=== RUN   TestDownloadOnly/v1.20.0/json-events

aaa_download_only_test.go:81: (dbg) Run:  out/minikube-darwin-arm64 start -o=json --download-only -p download-only-185000 --force --alsologtostderr --kubernetes-version=v1.20.0 --container-runtime=docker --driver=qemu2 

aaa_download_only_test.go:81: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -o=json --download-only -p download-only-185000 --force --alsologtostderr --kubernetes-version=v1.20.0 --container-runtime=docker --driver=qemu2 : exit status 40 (30.093684084s)

-- stdout --

	{"specversion":"1.0","id":"3a92a786-b870-4439-91b2-fe02053156c8","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[download-only-185000] minikube v1.34.0 on Darwin 15.0.1 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}

	{"specversion":"1.0","id":"a2e5baf4-8ea8-4c37-a854-79b030e0c621","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=19780"}}

	{"specversion":"1.0","id":"da904534-fd12-4c06-a2c8-3013fd25a309","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/Users/jenkins/minikube-integration/19780-1164/kubeconfig"}}

	{"specversion":"1.0","id":"796a1bbb-7233-4426-8998-9745da020b85","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-darwin-arm64"}}

	{"specversion":"1.0","id":"4a52890a-c2e0-4925-a9b8-4174df1b26f3","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}

	{"specversion":"1.0","id":"eaf3caa2-84f1-41c3-92a6-3b89135cd20e","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/Users/jenkins/minikube-integration/19780-1164/.minikube"}}

	{"specversion":"1.0","id":"c5b98d93-b699-4daa-83c2-e5e63502b6f1","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.warning","datacontenttype":"application/json","data":{"message":"minikube skips various validations when --force is supplied; this may lead to unexpected behavior"}}

	{"specversion":"1.0","id":"328436ae-a7be-4330-8aa7-e146bc72c073","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the qemu2 driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}

	{"specversion":"1.0","id":"bd639835-10b1-453d-a087-d43e79970d8b","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Automatically selected the socket_vmnet network"}}

	{"specversion":"1.0","id":"40afca57-74e2-45b2-b05d-f514f84f5a57","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Downloading VM boot image ...","name":"Selecting Driver","totalsteps":"19"}}

	{"specversion":"1.0","id":"ae4b5d65-9b16-4e23-852c-02ea5e3b914f","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting \"download-only-185000\" primary control-plane node in \"download-only-185000\" cluster","name":"Starting Node","totalsteps":"19"}}

	{"specversion":"1.0","id":"9e5ea405-a5de-44c8-ad1f-171e593c0905","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Downloading Kubernetes v1.20.0 preload ...","name":"Starting Node","totalsteps":"19"}}

	{"specversion":"1.0","id":"d97232a9-5df9-4a72-b822-3b482061302c","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"40","issues":"","message":"Failed to cache kubectl: download failed: https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256: getter: \u0026{Ctx:context.Background Src:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256 Dst:/Users/jenkins/minikube-integration/19780-1164/.minikube/cache/darwin/arm64/v1.20.0/kubectl.download Pwd: Mode:2 Umask:---------- Detectors:[0x1074bcfa0 0x1074bcfa0 0x1074bcfa0 0x1074bcfa0 0x1074bcfa0 0x1074bcfa0 0x1074bcfa0] Decompressors:map[bz2:0x140003f9830 gz:0x140003f9838 tar:0x140003f9790 tar.bz2:0x140003f97a0 tar.gz:0x140003f97e0 tar.xz:0x140003f97f0 tar.zst:0x140003f9820 tbz2:0x140003f97a0 tgz:0x14

0003f97e0 txz:0x140003f97f0 tzst:0x140003f9820 xz:0x140003f9840 zip:0x140003f9850 zst:0x140003f9848] Getters:map[file:0x14000a18680 http:0x140008ba0a0 https:0x140008ba190] Dir:false ProgressListener:\u003cnil\u003e Insecure:false DisableSymlinks:false Options:[]}: invalid checksum: Error downloading checksum file: bad response code: 404","name":"INET_CACHE_KUBECTL","url":""}}

	{"specversion":"1.0","id":"2ba83465-d607-48ea-a7ab-05a3704a4e57","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"╭───────────────────────────────────────────────────────────────────────────────────────────╮\n│                                                                                           │\n│    If the above advice does not help, please let us know:                                 │\n│    https://github.com/kubernetes/minikube/issues/new/choose                               │\n│                                                                                           │\n│    Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │\n│

│\n╰───────────────────────────────────────────────────────────────────────────────────────────╯"}}

-- /stdout --

** stderr ** 

	I1009 11:45:34.333131    1687 out.go:345] Setting OutFile to fd 1 ...

	I1009 11:45:34.333300    1687 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 11:45:34.333304    1687 out.go:358] Setting ErrFile to fd 2...

	I1009 11:45:34.333306    1687 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 11:45:34.333445    1687 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19780-1164/.minikube/bin

	W1009 11:45:34.333534    1687 root.go:314] Error reading config file at /Users/jenkins/minikube-integration/19780-1164/.minikube/config/config.json: open /Users/jenkins/minikube-integration/19780-1164/.minikube/config/config.json: no such file or directory

	I1009 11:45:34.334957    1687 out.go:352] Setting JSON to true

	I1009 11:45:34.353626    1687 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":904,"bootTime":1728498630,"procs":520,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}

	W1009 11:45:34.353698    1687 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I1009 11:45:34.358820    1687 out.go:97] [download-only-185000] minikube v1.34.0 on Darwin 15.0.1 (arm64)

	I1009 11:45:34.358941    1687 notify.go:220] Checking for updates...

	W1009 11:45:34.358980    1687 preload.go:293] Failed to list preload files: open /Users/jenkins/minikube-integration/19780-1164/.minikube/cache/preloaded-tarball: no such file or directory

	I1009 11:45:34.361823    1687 out.go:169] MINIKUBE_LOCATION=19780

	I1009 11:45:34.369785    1687 out.go:169] KUBECONFIG=/Users/jenkins/minikube-integration/19780-1164/kubeconfig

	I1009 11:45:34.375801    1687 out.go:169] MINIKUBE_BIN=out/minikube-darwin-arm64

	I1009 11:45:34.378826    1687 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1009 11:45:34.379972    1687 out.go:169] MINIKUBE_HOME=/Users/jenkins/minikube-integration/19780-1164/.minikube

	W1009 11:45:34.386898    1687 out.go:321] minikube skips various validations when --force is supplied; this may lead to unexpected behavior

	I1009 11:45:34.387102    1687 driver.go:394] Setting default libvirt URI to qemu:///system

	I1009 11:45:34.390838    1687 out.go:97] Using the qemu2 driver based on user configuration

	I1009 11:45:34.390860    1687 start.go:297] selected driver: qemu2

	I1009 11:45:34.390890    1687 start.go:901] validating driver "qemu2" against <nil>

	I1009 11:45:34.390978    1687 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I1009 11:45:34.394867    1687 out.go:169] Automatically selected the socket_vmnet network

	I1009 11:45:34.399100    1687 start_flags.go:393] Using suggested 4000MB memory alloc based on sys=16384MB, container=0MB

	I1009 11:45:34.399233    1687 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]

	I1009 11:45:34.399269    1687 cni.go:84] Creating CNI manager for ""

	I1009 11:45:34.399300    1687 cni.go:162] CNI unnecessary in this configuration, recommending no CNI

	I1009 11:45:34.399348    1687 start.go:340] cluster config:

	{Name:download-only-185000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:download-only-185000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Con

tainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSo

ck: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1009 11:45:34.404041    1687 iso.go:125] acquiring lock: {Name:mka6a0d59ae6cc32794e4fbfa8e5c6ce6a65e504 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1009 11:45:34.407796    1687 out.go:97] Downloading VM boot image ...

	I1009 11:45:34.407813    1687 download.go:107] Downloading: https://storage.googleapis.com/minikube-builds/iso/19774/minikube-v1.34.0-1728382514-19774-arm64.iso?checksum=file:https://storage.googleapis.com/minikube-builds/iso/19774/minikube-v1.34.0-1728382514-19774-arm64.iso.sha256 -> /Users/jenkins/minikube-integration/19780-1164/.minikube/cache/iso/arm64/minikube-v1.34.0-1728382514-19774-arm64.iso

	I1009 11:45:48.744440    1687 out.go:97] Starting "download-only-185000" primary control-plane node in "download-only-185000" cluster

	I1009 11:45:48.744460    1687 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker

	I1009 11:45:48.802717    1687 preload.go:118] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4

	I1009 11:45:48.802736    1687 cache.go:56] Caching tarball of preloaded images

	I1009 11:45:48.802954    1687 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker

	I1009 11:45:48.808167    1687 out.go:97] Downloading Kubernetes v1.20.0 preload ...

	I1009 11:45:48.808174    1687 preload.go:236] getting checksum for preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4 ...

	I1009 11:45:48.888437    1687 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4?checksum=md5:1a3e8f9b29e6affec63d76d0d3000942 -> /Users/jenkins/minikube-integration/19780-1164/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4

	I1009 11:46:02.906116    1687 preload.go:247] saving checksum for preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4 ...

	I1009 11:46:02.906283    1687 preload.go:254] verifying checksum of /Users/jenkins/minikube-integration/19780-1164/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4 ...

	I1009 11:46:03.601492    1687 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on docker

	I1009 11:46:03.601688    1687 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/download-only-185000/config.json ...

	I1009 11:46:03.601704    1687 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/download-only-185000/config.json: {Name:mkd0352330e63ea9488a0405dc95f822cf67234d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1009 11:46:03.601979    1687 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker

	I1009 11:46:03.602205    1687 download.go:107] Downloading: https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256 -> /Users/jenkins/minikube-integration/19780-1164/.minikube/cache/darwin/arm64/v1.20.0/kubectl

	I1009 11:46:04.346361    1687 out.go:193] 

	W1009 11:46:04.351405    1687 out_reason.go:110] Failed to cache kubectl: download failed: https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256: getter: &{Ctx:context.Background Src:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256 Dst:/Users/jenkins/minikube-integration/19780-1164/.minikube/cache/darwin/arm64/v1.20.0/kubectl.download Pwd: Mode:2 Umask:---------- Detectors:[0x1074bcfa0 0x1074bcfa0 0x1074bcfa0 0x1074bcfa0 0x1074bcfa0 0x1074bcfa0 0x1074bcfa0] Decompressors:map[bz2:0x140003f9830 gz:0x140003f9838 tar:0x140003f9790 tar.bz2:0x140003f97a0 tar.gz:0x140003f97e0 tar.xz:0x140003f97f0 tar.zst:0x140003f9820 tbz2:0x140003f97a0 tgz:0x140003f97e0 txz:0x140003f97f0 tzst:0x140003f9820 xz:0x140003f9840 zip:0x140003f9850 zst:0x140003f9848] Getters:map[file:0x14000a18680 http:0x140008ba0a0 https:0x140008ba190] Dir:false ProgressList

ener:<nil> Insecure:false DisableSymlinks:false Options:[]}: invalid checksum: Error downloading checksum file: bad response code: 404

	W1009 11:46:04.351432    1687 out_reason.go:110] 

	W1009 11:46:04.358327    1687 out.go:283] ╭───────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                           │

	│    If the above advice does not help, please let us know:                                 │

	│    https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                           │

	│    Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                           │

	╰───────────────────────────────────────────────────────────────────────────────────────────╯

	I1009 11:46:04.361360    1687 out.go:193] 

** /stderr **

aaa_download_only_test.go:83: failed to download only. args: ["start" "-o=json" "--download-only" "-p" "download-only-185000" "--force" "--alsologtostderr" "--kubernetes-version=v1.20.0" "--container-runtime=docker" "--driver=qemu2" ""] exit status 40

--- FAIL: TestDownloadOnly/v1.20.0/json-events (30.10s)

=== RUN   TestDownloadOnly/v1.20.0/kubectl

aaa_download_only_test.go:175: expected the file for binary exist at "/Users/jenkins/minikube-integration/19780-1164/.minikube/cache/darwin/arm64/v1.20.0/kubectl" but got error stat /Users/jenkins/minikube-integration/19780-1164/.minikube/cache/darwin/arm64/v1.20.0/kubectl: no such file or directory

--- FAIL: TestDownloadOnly/v1.20.0/kubectl (0.00s)

=== RUN   TestOffline

=== PAUSE TestOffline

=== CONT  TestOffline

aab_offline_test.go:55: (dbg) Run:  out/minikube-darwin-arm64 start -p offline-docker-935000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=qemu2 

aab_offline_test.go:55: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p offline-docker-935000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=qemu2 : exit status 80 (9.838519792s)

-- stdout --

	* [offline-docker-935000] minikube v1.34.0 on Darwin 15.0.1 (arm64)

	  - MINIKUBE_LOCATION=19780

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19780-1164/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19780-1164/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "offline-docker-935000" primary control-plane node in "offline-docker-935000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "offline-docker-935000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I1009 12:40:34.109877    3844 out.go:345] Setting OutFile to fd 1 ...

	I1009 12:40:34.110014    3844 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:40:34.110018    3844 out.go:358] Setting ErrFile to fd 2...

	I1009 12:40:34.110021    3844 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:40:34.110176    3844 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19780-1164/.minikube/bin

	I1009 12:40:34.111417    3844 out.go:352] Setting JSON to false

	I1009 12:40:34.130367    3844 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":4204,"bootTime":1728498630,"procs":518,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}

	W1009 12:40:34.130447    3844 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I1009 12:40:34.136005    3844 out.go:177] * [offline-docker-935000] minikube v1.34.0 on Darwin 15.0.1 (arm64)

	I1009 12:40:34.142865    3844 out.go:177]   - MINIKUBE_LOCATION=19780

	I1009 12:40:34.142907    3844 notify.go:220] Checking for updates...

	I1009 12:40:34.150878    3844 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19780-1164/kubeconfig

	I1009 12:40:34.153980    3844 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I1009 12:40:34.156822    3844 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1009 12:40:34.159804    3844 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19780-1164/.minikube

	I1009 12:40:34.166855    3844 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I1009 12:40:34.171232    3844 config.go:182] Loaded profile config "multinode-341000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I1009 12:40:34.171284    3844 driver.go:394] Setting default libvirt URI to qemu:///system

	I1009 12:40:34.174785    3844 out.go:177] * Using the qemu2 driver based on user configuration

	I1009 12:40:34.181876    3844 start.go:297] selected driver: qemu2

	I1009 12:40:34.181892    3844 start.go:901] validating driver "qemu2" against <nil>

	I1009 12:40:34.181903    3844 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I1009 12:40:34.184168    3844 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I1009 12:40:34.188807    3844 out.go:177] * Automatically selected the socket_vmnet network

	I1009 12:40:34.191920    3844 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I1009 12:40:34.191937    3844 cni.go:84] Creating CNI manager for ""

	I1009 12:40:34.191962    3844 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I1009 12:40:34.191965    3844 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I1009 12:40:34.192014    3844 start.go:340] cluster config:

	{Name:offline-docker-935000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:offline-docker-935000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C

ontainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bi

n/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1009 12:40:34.196729    3844 iso.go:125] acquiring lock: {Name:mka6a0d59ae6cc32794e4fbfa8e5c6ce6a65e504 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1009 12:40:34.200874    3844 out.go:177] * Starting "offline-docker-935000" primary control-plane node in "offline-docker-935000" cluster

	I1009 12:40:34.212819    3844 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime docker

	I1009 12:40:34.212868    3844 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19780-1164/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4

	I1009 12:40:34.212878    3844 cache.go:56] Caching tarball of preloaded images

	I1009 12:40:34.212976    3844 preload.go:172] Found /Users/jenkins/minikube-integration/19780-1164/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I1009 12:40:34.212982    3844 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on docker

	I1009 12:40:34.213045    3844 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/offline-docker-935000/config.json ...

	I1009 12:40:34.213056    3844 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/offline-docker-935000/config.json: {Name:mk56db15713882f64743bdeb632156bfdbda1160 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1009 12:40:34.213352    3844 start.go:360] acquireMachinesLock for offline-docker-935000: {Name:mk6dc29eb74286120c58954bae0cd65a85a89b02 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1009 12:40:34.213398    3844 start.go:364] duration metric: took 36.625µs to acquireMachinesLock for "offline-docker-935000"

	I1009 12:40:34.213407    3844 start.go:93] Provisioning new machine with config: &{Name:offline-docker-935000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19774/minikube-v1.34.0-1728382514-19774-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf

ig:{KubernetesVersion:v1.31.1 ClusterName:offline-docker-935000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 Mou

ntOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1009 12:40:34.213431    3844 start.go:125] createHost starting for "" (driver="qemu2")

	I1009 12:40:34.217861    3844 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I1009 12:40:34.233282    3844 start.go:159] libmachine.API.Create for "offline-docker-935000" (driver="qemu2")

	I1009 12:40:34.233317    3844 client.go:168] LocalClient.Create starting

	I1009 12:40:34.233390    3844 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19780-1164/.minikube/certs/ca.pem

	I1009 12:40:34.233432    3844 main.go:141] libmachine: Decoding PEM data...

	I1009 12:40:34.233444    3844 main.go:141] libmachine: Parsing certificate...

	I1009 12:40:34.233488    3844 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19780-1164/.minikube/certs/cert.pem

	I1009 12:40:34.233517    3844 main.go:141] libmachine: Decoding PEM data...

	I1009 12:40:34.233525    3844 main.go:141] libmachine: Parsing certificate...

	I1009 12:40:34.233905    3844 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19780-1164/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19780-1164/.minikube/cache/iso/arm64/minikube-v1.34.0-1728382514-19774-arm64.iso...

	I1009 12:40:34.384773    3844 main.go:141] libmachine: Creating SSH key...

	I1009 12:40:34.447747    3844 main.go:141] libmachine: Creating Disk image...

	I1009 12:40:34.447763    3844 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I1009 12:40:34.447961    3844 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/offline-docker-935000/disk.qcow2.raw /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/offline-docker-935000/disk.qcow2

	I1009 12:40:34.458479    3844 main.go:141] libmachine: STDOUT: 

	I1009 12:40:34.458500    3844 main.go:141] libmachine: STDERR: 

	I1009 12:40:34.458569    3844 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/offline-docker-935000/disk.qcow2 +20000M

	I1009 12:40:34.468002    3844 main.go:141] libmachine: STDOUT: Image resized.

	I1009 12:40:34.468039    3844 main.go:141] libmachine: STDERR: 

	I1009 12:40:34.468060    3844 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/offline-docker-935000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/offline-docker-935000/disk.qcow2

	I1009 12:40:34.468067    3844 main.go:141] libmachine: Starting QEMU VM...

	I1009 12:40:34.468078    3844 qemu.go:418] Using hvf for hardware acceleration

	I1009 12:40:34.468118    3844 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/offline-docker-935000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19780-1164/.minikube/machines/offline-docker-935000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/offline-docker-935000/qemu.pid -device virtio-net-pci,netdev=net0,mac=12:e1:e9:62:ee:41 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/offline-docker-935000/disk.qcow2

	I1009 12:40:34.469975    3844 main.go:141] libmachine: STDOUT: 

	I1009 12:40:34.469991    3844 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I1009 12:40:34.470012    3844 client.go:171] duration metric: took 236.696125ms to LocalClient.Create

	I1009 12:40:36.471982    3844 start.go:128] duration metric: took 2.258609542s to createHost

	I1009 12:40:36.471995    3844 start.go:83] releasing machines lock for "offline-docker-935000", held for 2.258657917s

	W1009 12:40:36.472010    3844 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I1009 12:40:36.475132    3844 out.go:177] * Deleting "offline-docker-935000" in qemu2 ...

	W1009 12:40:36.486573    3844 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I1009 12:40:36.486580    3844 start.go:729] Will try again in 5 seconds ...

	I1009 12:40:41.488608    3844 start.go:360] acquireMachinesLock for offline-docker-935000: {Name:mk6dc29eb74286120c58954bae0cd65a85a89b02 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1009 12:40:41.489211    3844 start.go:364] duration metric: took 471.708µs to acquireMachinesLock for "offline-docker-935000"

	I1009 12:40:41.489360    3844 start.go:93] Provisioning new machine with config: &{Name:offline-docker-935000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19774/minikube-v1.34.0-1728382514-19774-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf

ig:{KubernetesVersion:v1.31.1 ClusterName:offline-docker-935000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 Mou

ntOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1009 12:40:41.489716    3844 start.go:125] createHost starting for "" (driver="qemu2")

	I1009 12:40:41.503405    3844 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I1009 12:40:41.551903    3844 start.go:159] libmachine.API.Create for "offline-docker-935000" (driver="qemu2")

	I1009 12:40:41.551964    3844 client.go:168] LocalClient.Create starting

	I1009 12:40:41.552152    3844 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19780-1164/.minikube/certs/ca.pem

	I1009 12:40:41.552246    3844 main.go:141] libmachine: Decoding PEM data...

	I1009 12:40:41.552262    3844 main.go:141] libmachine: Parsing certificate...

	I1009 12:40:41.552331    3844 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19780-1164/.minikube/certs/cert.pem

	I1009 12:40:41.552392    3844 main.go:141] libmachine: Decoding PEM data...

	I1009 12:40:41.552408    3844 main.go:141] libmachine: Parsing certificate...

	I1009 12:40:41.552970    3844 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19780-1164/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19780-1164/.minikube/cache/iso/arm64/minikube-v1.34.0-1728382514-19774-arm64.iso...

	I1009 12:40:41.719683    3844 main.go:141] libmachine: Creating SSH key...

	I1009 12:40:41.847781    3844 main.go:141] libmachine: Creating Disk image...

	I1009 12:40:41.847787    3844 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I1009 12:40:41.847999    3844 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/offline-docker-935000/disk.qcow2.raw /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/offline-docker-935000/disk.qcow2

	I1009 12:40:41.858074    3844 main.go:141] libmachine: STDOUT: 

	I1009 12:40:41.858093    3844 main.go:141] libmachine: STDERR: 

	I1009 12:40:41.858144    3844 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/offline-docker-935000/disk.qcow2 +20000M

	I1009 12:40:41.866657    3844 main.go:141] libmachine: STDOUT: Image resized.

	I1009 12:40:41.866681    3844 main.go:141] libmachine: STDERR: 

	I1009 12:40:41.866694    3844 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/offline-docker-935000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/offline-docker-935000/disk.qcow2

	I1009 12:40:41.866702    3844 main.go:141] libmachine: Starting QEMU VM...

	I1009 12:40:41.866709    3844 qemu.go:418] Using hvf for hardware acceleration

	I1009 12:40:41.866740    3844 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/offline-docker-935000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19780-1164/.minikube/machines/offline-docker-935000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/offline-docker-935000/qemu.pid -device virtio-net-pci,netdev=net0,mac=76:28:48:08:ed:c2 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/offline-docker-935000/disk.qcow2

	I1009 12:40:41.868503    3844 main.go:141] libmachine: STDOUT: 

	I1009 12:40:41.868516    3844 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I1009 12:40:41.868529    3844 client.go:171] duration metric: took 316.563709ms to LocalClient.Create

	I1009 12:40:43.870707    3844 start.go:128] duration metric: took 2.38099475s to createHost

	I1009 12:40:43.870793    3844 start.go:83] releasing machines lock for "offline-docker-935000", held for 2.38161575s

	W1009 12:40:43.871240    3844 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p offline-docker-935000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p offline-docker-935000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I1009 12:40:43.882939    3844 out.go:201] 

	W1009 12:40:43.885871    3844 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W1009 12:40:43.885894    3844 out.go:270] * 

	* 

	W1009 12:40:43.888804    3844 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I1009 12:40:43.899895    3844 out.go:201] 

** /stderr **

aab_offline_test.go:58: out/minikube-darwin-arm64 start -p offline-docker-935000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=qemu2  failed: exit status 80

panic.go:629: *** TestOffline FAILED at 2024-10-09 12:40:43.916264 -0700 PDT m=+3309.780246043

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p offline-docker-935000 -n offline-docker-935000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p offline-docker-935000 -n offline-docker-935000: exit status 7 (71.775666ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "offline-docker-935000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "offline-docker-935000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p offline-docker-935000

--- FAIL: TestOffline (10.01s)

=== RUN   TestAddons/Setup

addons_test.go:107: (dbg) Run:  out/minikube-darwin-arm64 start -p addons-953000 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=nvidia-device-plugin --addons=yakd --addons=volcano --driver=qemu2  --addons=ingress --addons=ingress-dns --addons=storage-provisioner-rancher

addons_test.go:107: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p addons-953000 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=nvidia-device-plugin --addons=yakd --addons=volcano --driver=qemu2  --addons=ingress --addons=ingress-dns --addons=storage-provisioner-rancher: exit status 90 (1m24.858135333s)

-- stdout --

	* [addons-953000] minikube v1.34.0 on Darwin 15.0.1 (arm64)

	  - MINIKUBE_LOCATION=19780

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19780-1164/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19780-1164/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "addons-953000" primary control-plane node in "addons-953000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

-- /stdout --

** stderr ** 

	I1009 11:46:19.061653    1765 out.go:345] Setting OutFile to fd 1 ...

	I1009 11:46:19.061810    1765 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 11:46:19.061814    1765 out.go:358] Setting ErrFile to fd 2...

	I1009 11:46:19.061816    1765 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 11:46:19.061938    1765 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19780-1164/.minikube/bin

	I1009 11:46:19.063136    1765 out.go:352] Setting JSON to false

	I1009 11:46:19.080758    1765 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":949,"bootTime":1728498630,"procs":506,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}

	W1009 11:46:19.080820    1765 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I1009 11:46:19.087590    1765 out.go:177] * [addons-953000] minikube v1.34.0 on Darwin 15.0.1 (arm64)

	I1009 11:46:19.094824    1765 out.go:177]   - MINIKUBE_LOCATION=19780

	I1009 11:46:19.094853    1765 notify.go:220] Checking for updates...

	I1009 11:46:19.101707    1765 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19780-1164/kubeconfig

	I1009 11:46:19.104697    1765 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I1009 11:46:19.107649    1765 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1009 11:46:19.110709    1765 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19780-1164/.minikube

	I1009 11:46:19.113715    1765 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I1009 11:46:19.116911    1765 driver.go:394] Setting default libvirt URI to qemu:///system

	I1009 11:46:19.120723    1765 out.go:177] * Using the qemu2 driver based on user configuration

	I1009 11:46:19.127713    1765 start.go:297] selected driver: qemu2

	I1009 11:46:19.127722    1765 start.go:901] validating driver "qemu2" against <nil>

	I1009 11:46:19.127730    1765 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I1009 11:46:19.130293    1765 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I1009 11:46:19.133662    1765 out.go:177] * Automatically selected the socket_vmnet network

	I1009 11:46:19.136831    1765 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I1009 11:46:19.136849    1765 cni.go:84] Creating CNI manager for ""

	I1009 11:46:19.136869    1765 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I1009 11:46:19.136874    1765 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I1009 11:46:19.136899    1765 start.go:340] cluster config:

	{Name:addons-953000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-953000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:

docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_c

lient SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1009 11:46:19.141558    1765 iso.go:125] acquiring lock: {Name:mka6a0d59ae6cc32794e4fbfa8e5c6ce6a65e504 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1009 11:46:19.148696    1765 out.go:177] * Starting "addons-953000" primary control-plane node in "addons-953000" cluster

	I1009 11:46:19.152726    1765 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime docker

	I1009 11:46:19.152741    1765 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19780-1164/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4

	I1009 11:46:19.152748    1765 cache.go:56] Caching tarball of preloaded images

	I1009 11:46:19.152826    1765 preload.go:172] Found /Users/jenkins/minikube-integration/19780-1164/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I1009 11:46:19.152831    1765 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on docker

	I1009 11:46:19.153026    1765 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/addons-953000/config.json ...

	I1009 11:46:19.153037    1765 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/addons-953000/config.json: {Name:mk2faf6376c8b3ecc65738f754eb7a8bb061043d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1009 11:46:19.153370    1765 start.go:360] acquireMachinesLock for addons-953000: {Name:mk6dc29eb74286120c58954bae0cd65a85a89b02 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1009 11:46:19.153463    1765 start.go:364] duration metric: took 86.791µs to acquireMachinesLock for "addons-953000"

	I1009 11:46:19.153473    1765 start.go:93] Provisioning new machine with config: &{Name:addons-953000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19774/minikube-v1.34.0-1728382514-19774-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kube

rnetesVersion:v1.31.1 ClusterName:addons-953000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mou

ntPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1009 11:46:19.153506    1765 start.go:125] createHost starting for "" (driver="qemu2")

	I1009 11:46:19.160740    1765 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	I1009 11:46:19.394851    1765 start.go:159] libmachine.API.Create for "addons-953000" (driver="qemu2")

	I1009 11:46:19.394884    1765 client.go:168] LocalClient.Create starting

	I1009 11:46:19.395080    1765 main.go:141] libmachine: Creating CA: /Users/jenkins/minikube-integration/19780-1164/.minikube/certs/ca.pem

	I1009 11:46:19.435331    1765 main.go:141] libmachine: Creating client certificate: /Users/jenkins/minikube-integration/19780-1164/.minikube/certs/cert.pem

	I1009 11:46:19.636553    1765 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19780-1164/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19780-1164/.minikube/cache/iso/arm64/minikube-v1.34.0-1728382514-19774-arm64.iso...

	I1009 11:46:20.401201    1765 main.go:141] libmachine: Creating SSH key...

	I1009 11:46:20.506700    1765 main.go:141] libmachine: Creating Disk image...

	I1009 11:46:20.506706    1765 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I1009 11:46:20.506972    1765 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/addons-953000/disk.qcow2.raw /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/addons-953000/disk.qcow2

	I1009 11:46:20.526932    1765 main.go:141] libmachine: STDOUT: 

	I1009 11:46:20.526980    1765 main.go:141] libmachine: STDERR: 

	I1009 11:46:20.527051    1765 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/addons-953000/disk.qcow2 +20000M

	I1009 11:46:20.535772    1765 main.go:141] libmachine: STDOUT: Image resized.

	I1009 11:46:20.535788    1765 main.go:141] libmachine: STDERR: 

	I1009 11:46:20.535804    1765 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/addons-953000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/addons-953000/disk.qcow2

	I1009 11:46:20.535809    1765 main.go:141] libmachine: Starting QEMU VM...

	I1009 11:46:20.535849    1765 qemu.go:418] Using hvf for hardware acceleration

	I1009 11:46:20.535882    1765 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 4000 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/addons-953000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19780-1164/.minikube/machines/addons-953000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/addons-953000/qemu.pid -device virtio-net-pci,netdev=net0,mac=fa:15:02:02:89:77 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/addons-953000/disk.qcow2

	I1009 11:46:20.595299    1765 main.go:141] libmachine: STDOUT: 

	I1009 11:46:20.595344    1765 main.go:141] libmachine: STDERR: 

	I1009 11:46:20.595348    1765 main.go:141] libmachine: Attempt 0

	I1009 11:46:20.595361    1765 main.go:141] libmachine: Searching for fa:15:2:2:89:77 in /var/db/dhcpd_leases ...

	I1009 11:46:20.595455    1765 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I1009 11:46:20.595473    1765 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:da:98:b3:c0:e3:d9 ID:1,da:98:b3:c0:e3:d9 Lease:0x6706d9ed}

	I1009 11:46:22.597649    1765 main.go:141] libmachine: Attempt 1

	I1009 11:46:22.597734    1765 main.go:141] libmachine: Searching for fa:15:2:2:89:77 in /var/db/dhcpd_leases ...

	I1009 11:46:22.598076    1765 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I1009 11:46:22.598130    1765 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:da:98:b3:c0:e3:d9 ID:1,da:98:b3:c0:e3:d9 Lease:0x6706d9ed}

	I1009 11:46:24.600370    1765 main.go:141] libmachine: Attempt 2

	I1009 11:46:24.600583    1765 main.go:141] libmachine: Searching for fa:15:2:2:89:77 in /var/db/dhcpd_leases ...

	I1009 11:46:24.600932    1765 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I1009 11:46:24.600991    1765 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:da:98:b3:c0:e3:d9 ID:1,da:98:b3:c0:e3:d9 Lease:0x6706d9ed}

	I1009 11:46:26.603147    1765 main.go:141] libmachine: Attempt 3

	I1009 11:46:26.603179    1765 main.go:141] libmachine: Searching for fa:15:2:2:89:77 in /var/db/dhcpd_leases ...

	I1009 11:46:26.603263    1765 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I1009 11:46:26.603281    1765 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:da:98:b3:c0:e3:d9 ID:1,da:98:b3:c0:e3:d9 Lease:0x6706d9ed}

	I1009 11:46:28.605303    1765 main.go:141] libmachine: Attempt 4

	I1009 11:46:28.605315    1765 main.go:141] libmachine: Searching for fa:15:2:2:89:77 in /var/db/dhcpd_leases ...

	I1009 11:46:28.605356    1765 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I1009 11:46:28.605364    1765 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:da:98:b3:c0:e3:d9 ID:1,da:98:b3:c0:e3:d9 Lease:0x6706d9ed}

	I1009 11:46:30.607397    1765 main.go:141] libmachine: Attempt 5

	I1009 11:46:30.607404    1765 main.go:141] libmachine: Searching for fa:15:2:2:89:77 in /var/db/dhcpd_leases ...

	I1009 11:46:30.607445    1765 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I1009 11:46:30.607451    1765 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:da:98:b3:c0:e3:d9 ID:1,da:98:b3:c0:e3:d9 Lease:0x6706d9ed}

	I1009 11:46:32.609481    1765 main.go:141] libmachine: Attempt 6

	I1009 11:46:32.609501    1765 main.go:141] libmachine: Searching for fa:15:2:2:89:77 in /var/db/dhcpd_leases ...

	I1009 11:46:32.609594    1765 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I1009 11:46:32.609604    1765 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:da:98:b3:c0:e3:d9 ID:1,da:98:b3:c0:e3:d9 Lease:0x6706d9ed}

	I1009 11:46:34.611635    1765 main.go:141] libmachine: Attempt 7

	I1009 11:46:34.611681    1765 main.go:141] libmachine: Searching for fa:15:2:2:89:77 in /var/db/dhcpd_leases ...

	I1009 11:46:34.611811    1765 main.go:141] libmachine: Found 2 entries in /var/db/dhcpd_leases!

	I1009 11:46:34.611824    1765 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:fa:15:2:2:89:77 ID:1,fa:15:2:2:89:77 Lease:0x6706dd99}

	I1009 11:46:34.611828    1765 main.go:141] libmachine: Found match: fa:15:2:2:89:77

	I1009 11:46:34.611838    1765 main.go:141] libmachine: IP: 192.168.105.2

	I1009 11:46:34.611843    1765 main.go:141] libmachine: Waiting for VM to start (ssh -p 22 docker@192.168.105.2)...

	I1009 11:46:36.630763    1765 machine.go:93] provisionDockerMachine start ...

	I1009 11:46:36.632122    1765 main.go:141] libmachine: Using SSH client type: native

	I1009 11:46:36.632608    1765 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10507a480] 0x10507ccc0 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I1009 11:46:36.632622    1765 main.go:141] libmachine: About to run SSH command:

	hostname

	I1009 11:46:36.662553    1765 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain

	I1009 11:46:39.750031    1765 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube

	I1009 11:46:39.750088    1765 buildroot.go:166] provisioning hostname "addons-953000"

	I1009 11:46:39.750250    1765 main.go:141] libmachine: Using SSH client type: native

	I1009 11:46:39.750496    1765 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10507a480] 0x10507ccc0 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I1009 11:46:39.750507    1765 main.go:141] libmachine: About to run SSH command:

	sudo hostname addons-953000 && echo "addons-953000" | sudo tee /etc/hostname

	I1009 11:46:39.817060    1765 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-953000

	I1009 11:46:39.817156    1765 main.go:141] libmachine: Using SSH client type: native

	I1009 11:46:39.817325    1765 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10507a480] 0x10507ccc0 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I1009 11:46:39.817337    1765 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\saddons-953000' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-953000/g' /etc/hosts;

				else 

					echo '127.0.1.1 addons-953000' | sudo tee -a /etc/hosts; 

				fi

			fi

	I1009 11:46:39.873075    1765 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I1009 11:46:39.873085    1765 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/19780-1164/.minikube CaCertPath:/Users/jenkins/minikube-integration/19780-1164/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/19780-1164/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/19780-1164/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/19780-1164/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/19780-1164/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/19780-1164/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/19780-1164/.minikube}

	I1009 11:46:39.873093    1765 buildroot.go:174] setting up certificates

	I1009 11:46:39.873098    1765 provision.go:84] configureAuth start

	I1009 11:46:39.873106    1765 provision.go:143] copyHostCerts

	I1009 11:46:39.873202    1765 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19780-1164/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/19780-1164/.minikube/ca.pem (1078 bytes)

	I1009 11:46:39.873766    1765 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19780-1164/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/19780-1164/.minikube/cert.pem (1123 bytes)

	I1009 11:46:39.873938    1765 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19780-1164/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/19780-1164/.minikube/key.pem (1679 bytes)

	I1009 11:46:39.874062    1765 provision.go:117] generating server cert: /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/19780-1164/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/19780-1164/.minikube/certs/ca-key.pem org=jenkins.addons-953000 san=[127.0.0.1 192.168.105.2 addons-953000 localhost minikube]

	I1009 11:46:40.302373    1765 provision.go:177] copyRemoteCerts

	I1009 11:46:40.302501    1765 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I1009 11:46:40.302526    1765 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19780-1164/.minikube/machines/addons-953000/id_rsa Username:docker}

	I1009 11:46:40.331645    1765 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19780-1164/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I1009 11:46:40.340221    1765 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I1009 11:46:40.348609    1765 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I1009 11:46:40.358730    1765 provision.go:87] duration metric: took 485.624333ms to configureAuth

	I1009 11:46:40.358743    1765 buildroot.go:189] setting minikube options for container-runtime

	I1009 11:46:40.358862    1765 config.go:182] Loaded profile config "addons-953000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I1009 11:46:40.358915    1765 main.go:141] libmachine: Using SSH client type: native

	I1009 11:46:40.359012    1765 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10507a480] 0x10507ccc0 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I1009 11:46:40.359017    1765 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I1009 11:46:40.409847    1765 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I1009 11:46:40.409858    1765 buildroot.go:70] root file system type: tmpfs

	I1009 11:46:40.409909    1765 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...

	I1009 11:46:40.409994    1765 main.go:141] libmachine: Using SSH client type: native

	I1009 11:46:40.410101    1765 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10507a480] 0x10507ccc0 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I1009 11:46:40.410136    1765 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %s "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I1009 11:46:40.466691    1765 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I1009 11:46:40.466757    1765 main.go:141] libmachine: Using SSH client type: native

	I1009 11:46:40.466873    1765 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10507a480] 0x10507ccc0 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I1009 11:46:40.466881    1765 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I1009 11:46:41.826796    1765 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory

	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.

	I1009 11:46:41.826808    1765 machine.go:96] duration metric: took 5.196086s to provisionDockerMachine

	I1009 11:46:41.826816    1765 client.go:171] duration metric: took 22.432210208s to LocalClient.Create

	I1009 11:46:41.826829    1765 start.go:167] duration metric: took 22.432268584s to libmachine.API.Create "addons-953000"

	I1009 11:46:41.826834    1765 start.go:293] postStartSetup for "addons-953000" (driver="qemu2")

	I1009 11:46:41.826841    1765 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I1009 11:46:41.826910    1765 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I1009 11:46:41.826929    1765 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19780-1164/.minikube/machines/addons-953000/id_rsa Username:docker}

	I1009 11:46:41.855077    1765 ssh_runner.go:195] Run: cat /etc/os-release

	I1009 11:46:41.856473    1765 info.go:137] Remote host: Buildroot 2023.02.9

	I1009 11:46:41.856479    1765 filesync.go:126] Scanning /Users/jenkins/minikube-integration/19780-1164/.minikube/addons for local assets ...

	I1009 11:46:41.856560    1765 filesync.go:126] Scanning /Users/jenkins/minikube-integration/19780-1164/.minikube/files for local assets ...

	I1009 11:46:41.856598    1765 start.go:296] duration metric: took 29.761209ms for postStartSetup

	I1009 11:46:41.856997    1765 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/addons-953000/config.json ...

	I1009 11:46:41.857207    1765 start.go:128] duration metric: took 22.70398425s to createHost

	I1009 11:46:41.857246    1765 main.go:141] libmachine: Using SSH client type: native

	I1009 11:46:41.857337    1765 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x10507a480] 0x10507ccc0 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I1009 11:46:41.857341    1765 main.go:141] libmachine: About to run SSH command:

	date +%s.%N

	I1009 11:46:41.905149    1765 main.go:141] libmachine: SSH cmd err, output: <nil>: 1728499602.330220796

	I1009 11:46:41.905159    1765 fix.go:216] guest clock: 1728499602.330220796

	I1009 11:46:41.905163    1765 fix.go:229] Guest: 2024-10-09 11:46:42.330220796 -0700 PDT Remote: 2024-10-09 11:46:41.857214 -0700 PDT m=+22.816642751 (delta=473.006796ms)

	I1009 11:46:41.905174    1765 fix.go:200] guest clock delta is within tolerance: 473.006796ms

	I1009 11:46:41.905177    1765 start.go:83] releasing machines lock for "addons-953000", held for 22.751996541s

	I1009 11:46:41.905486    1765 ssh_runner.go:195] Run: cat /version.json

	I1009 11:46:41.905496    1765 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19780-1164/.minikube/machines/addons-953000/id_rsa Username:docker}

	I1009 11:46:41.905487    1765 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I1009 11:46:41.905542    1765 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19780-1164/.minikube/machines/addons-953000/id_rsa Username:docker}

	I1009 11:46:42.154736    1765 ssh_runner.go:195] Run: systemctl --version

	I1009 11:46:42.165154    1765 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W1009 11:46:42.171432    1765 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I1009 11:46:42.171652    1765 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I1009 11:46:42.192475    1765 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I1009 11:46:42.192499    1765 start.go:495] detecting cgroup driver to use...

	I1009 11:46:42.192749    1765 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I1009 11:46:42.206889    1765 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"

	I1009 11:46:42.213811    1765 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I1009 11:46:42.220186    1765 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...

	I1009 11:46:42.220247    1765 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I1009 11:46:42.225609    1765 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I1009 11:46:42.230841    1765 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I1009 11:46:42.235881    1765 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I1009 11:46:42.240222    1765 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I1009 11:46:42.244449    1765 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I1009 11:46:42.248648    1765 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"

	I1009 11:46:42.252497    1765 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1  enable_unprivileged_ports = true|' /etc/containerd/config.toml"

	I1009 11:46:42.256323    1765 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I1009 11:46:42.259981    1765 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I1009 11:46:42.260008    1765 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I1009 11:46:42.264629    1765 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I1009 11:46:42.268266    1765 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1009 11:46:42.357568    1765 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I1009 11:46:42.365730    1765 start.go:495] detecting cgroup driver to use...

	I1009 11:46:42.365826    1765 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I1009 11:46:42.372134    1765 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1009 11:46:42.386168    1765 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I1009 11:46:42.403274    1765 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1009 11:46:42.409617    1765 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I1009 11:46:42.415989    1765 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I1009 11:46:42.458252    1765 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I1009 11:46:42.463597    1765 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I1009 11:46:42.470528    1765 ssh_runner.go:195] Run: which cri-dockerd

	I1009 11:46:42.471958    1765 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I1009 11:46:42.475473    1765 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (190 bytes)

	I1009 11:46:42.481472    1765 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I1009 11:46:42.566777    1765 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I1009 11:46:42.648735    1765 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...

	I1009 11:46:42.648803    1765 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)

	I1009 11:46:42.655315    1765 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1009 11:46:42.739364    1765 ssh_runner.go:195] Run: sudo systemctl restart docker

	I1009 11:47:43.824724    1765 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1m1.086084125s)

	I1009 11:47:43.825052    1765 ssh_runner.go:195] Run: sudo journalctl --no-pager -u docker

	I1009 11:47:43.859471    1765 out.go:201] 

	W1009 11:47:43.863518    1765 out.go:270] X Exiting due to RUNTIME_ENABLE: Failed to enable container runtime: sudo systemctl restart docker: Process exited with status 1

	stdout:

	stderr:

	Job for docker.service failed because the control process exited with error code.

	See "systemctl status docker.service" and "journalctl -xeu docker.service" for details.

	sudo journalctl --no-pager -u docker:

	-- stdout --

	Oct 09 18:46:41 addons-953000 systemd[1]: Starting Docker Application Container Engine...

	Oct 09 18:46:41 addons-953000 dockerd[545]: time="2024-10-09T18:46:41.112795129Z" level=info msg="Starting up"

	Oct 09 18:46:41 addons-953000 dockerd[545]: time="2024-10-09T18:46:41.113117629Z" level=info msg="containerd not running, starting managed containerd"

	Oct 09 18:46:41 addons-953000 dockerd[545]: time="2024-10-09T18:46:41.113542962Z" level=info msg="started new containerd process" address=/var/run/docker/containerd/containerd.sock module=libcontainerd pid=551

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.128892879Z" level=info msg="starting containerd" revision=7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c version=v1.7.22

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.137754129Z" level=info msg="loading plugin \"io.containerd.event.v1.exchange\"..." type=io.containerd.event.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.137768379Z" level=info msg="loading plugin \"io.containerd.internal.v1.opt\"..." type=io.containerd.internal.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.137789420Z" level=info msg="loading plugin \"io.containerd.warning.v1.deprecations\"..." type=io.containerd.warning.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.137795795Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.blockfile\"..." type=io.containerd.snapshotter.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.137821462Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.blockfile\"..." error="no scratch file generator: skip plugin" type=io.containerd.snapshotter.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.137827379Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.btrfs\"..." type=io.containerd.snapshotter.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.137895504Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.btrfs\"..." error="path /var/lib/docker/containerd/daemon/io.containerd.snapshotter.v1.btrfs (ext4) must be a btrfs filesystem to be used with the btrfs snapshotter: skip plugin" type=io.containerd.snapshotter.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.137905629Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.devmapper\"..." type=io.containerd.snapshotter.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.137911087Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.devmapper\"..." error="devmapper not configured: skip plugin" type=io.containerd.snapshotter.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.137916004Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.native\"..." type=io.containerd.snapshotter.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.137939254Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.overlayfs\"..." type=io.containerd.snapshotter.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.138043295Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.aufs\"..." type=io.containerd.snapshotter.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.138739045Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.aufs\"..." error="aufs is not supported (modprobe aufs failed: exit status 1 \"modprobe: FATAL: Module aufs not found in directory /lib/modules/5.10.207\\n\"): skip plugin" type=io.containerd.snapshotter.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.138772712Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.zfs\"..." type=io.containerd.snapshotter.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.138838129Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.zfs\"..." error="path /var/lib/docker/containerd/daemon/io.containerd.snapshotter.v1.zfs must be a zfs filesystem to be used with the zfs snapshotter: skip plugin" type=io.containerd.snapshotter.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.138848545Z" level=info msg="loading plugin \"io.containerd.content.v1.content\"..." type=io.containerd.content.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.138878254Z" level=info msg="loading plugin \"io.containerd.metadata.v1.bolt\"..." type=io.containerd.metadata.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.138895420Z" level=info msg="metadata content store policy set" policy=shared

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.141854962Z" level=info msg="loading plugin \"io.containerd.gc.v1.scheduler\"..." type=io.containerd.gc.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.141879587Z" level=info msg="loading plugin \"io.containerd.differ.v1.walking\"..." type=io.containerd.differ.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.141889254Z" level=info msg="loading plugin \"io.containerd.lease.v1.manager\"..." type=io.containerd.lease.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.141896920Z" level=info msg="loading plugin \"io.containerd.streaming.v1.manager\"..." type=io.containerd.streaming.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.141905545Z" level=info msg="loading plugin \"io.containerd.runtime.v1.linux\"..." type=io.containerd.runtime.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.141941795Z" level=info msg="loading plugin \"io.containerd.monitor.v1.cgroups\"..." type=io.containerd.monitor.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142238379Z" level=info msg="loading plugin \"io.containerd.runtime.v2.task\"..." type=io.containerd.runtime.v2

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142303045Z" level=info msg="loading plugin \"io.containerd.runtime.v2.shim\"..." type=io.containerd.runtime.v2

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142325795Z" level=info msg="loading plugin \"io.containerd.sandbox.store.v1.local\"..." type=io.containerd.sandbox.store.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142344087Z" level=info msg="loading plugin \"io.containerd.sandbox.controller.v1.local\"..." type=io.containerd.sandbox.controller.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142363254Z" level=info msg="loading plugin \"io.containerd.service.v1.containers-service\"..." type=io.containerd.service.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142382212Z" level=info msg="loading plugin \"io.containerd.service.v1.content-service\"..." type=io.containerd.service.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142401337Z" level=info msg="loading plugin \"io.containerd.service.v1.diff-service\"..." type=io.containerd.service.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142420337Z" level=info msg="loading plugin \"io.containerd.service.v1.images-service\"..." type=io.containerd.service.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142439420Z" level=info msg="loading plugin \"io.containerd.service.v1.introspection-service\"..." type=io.containerd.service.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142457962Z" level=info msg="loading plugin \"io.containerd.service.v1.namespaces-service\"..." type=io.containerd.service.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142475212Z" level=info msg="loading plugin \"io.containerd.service.v1.snapshots-service\"..." type=io.containerd.service.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142492795Z" level=info msg="loading plugin \"io.containerd.service.v1.tasks-service\"..." type=io.containerd.service.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142516170Z" level=info msg="loading plugin \"io.containerd.grpc.v1.containers\"..." type=io.containerd.grpc.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142555712Z" level=info msg="loading plugin \"io.containerd.grpc.v1.content\"..." type=io.containerd.grpc.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142707087Z" level=info msg="loading plugin \"io.containerd.grpc.v1.diff\"..." type=io.containerd.grpc.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142723087Z" level=info msg="loading plugin \"io.containerd.grpc.v1.events\"..." type=io.containerd.grpc.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142731670Z" level=info msg="loading plugin \"io.containerd.grpc.v1.images\"..." type=io.containerd.grpc.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142739754Z" level=info msg="loading plugin \"io.containerd.grpc.v1.introspection\"..." type=io.containerd.grpc.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142745629Z" level=info msg="loading plugin \"io.containerd.grpc.v1.leases\"..." type=io.containerd.grpc.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142755045Z" level=info msg="loading plugin \"io.containerd.grpc.v1.namespaces\"..." type=io.containerd.grpc.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142766879Z" level=info msg="loading plugin \"io.containerd.grpc.v1.sandbox-controllers\"..." type=io.containerd.grpc.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142776587Z" level=info msg="loading plugin \"io.containerd.grpc.v1.sandboxes\"..." type=io.containerd.grpc.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142783712Z" level=info msg="loading plugin \"io.containerd.grpc.v1.snapshots\"..." type=io.containerd.grpc.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142791295Z" level=info msg="loading plugin \"io.containerd.grpc.v1.streaming\"..." type=io.containerd.grpc.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142798670Z" level=info msg="loading plugin \"io.containerd.grpc.v1.tasks\"..." type=io.containerd.grpc.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142808087Z" level=info msg="loading plugin \"io.containerd.transfer.v1.local\"..." type=io.containerd.transfer.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142824045Z" level=info msg="loading plugin \"io.containerd.grpc.v1.transfer\"..." type=io.containerd.grpc.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142841670Z" level=info msg="loading plugin \"io.containerd.grpc.v1.version\"..." type=io.containerd.grpc.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142847629Z" level=info msg="loading plugin \"io.containerd.internal.v1.restart\"..." type=io.containerd.internal.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142907837Z" level=info msg="loading plugin \"io.containerd.tracing.processor.v1.otlp\"..." type=io.containerd.tracing.processor.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142925337Z" level=info msg="skip loading plugin \"io.containerd.tracing.processor.v1.otlp\"..." error="skip plugin: tracing endpoint not configured" type=io.containerd.tracing.processor.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142932962Z" level=info msg="loading plugin \"io.containerd.internal.v1.tracing\"..." type=io.containerd.internal.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142940670Z" level=info msg="skip loading plugin \"io.containerd.internal.v1.tracing\"..." error="skip plugin: tracing endpoint not configured" type=io.containerd.internal.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142945587Z" level=info msg="loading plugin \"io.containerd.grpc.v1.healthcheck\"..." type=io.containerd.grpc.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142953587Z" level=info msg="loading plugin \"io.containerd.nri.v1.nri\"..." type=io.containerd.nri.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142986170Z" level=info msg="NRI interface is disabled by configuration."

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.143145920Z" level=info msg=serving... address=/var/run/docker/containerd/containerd-debug.sock

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.143170337Z" level=info msg=serving... address=/var/run/docker/containerd/containerd.sock.ttrpc

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.143182879Z" level=info msg=serving... address=/var/run/docker/containerd/containerd.sock

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.143196920Z" level=info msg="containerd successfully booted in 0.014655s"

	Oct 09 18:46:42 addons-953000 dockerd[545]: time="2024-10-09T18:46:42.151983754Z" level=info msg="[graphdriver] trying configured driver: overlay2"

	Oct 09 18:46:42 addons-953000 dockerd[545]: time="2024-10-09T18:46:42.161870087Z" level=info msg="Loading containers: start."

	Oct 09 18:46:42 addons-953000 dockerd[545]: time="2024-10-09T18:46:42.203903879Z" level=warning msg="ip6tables is enabled, but cannot set up ip6tables chains" error="failed to create NAT chain DOCKER: iptables failed: ip6tables --wait -t nat -N DOCKER: ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)\nPerhaps ip6tables or your kernel needs to be upgraded.\n (exit status 3)"

	Oct 09 18:46:42 addons-953000 dockerd[545]: time="2024-10-09T18:46:42.235415171Z" level=info msg="Loading containers: done."

	Oct 09 18:46:42 addons-953000 dockerd[545]: time="2024-10-09T18:46:42.239040421Z" level=warning msg="WARNING: bridge-nf-call-iptables is disabled"

	Oct 09 18:46:42 addons-953000 dockerd[545]: time="2024-10-09T18:46:42.239049837Z" level=warning msg="WARNING: bridge-nf-call-ip6tables is disabled"

	Oct 09 18:46:42 addons-953000 dockerd[545]: time="2024-10-09T18:46:42.239061837Z" level=info msg="Docker daemon" commit=41ca978 containerd-snapshotter=false storage-driver=overlay2 version=27.3.1

	Oct 09 18:46:42 addons-953000 dockerd[545]: time="2024-10-09T18:46:42.239092587Z" level=info msg="Daemon has completed initialization"

	Oct 09 18:46:42 addons-953000 dockerd[545]: time="2024-10-09T18:46:42.251324462Z" level=info msg="API listen on /var/run/docker.sock"

	Oct 09 18:46:42 addons-953000 systemd[1]: Started Docker Application Container Engine.

	Oct 09 18:46:42 addons-953000 dockerd[545]: time="2024-10-09T18:46:42.252281587Z" level=info msg="API listen on [::]:2376"

	Oct 09 18:46:43 addons-953000 dockerd[545]: time="2024-10-09T18:46:43.170285005Z" level=info msg="Processing signal 'terminated'"

	Oct 09 18:46:43 addons-953000 dockerd[545]: time="2024-10-09T18:46:43.170860671Z" level=info msg="stopping event stream following graceful shutdown" error="<nil>" module=libcontainerd namespace=moby

	Oct 09 18:46:43 addons-953000 dockerd[545]: time="2024-10-09T18:46:43.170970005Z" level=info msg="Daemon shutdown complete"

	Oct 09 18:46:43 addons-953000 dockerd[545]: time="2024-10-09T18:46:43.170984088Z" level=info msg="stopping healthcheck following graceful shutdown" module=libcontainerd

	Oct 09 18:46:43 addons-953000 dockerd[545]: time="2024-10-09T18:46:43.171000046Z" level=info msg="stopping event stream following graceful shutdown" error="context canceled" module=libcontainerd namespace=plugins.moby

	Oct 09 18:46:43 addons-953000 systemd[1]: Stopping Docker Application Container Engine...

	Oct 09 18:46:44 addons-953000 systemd[1]: docker.service: Deactivated successfully.

	Oct 09 18:46:44 addons-953000 systemd[1]: Stopped Docker Application Container Engine.

	Oct 09 18:46:44 addons-953000 systemd[1]: Starting Docker Application Container Engine...

	Oct 09 18:46:44 addons-953000 dockerd[897]: time="2024-10-09T18:46:44.230123630Z" level=info msg="Starting up"

	Oct 09 18:47:43 addons-953000 dockerd[897]: failed to start daemon: failed to dial "/run/containerd/containerd.sock": failed to dial "/run/containerd/containerd.sock": context deadline exceeded

	Oct 09 18:47:43 addons-953000 systemd[1]: docker.service: Main process exited, code=exited, status=1/FAILURE

	Oct 09 18:47:43 addons-953000 systemd[1]: docker.service: Failed with result 'exit-code'.

	Oct 09 18:47:43 addons-953000 systemd[1]: Failed to start Docker Application Container Engine.

	-- /stdout --

	X Exiting due to RUNTIME_ENABLE: Failed to enable container runtime: sudo systemctl restart docker: Process exited with status 1

	stdout:

	stderr:

	Job for docker.service failed because the control process exited with error code.

	See "systemctl status docker.service" and "journalctl -xeu docker.service" for details.

	sudo journalctl --no-pager -u docker:

	-- stdout --

	Oct 09 18:46:41 addons-953000 systemd[1]: Starting Docker Application Container Engine...

	Oct 09 18:46:41 addons-953000 dockerd[545]: time="2024-10-09T18:46:41.112795129Z" level=info msg="Starting up"

	Oct 09 18:46:41 addons-953000 dockerd[545]: time="2024-10-09T18:46:41.113117629Z" level=info msg="containerd not running, starting managed containerd"

	Oct 09 18:46:41 addons-953000 dockerd[545]: time="2024-10-09T18:46:41.113542962Z" level=info msg="started new containerd process" address=/var/run/docker/containerd/containerd.sock module=libcontainerd pid=551

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.128892879Z" level=info msg="starting containerd" revision=7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c version=v1.7.22

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.137754129Z" level=info msg="loading plugin \"io.containerd.event.v1.exchange\"..." type=io.containerd.event.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.137768379Z" level=info msg="loading plugin \"io.containerd.internal.v1.opt\"..." type=io.containerd.internal.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.137789420Z" level=info msg="loading plugin \"io.containerd.warning.v1.deprecations\"..." type=io.containerd.warning.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.137795795Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.blockfile\"..." type=io.containerd.snapshotter.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.137821462Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.blockfile\"..." error="no scratch file generator: skip plugin" type=io.containerd.snapshotter.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.137827379Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.btrfs\"..." type=io.containerd.snapshotter.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.137895504Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.btrfs\"..." error="path /var/lib/docker/containerd/daemon/io.containerd.snapshotter.v1.btrfs (ext4) must be a btrfs filesystem to be used with the btrfs snapshotter: skip plugin" type=io.containerd.snapshotter.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.137905629Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.devmapper\"..." type=io.containerd.snapshotter.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.137911087Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.devmapper\"..." error="devmapper not configured: skip plugin" type=io.containerd.snapshotter.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.137916004Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.native\"..." type=io.containerd.snapshotter.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.137939254Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.overlayfs\"..." type=io.containerd.snapshotter.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.138043295Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.aufs\"..." type=io.containerd.snapshotter.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.138739045Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.aufs\"..." error="aufs is not supported (modprobe aufs failed: exit status 1 \"modprobe: FATAL: Module aufs not found in directory /lib/modules/5.10.207\\n\"): skip plugin" type=io.containerd.snapshotter.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.138772712Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.zfs\"..." type=io.containerd.snapshotter.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.138838129Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.zfs\"..." error="path /var/lib/docker/containerd/daemon/io.containerd.snapshotter.v1.zfs must be a zfs filesystem to be used with the zfs snapshotter: skip plugin" type=io.containerd.snapshotter.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.138848545Z" level=info msg="loading plugin \"io.containerd.content.v1.content\"..." type=io.containerd.content.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.138878254Z" level=info msg="loading plugin \"io.containerd.metadata.v1.bolt\"..." type=io.containerd.metadata.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.138895420Z" level=info msg="metadata content store policy set" policy=shared

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.141854962Z" level=info msg="loading plugin \"io.containerd.gc.v1.scheduler\"..." type=io.containerd.gc.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.141879587Z" level=info msg="loading plugin \"io.containerd.differ.v1.walking\"..." type=io.containerd.differ.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.141889254Z" level=info msg="loading plugin \"io.containerd.lease.v1.manager\"..." type=io.containerd.lease.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.141896920Z" level=info msg="loading plugin \"io.containerd.streaming.v1.manager\"..." type=io.containerd.streaming.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.141905545Z" level=info msg="loading plugin \"io.containerd.runtime.v1.linux\"..." type=io.containerd.runtime.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.141941795Z" level=info msg="loading plugin \"io.containerd.monitor.v1.cgroups\"..." type=io.containerd.monitor.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142238379Z" level=info msg="loading plugin \"io.containerd.runtime.v2.task\"..." type=io.containerd.runtime.v2

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142303045Z" level=info msg="loading plugin \"io.containerd.runtime.v2.shim\"..." type=io.containerd.runtime.v2

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142325795Z" level=info msg="loading plugin \"io.containerd.sandbox.store.v1.local\"..." type=io.containerd.sandbox.store.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142344087Z" level=info msg="loading plugin \"io.containerd.sandbox.controller.v1.local\"..." type=io.containerd.sandbox.controller.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142363254Z" level=info msg="loading plugin \"io.containerd.service.v1.containers-service\"..." type=io.containerd.service.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142382212Z" level=info msg="loading plugin \"io.containerd.service.v1.content-service\"..." type=io.containerd.service.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142401337Z" level=info msg="loading plugin \"io.containerd.service.v1.diff-service\"..." type=io.containerd.service.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142420337Z" level=info msg="loading plugin \"io.containerd.service.v1.images-service\"..." type=io.containerd.service.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142439420Z" level=info msg="loading plugin \"io.containerd.service.v1.introspection-service\"..." type=io.containerd.service.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142457962Z" level=info msg="loading plugin \"io.containerd.service.v1.namespaces-service\"..." type=io.containerd.service.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142475212Z" level=info msg="loading plugin \"io.containerd.service.v1.snapshots-service\"..." type=io.containerd.service.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142492795Z" level=info msg="loading plugin \"io.containerd.service.v1.tasks-service\"..." type=io.containerd.service.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142516170Z" level=info msg="loading plugin \"io.containerd.grpc.v1.containers\"..." type=io.containerd.grpc.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142555712Z" level=info msg="loading plugin \"io.containerd.grpc.v1.content\"..." type=io.containerd.grpc.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142707087Z" level=info msg="loading plugin \"io.containerd.grpc.v1.diff\"..." type=io.containerd.grpc.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142723087Z" level=info msg="loading plugin \"io.containerd.grpc.v1.events\"..." type=io.containerd.grpc.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142731670Z" level=info msg="loading plugin \"io.containerd.grpc.v1.images\"..." type=io.containerd.grpc.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142739754Z" level=info msg="loading plugin \"io.containerd.grpc.v1.introspection\"..." type=io.containerd.grpc.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142745629Z" level=info msg="loading plugin \"io.containerd.grpc.v1.leases\"..." type=io.containerd.grpc.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142755045Z" level=info msg="loading plugin \"io.containerd.grpc.v1.namespaces\"..." type=io.containerd.grpc.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142766879Z" level=info msg="loading plugin \"io.containerd.grpc.v1.sandbox-controllers\"..." type=io.containerd.grpc.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142776587Z" level=info msg="loading plugin \"io.containerd.grpc.v1.sandboxes\"..." type=io.containerd.grpc.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142783712Z" level=info msg="loading plugin \"io.containerd.grpc.v1.snapshots\"..." type=io.containerd.grpc.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142791295Z" level=info msg="loading plugin \"io.containerd.grpc.v1.streaming\"..." type=io.containerd.grpc.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142798670Z" level=info msg="loading plugin \"io.containerd.grpc.v1.tasks\"..." type=io.containerd.grpc.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142808087Z" level=info msg="loading plugin \"io.containerd.transfer.v1.local\"..." type=io.containerd.transfer.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142824045Z" level=info msg="loading plugin \"io.containerd.grpc.v1.transfer\"..." type=io.containerd.grpc.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142841670Z" level=info msg="loading plugin \"io.containerd.grpc.v1.version\"..." type=io.containerd.grpc.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142847629Z" level=info msg="loading plugin \"io.containerd.internal.v1.restart\"..." type=io.containerd.internal.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142907837Z" level=info msg="loading plugin \"io.containerd.tracing.processor.v1.otlp\"..." type=io.containerd.tracing.processor.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142925337Z" level=info msg="skip loading plugin \"io.containerd.tracing.processor.v1.otlp\"..." error="skip plugin: tracing endpoint not configured" type=io.containerd.tracing.processor.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142932962Z" level=info msg="loading plugin \"io.containerd.internal.v1.tracing\"..." type=io.containerd.internal.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142940670Z" level=info msg="skip loading plugin \"io.containerd.internal.v1.tracing\"..." error="skip plugin: tracing endpoint not configured" type=io.containerd.internal.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142945587Z" level=info msg="loading plugin \"io.containerd.grpc.v1.healthcheck\"..." type=io.containerd.grpc.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142953587Z" level=info msg="loading plugin \"io.containerd.nri.v1.nri\"..." type=io.containerd.nri.v1

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.142986170Z" level=info msg="NRI interface is disabled by configuration."

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.143145920Z" level=info msg=serving... address=/var/run/docker/containerd/containerd-debug.sock

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.143170337Z" level=info msg=serving... address=/var/run/docker/containerd/containerd.sock.ttrpc

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.143182879Z" level=info msg=serving... address=/var/run/docker/containerd/containerd.sock

	Oct 09 18:46:41 addons-953000 dockerd[551]: time="2024-10-09T18:46:41.143196920Z" level=info msg="containerd successfully booted in 0.014655s"

	Oct 09 18:46:42 addons-953000 dockerd[545]: time="2024-10-09T18:46:42.151983754Z" level=info msg="[graphdriver] trying configured driver: overlay2"

	Oct 09 18:46:42 addons-953000 dockerd[545]: time="2024-10-09T18:46:42.161870087Z" level=info msg="Loading containers: start."

	Oct 09 18:46:42 addons-953000 dockerd[545]: time="2024-10-09T18:46:42.203903879Z" level=warning msg="ip6tables is enabled, but cannot set up ip6tables chains" error="failed to create NAT chain DOCKER: iptables failed: ip6tables --wait -t nat -N DOCKER: ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)\nPerhaps ip6tables or your kernel needs to be upgraded.\n (exit status 3)"

	Oct 09 18:46:42 addons-953000 dockerd[545]: time="2024-10-09T18:46:42.235415171Z" level=info msg="Loading containers: done."

	Oct 09 18:46:42 addons-953000 dockerd[545]: time="2024-10-09T18:46:42.239040421Z" level=warning msg="WARNING: bridge-nf-call-iptables is disabled"

	Oct 09 18:46:42 addons-953000 dockerd[545]: time="2024-10-09T18:46:42.239049837Z" level=warning msg="WARNING: bridge-nf-call-ip6tables is disabled"

	Oct 09 18:46:42 addons-953000 dockerd[545]: time="2024-10-09T18:46:42.239061837Z" level=info msg="Docker daemon" commit=41ca978 containerd-snapshotter=false storage-driver=overlay2 version=27.3.1

	Oct 09 18:46:42 addons-953000 dockerd[545]: time="2024-10-09T18:46:42.239092587Z" level=info msg="Daemon has completed initialization"

	Oct 09 18:46:42 addons-953000 dockerd[545]: time="2024-10-09T18:46:42.251324462Z" level=info msg="API listen on /var/run/docker.sock"

	Oct 09 18:46:42 addons-953000 systemd[1]: Started Docker Application Container Engine.

	Oct 09 18:46:42 addons-953000 dockerd[545]: time="2024-10-09T18:46:42.252281587Z" level=info msg="API listen on [::]:2376"

	Oct 09 18:46:43 addons-953000 dockerd[545]: time="2024-10-09T18:46:43.170285005Z" level=info msg="Processing signal 'terminated'"

	Oct 09 18:46:43 addons-953000 dockerd[545]: time="2024-10-09T18:46:43.170860671Z" level=info msg="stopping event stream following graceful shutdown" error="<nil>" module=libcontainerd namespace=moby

	Oct 09 18:46:43 addons-953000 dockerd[545]: time="2024-10-09T18:46:43.170970005Z" level=info msg="Daemon shutdown complete"

	Oct 09 18:46:43 addons-953000 dockerd[545]: time="2024-10-09T18:46:43.170984088Z" level=info msg="stopping healthcheck following graceful shutdown" module=libcontainerd

	Oct 09 18:46:43 addons-953000 dockerd[545]: time="2024-10-09T18:46:43.171000046Z" level=info msg="stopping event stream following graceful shutdown" error="context canceled" module=libcontainerd namespace=plugins.moby

	Oct 09 18:46:43 addons-953000 systemd[1]: Stopping Docker Application Container Engine...

	Oct 09 18:46:44 addons-953000 systemd[1]: docker.service: Deactivated successfully.

	Oct 09 18:46:44 addons-953000 systemd[1]: Stopped Docker Application Container Engine.

	Oct 09 18:46:44 addons-953000 systemd[1]: Starting Docker Application Container Engine...

	Oct 09 18:46:44 addons-953000 dockerd[897]: time="2024-10-09T18:46:44.230123630Z" level=info msg="Starting up"

	Oct 09 18:47:43 addons-953000 dockerd[897]: failed to start daemon: failed to dial "/run/containerd/containerd.sock": failed to dial "/run/containerd/containerd.sock": context deadline exceeded

	Oct 09 18:47:43 addons-953000 systemd[1]: docker.service: Main process exited, code=exited, status=1/FAILURE

	Oct 09 18:47:43 addons-953000 systemd[1]: docker.service: Failed with result 'exit-code'.

	Oct 09 18:47:43 addons-953000 systemd[1]: Failed to start Docker Application Container Engine.

	-- /stdout --

	W1009 11:47:43.863571    1765 out.go:270] * 

	* 

	W1009 11:47:43.864618    1765 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I1009 11:47:43.876382    1765 out.go:201] 

** /stderr **

addons_test.go:109: out/minikube-darwin-arm64 start -p addons-953000 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=nvidia-device-plugin --addons=yakd --addons=volcano --driver=qemu2  --addons=ingress --addons=ingress-dns --addons=storage-provisioner-rancher failed: exit status 90

--- FAIL: TestAddons/Setup (84.87s)

=== RUN   TestCertOptions

=== PAUSE TestCertOptions

=== CONT  TestCertOptions

cert_options_test.go:49: (dbg) Run:  out/minikube-darwin-arm64 start -p cert-options-137000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=qemu2 

cert_options_test.go:49: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p cert-options-137000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=qemu2 : exit status 80 (9.772530458s)

-- stdout --

	* [cert-options-137000] minikube v1.34.0 on Darwin 15.0.1 (arm64)

	  - MINIKUBE_LOCATION=19780

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19780-1164/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19780-1164/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "cert-options-137000" primary control-plane node in "cert-options-137000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "cert-options-137000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p cert-options-137000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

cert_options_test.go:51: failed to start minikube with args: "out/minikube-darwin-arm64 start -p cert-options-137000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=qemu2 " : exit status 80

cert_options_test.go:60: (dbg) Run:  out/minikube-darwin-arm64 -p cert-options-137000 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"

cert_options_test.go:60: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p cert-options-137000 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt": exit status 83 (83.112292ms)

-- stdout --

	* The control-plane node cert-options-137000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p cert-options-137000"

-- /stdout --

cert_options_test.go:62: failed to read apiserver cert inside minikube. args "out/minikube-darwin-arm64 -p cert-options-137000 ssh \"openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt\"": exit status 83

cert_options_test.go:69: apiserver cert does not include 127.0.0.1 in SAN.

cert_options_test.go:69: apiserver cert does not include 192.168.15.15 in SAN.

cert_options_test.go:69: apiserver cert does not include localhost in SAN.

cert_options_test.go:69: apiserver cert does not include www.google.com in SAN.

cert_options_test.go:88: (dbg) Run:  kubectl --context cert-options-137000 config view

cert_options_test.go:93: Kubeconfig apiserver server port incorrect. Output of 

'kubectl config view' = "\n-- stdout --\n\tapiVersion: v1\n\tclusters: null\n\tcontexts: null\n\tcurrent-context: \"\"\n\tkind: Config\n\tpreferences: {}\n\tusers: null\n\n-- /stdout --"

cert_options_test.go:100: (dbg) Run:  out/minikube-darwin-arm64 ssh -p cert-options-137000 -- "sudo cat /etc/kubernetes/admin.conf"

cert_options_test.go:100: (dbg) Non-zero exit: out/minikube-darwin-arm64 ssh -p cert-options-137000 -- "sudo cat /etc/kubernetes/admin.conf": exit status 83 (43.037792ms)

-- stdout --

	* The control-plane node cert-options-137000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p cert-options-137000"

-- /stdout --

cert_options_test.go:102: failed to SSH to minikube with args: "out/minikube-darwin-arm64 ssh -p cert-options-137000 -- \"sudo cat /etc/kubernetes/admin.conf\"" : exit status 83

cert_options_test.go:106: Internal minikube kubeconfig (admin.conf) does not contains the right api port. 

-- stdout --

	* The control-plane node cert-options-137000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p cert-options-137000"

-- /stdout --

cert_options_test.go:109: *** TestCertOptions FAILED at 2024-10-09 12:52:27.803141 -0700 PDT m=+4013.705480626

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p cert-options-137000 -n cert-options-137000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p cert-options-137000 -n cert-options-137000: exit status 7 (34.148042ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "cert-options-137000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "cert-options-137000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p cert-options-137000

--- FAIL: TestCertOptions (10.12s)

=== RUN   TestCertExpiration

=== PAUSE TestCertExpiration

=== CONT  TestCertExpiration

cert_options_test.go:123: (dbg) Run:  out/minikube-darwin-arm64 start -p cert-expiration-620000 --memory=2048 --cert-expiration=3m --driver=qemu2 

E1009 12:51:56.024734    1686 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/functional-517000/client.crt: no such file or directory" logger="UnhandledError"

cert_options_test.go:123: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p cert-expiration-620000 --memory=2048 --cert-expiration=3m --driver=qemu2 : exit status 80 (11.657956875s)

-- stdout --

	* [cert-expiration-620000] minikube v1.34.0 on Darwin 15.0.1 (arm64)

	  - MINIKUBE_LOCATION=19780

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19780-1164/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19780-1164/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "cert-expiration-620000" primary control-plane node in "cert-expiration-620000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "cert-expiration-620000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p cert-expiration-620000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

cert_options_test.go:125: failed to start minikube with args: "out/minikube-darwin-arm64 start -p cert-expiration-620000 --memory=2048 --cert-expiration=3m --driver=qemu2 " : exit status 80

cert_options_test.go:131: (dbg) Run:  out/minikube-darwin-arm64 start -p cert-expiration-620000 --memory=2048 --cert-expiration=8760h --driver=qemu2 

cert_options_test.go:131: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p cert-expiration-620000 --memory=2048 --cert-expiration=8760h --driver=qemu2 : exit status 80 (5.236095959s)

-- stdout --

	* [cert-expiration-620000] minikube v1.34.0 on Darwin 15.0.1 (arm64)

	  - MINIKUBE_LOCATION=19780

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19780-1164/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19780-1164/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on existing profile

	* Starting "cert-expiration-620000" primary control-plane node in "cert-expiration-620000" cluster

	* Restarting existing qemu2 VM for "cert-expiration-620000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Restarting existing qemu2 VM for "cert-expiration-620000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p cert-expiration-620000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

cert_options_test.go:133: failed to start minikube after cert expiration: "out/minikube-darwin-arm64 start -p cert-expiration-620000 --memory=2048 --cert-expiration=8760h --driver=qemu2 " : exit status 80

cert_options_test.go:136: minikube start output did not warn about expired certs: 

-- stdout --

	* [cert-expiration-620000] minikube v1.34.0 on Darwin 15.0.1 (arm64)

	  - MINIKUBE_LOCATION=19780

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19780-1164/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19780-1164/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on existing profile

	* Starting "cert-expiration-620000" primary control-plane node in "cert-expiration-620000" cluster

	* Restarting existing qemu2 VM for "cert-expiration-620000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Restarting existing qemu2 VM for "cert-expiration-620000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p cert-expiration-620000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

cert_options_test.go:138: *** TestCertExpiration FAILED at 2024-10-09 12:55:12.821695 -0700 PDT m=+4178.729520710

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p cert-expiration-620000 -n cert-expiration-620000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p cert-expiration-620000 -n cert-expiration-620000: exit status 7 (72.489834ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "cert-expiration-620000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "cert-expiration-620000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p cert-expiration-620000

--- FAIL: TestCertExpiration (197.05s)

=== RUN   TestDockerFlags

=== PAUSE TestDockerFlags

=== CONT  TestDockerFlags

docker_test.go:51: (dbg) Run:  out/minikube-darwin-arm64 start -p docker-flags-242000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=qemu2 

docker_test.go:51: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p docker-flags-242000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=qemu2 : exit status 80 (12.380810208s)

-- stdout --

	* [docker-flags-242000] minikube v1.34.0 on Darwin 15.0.1 (arm64)

	  - MINIKUBE_LOCATION=19780

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19780-1164/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19780-1164/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "docker-flags-242000" primary control-plane node in "docker-flags-242000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "docker-flags-242000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I1009 12:52:05.209149    4386 out.go:345] Setting OutFile to fd 1 ...

	I1009 12:52:05.209372    4386 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:52:05.209379    4386 out.go:358] Setting ErrFile to fd 2...

	I1009 12:52:05.209381    4386 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:52:05.209535    4386 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19780-1164/.minikube/bin

	I1009 12:52:05.211266    4386 out.go:352] Setting JSON to false

	I1009 12:52:05.233597    4386 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":4895,"bootTime":1728498630,"procs":521,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}

	W1009 12:52:05.233703    4386 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I1009 12:52:05.246161    4386 out.go:177] * [docker-flags-242000] minikube v1.34.0 on Darwin 15.0.1 (arm64)

	I1009 12:52:05.254256    4386 notify.go:220] Checking for updates...

	I1009 12:52:05.259149    4386 out.go:177]   - MINIKUBE_LOCATION=19780

	I1009 12:52:05.267490    4386 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19780-1164/kubeconfig

	I1009 12:52:05.275008    4386 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I1009 12:52:05.283122    4386 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1009 12:52:05.290130    4386 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19780-1164/.minikube

	I1009 12:52:05.297027    4386 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I1009 12:52:05.302567    4386 config.go:182] Loaded profile config "cert-expiration-620000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I1009 12:52:05.302665    4386 config.go:182] Loaded profile config "multinode-341000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I1009 12:52:05.302720    4386 driver.go:394] Setting default libvirt URI to qemu:///system

	I1009 12:52:05.307151    4386 out.go:177] * Using the qemu2 driver based on user configuration

	I1009 12:52:05.315123    4386 start.go:297] selected driver: qemu2

	I1009 12:52:05.315130    4386 start.go:901] validating driver "qemu2" against <nil>

	I1009 12:52:05.315136    4386 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I1009 12:52:05.318242    4386 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I1009 12:52:05.324225    4386 out.go:177] * Automatically selected the socket_vmnet network

	I1009 12:52:05.328162    4386 start_flags.go:942] Waiting for no components: map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false]

	I1009 12:52:05.328189    4386 cni.go:84] Creating CNI manager for ""

	I1009 12:52:05.328219    4386 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I1009 12:52:05.328225    4386 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I1009 12:52:05.328273    4386 start.go:340] cluster config:

	{Name:docker-flags-242000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:docker-flags-242000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[]

DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMn

etClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1009 12:52:05.334622    4386 iso.go:125] acquiring lock: {Name:mka6a0d59ae6cc32794e4fbfa8e5c6ce6a65e504 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1009 12:52:05.343102    4386 out.go:177] * Starting "docker-flags-242000" primary control-plane node in "docker-flags-242000" cluster

	I1009 12:52:05.346112    4386 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime docker

	I1009 12:52:05.346134    4386 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19780-1164/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4

	I1009 12:52:05.346151    4386 cache.go:56] Caching tarball of preloaded images

	I1009 12:52:05.346293    4386 preload.go:172] Found /Users/jenkins/minikube-integration/19780-1164/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I1009 12:52:05.346300    4386 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on docker

	I1009 12:52:05.346397    4386 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/docker-flags-242000/config.json ...

	I1009 12:52:05.346410    4386 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/docker-flags-242000/config.json: {Name:mkc594ebc34bed981fb432ec456354b8c5f9baa9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1009 12:52:05.346715    4386 start.go:360] acquireMachinesLock for docker-flags-242000: {Name:mk6dc29eb74286120c58954bae0cd65a85a89b02 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1009 12:52:07.550864    4386 start.go:364] duration metric: took 2.204111208s to acquireMachinesLock for "docker-flags-242000"

	I1009 12:52:07.551044    4386 start.go:93] Provisioning new machine with config: &{Name:docker-flags-242000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19774/minikube-v1.34.0-1728382514-19774-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey

: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:docker-flags-242000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:dock

er MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1009 12:52:07.551328    4386 start.go:125] createHost starting for "" (driver="qemu2")

	I1009 12:52:07.559503    4386 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I1009 12:52:07.608983    4386 start.go:159] libmachine.API.Create for "docker-flags-242000" (driver="qemu2")

	I1009 12:52:07.609039    4386 client.go:168] LocalClient.Create starting

	I1009 12:52:07.609249    4386 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19780-1164/.minikube/certs/ca.pem

	I1009 12:52:07.609320    4386 main.go:141] libmachine: Decoding PEM data...

	I1009 12:52:07.609344    4386 main.go:141] libmachine: Parsing certificate...

	I1009 12:52:07.609408    4386 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19780-1164/.minikube/certs/cert.pem

	I1009 12:52:07.609466    4386 main.go:141] libmachine: Decoding PEM data...

	I1009 12:52:07.609483    4386 main.go:141] libmachine: Parsing certificate...

	I1009 12:52:07.610209    4386 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19780-1164/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19780-1164/.minikube/cache/iso/arm64/minikube-v1.34.0-1728382514-19774-arm64.iso...

	I1009 12:52:07.775882    4386 main.go:141] libmachine: Creating SSH key...

	I1009 12:52:08.124856    4386 main.go:141] libmachine: Creating Disk image...

	I1009 12:52:08.124866    4386 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I1009 12:52:08.125121    4386 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/docker-flags-242000/disk.qcow2.raw /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/docker-flags-242000/disk.qcow2

	I1009 12:52:08.136517    4386 main.go:141] libmachine: STDOUT: 

	I1009 12:52:08.136553    4386 main.go:141] libmachine: STDERR: 

	I1009 12:52:08.136619    4386 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/docker-flags-242000/disk.qcow2 +20000M

	I1009 12:52:08.145333    4386 main.go:141] libmachine: STDOUT: Image resized.

	I1009 12:52:08.145360    4386 main.go:141] libmachine: STDERR: 

	I1009 12:52:08.145377    4386 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/docker-flags-242000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/docker-flags-242000/disk.qcow2

	I1009 12:52:08.145384    4386 main.go:141] libmachine: Starting QEMU VM...

	I1009 12:52:08.145393    4386 qemu.go:418] Using hvf for hardware acceleration

	I1009 12:52:08.145427    4386 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/docker-flags-242000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19780-1164/.minikube/machines/docker-flags-242000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/docker-flags-242000/qemu.pid -device virtio-net-pci,netdev=net0,mac=a6:08:0e:d1:96:32 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/docker-flags-242000/disk.qcow2

	I1009 12:52:08.147317    4386 main.go:141] libmachine: STDOUT: 

	I1009 12:52:08.147334    4386 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I1009 12:52:08.147354    4386 client.go:171] duration metric: took 538.3275ms to LocalClient.Create

	I1009 12:52:10.149473    4386 start.go:128] duration metric: took 2.598199334s to createHost

	I1009 12:52:10.149535    4386 start.go:83] releasing machines lock for "docker-flags-242000", held for 2.59870775s

	W1009 12:52:10.149595    4386 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I1009 12:52:10.159929    4386 out.go:177] * Deleting "docker-flags-242000" in qemu2 ...

	W1009 12:52:10.187039    4386 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I1009 12:52:10.187060    4386 start.go:729] Will try again in 5 seconds ...

	I1009 12:52:15.189036    4386 start.go:360] acquireMachinesLock for docker-flags-242000: {Name:mk6dc29eb74286120c58954bae0cd65a85a89b02 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1009 12:52:15.189496    4386 start.go:364] duration metric: took 391.959µs to acquireMachinesLock for "docker-flags-242000"

	I1009 12:52:15.189622    4386 start.go:93] Provisioning new machine with config: &{Name:docker-flags-242000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19774/minikube-v1.34.0-1728382514-19774-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey

: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:docker-flags-242000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:dock

er MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1009 12:52:15.189909    4386 start.go:125] createHost starting for "" (driver="qemu2")

	I1009 12:52:15.205597    4386 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I1009 12:52:15.254246    4386 start.go:159] libmachine.API.Create for "docker-flags-242000" (driver="qemu2")

	I1009 12:52:15.254283    4386 client.go:168] LocalClient.Create starting

	I1009 12:52:15.254447    4386 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19780-1164/.minikube/certs/ca.pem

	I1009 12:52:15.254522    4386 main.go:141] libmachine: Decoding PEM data...

	I1009 12:52:15.254543    4386 main.go:141] libmachine: Parsing certificate...

	I1009 12:52:15.254611    4386 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19780-1164/.minikube/certs/cert.pem

	I1009 12:52:15.254667    4386 main.go:141] libmachine: Decoding PEM data...

	I1009 12:52:15.254685    4386 main.go:141] libmachine: Parsing certificate...

	I1009 12:52:15.255575    4386 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19780-1164/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19780-1164/.minikube/cache/iso/arm64/minikube-v1.34.0-1728382514-19774-arm64.iso...

	I1009 12:52:15.423861    4386 main.go:141] libmachine: Creating SSH key...

	I1009 12:52:15.481646    4386 main.go:141] libmachine: Creating Disk image...

	I1009 12:52:15.481651    4386 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I1009 12:52:15.481857    4386 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/docker-flags-242000/disk.qcow2.raw /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/docker-flags-242000/disk.qcow2

	I1009 12:52:15.491593    4386 main.go:141] libmachine: STDOUT: 

	I1009 12:52:15.491617    4386 main.go:141] libmachine: STDERR: 

	I1009 12:52:15.491687    4386 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/docker-flags-242000/disk.qcow2 +20000M

	I1009 12:52:15.500062    4386 main.go:141] libmachine: STDOUT: Image resized.

	I1009 12:52:15.500076    4386 main.go:141] libmachine: STDERR: 

	I1009 12:52:15.500088    4386 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/docker-flags-242000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/docker-flags-242000/disk.qcow2

	I1009 12:52:15.500093    4386 main.go:141] libmachine: Starting QEMU VM...

	I1009 12:52:15.500102    4386 qemu.go:418] Using hvf for hardware acceleration

	I1009 12:52:15.500132    4386 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/docker-flags-242000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19780-1164/.minikube/machines/docker-flags-242000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/docker-flags-242000/qemu.pid -device virtio-net-pci,netdev=net0,mac=d2:b4:99:62:1a:d5 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/docker-flags-242000/disk.qcow2

	I1009 12:52:15.501928    4386 main.go:141] libmachine: STDOUT: 

	I1009 12:52:15.501947    4386 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I1009 12:52:15.501963    4386 client.go:171] duration metric: took 247.682958ms to LocalClient.Create

	I1009 12:52:17.504072    4386 start.go:128] duration metric: took 2.314209916s to createHost

	I1009 12:52:17.504172    4386 start.go:83] releasing machines lock for "docker-flags-242000", held for 2.314688167s

	W1009 12:52:17.504523    4386 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p docker-flags-242000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p docker-flags-242000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I1009 12:52:17.516988    4386 out.go:201] 

	W1009 12:52:17.521295    4386 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W1009 12:52:17.521321    4386 out.go:270] * 

	* 

	W1009 12:52:17.523854    4386 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I1009 12:52:17.535140    4386 out.go:201] 

** /stderr **

docker_test.go:53: failed to start minikube with args: "out/minikube-darwin-arm64 start -p docker-flags-242000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=qemu2 " : exit status 80

docker_test.go:56: (dbg) Run:  out/minikube-darwin-arm64 -p docker-flags-242000 ssh "sudo systemctl show docker --property=Environment --no-pager"

docker_test.go:56: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p docker-flags-242000 ssh "sudo systemctl show docker --property=Environment --no-pager": exit status 83 (87.221083ms)

-- stdout --

	* The control-plane node docker-flags-242000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p docker-flags-242000"

-- /stdout --

docker_test.go:58: failed to 'systemctl show docker' inside minikube. args "out/minikube-darwin-arm64 -p docker-flags-242000 ssh \"sudo systemctl show docker --property=Environment --no-pager\"": exit status 83

docker_test.go:63: expected env key/value "FOO=BAR" to be passed to minikube's docker and be included in: *"* The control-plane node docker-flags-242000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p docker-flags-242000\"\n"*.

docker_test.go:63: expected env key/value "BAZ=BAT" to be passed to minikube's docker and be included in: *"* The control-plane node docker-flags-242000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p docker-flags-242000\"\n"*.

docker_test.go:67: (dbg) Run:  out/minikube-darwin-arm64 -p docker-flags-242000 ssh "sudo systemctl show docker --property=ExecStart --no-pager"

docker_test.go:67: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p docker-flags-242000 ssh "sudo systemctl show docker --property=ExecStart --no-pager": exit status 83 (47.763959ms)

-- stdout --

	* The control-plane node docker-flags-242000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p docker-flags-242000"

-- /stdout --

docker_test.go:69: failed on the second 'systemctl show docker' inside minikube. args "out/minikube-darwin-arm64 -p docker-flags-242000 ssh \"sudo systemctl show docker --property=ExecStart --no-pager\"": exit status 83

docker_test.go:73: expected "out/minikube-darwin-arm64 -p docker-flags-242000 ssh \"sudo systemctl show docker --property=ExecStart --no-pager\"" output to have include *--debug* . output: "* The control-plane node docker-flags-242000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p docker-flags-242000\"\n"

panic.go:629: *** TestDockerFlags FAILED at 2024-10-09 12:52:17.687021 -0700 PDT m=+4003.589023918

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p docker-flags-242000 -n docker-flags-242000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p docker-flags-242000 -n docker-flags-242000: exit status 7 (33.801666ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "docker-flags-242000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "docker-flags-242000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p docker-flags-242000

--- FAIL: TestDockerFlags (12.63s)

=== RUN   TestForceSystemdFlag

=== PAUSE TestForceSystemdFlag

=== CONT  TestForceSystemdFlag

docker_test.go:91: (dbg) Run:  out/minikube-darwin-arm64 start -p force-systemd-flag-666000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=qemu2 

docker_test.go:91: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p force-systemd-flag-666000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=qemu2 : exit status 80 (12.480090292s)

-- stdout --

	* [force-systemd-flag-666000] minikube v1.34.0 on Darwin 15.0.1 (arm64)

	  - MINIKUBE_LOCATION=19780

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19780-1164/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19780-1164/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "force-systemd-flag-666000" primary control-plane node in "force-systemd-flag-666000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "force-systemd-flag-666000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I1009 12:51:30.018856    4242 out.go:345] Setting OutFile to fd 1 ...

	I1009 12:51:30.019025    4242 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:51:30.019028    4242 out.go:358] Setting ErrFile to fd 2...

	I1009 12:51:30.019031    4242 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:51:30.019180    4242 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19780-1164/.minikube/bin

	I1009 12:51:30.020819    4242 out.go:352] Setting JSON to false

	I1009 12:51:30.042755    4242 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":4860,"bootTime":1728498630,"procs":521,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}

	W1009 12:51:30.042856    4242 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I1009 12:51:30.048461    4242 out.go:177] * [force-systemd-flag-666000] minikube v1.34.0 on Darwin 15.0.1 (arm64)

	I1009 12:51:30.056537    4242 out.go:177]   - MINIKUBE_LOCATION=19780

	I1009 12:51:30.056639    4242 notify.go:220] Checking for updates...

	I1009 12:51:30.063436    4242 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19780-1164/kubeconfig

	I1009 12:51:30.066425    4242 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I1009 12:51:30.069396    4242 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1009 12:51:30.072410    4242 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19780-1164/.minikube

	I1009 12:51:30.075460    4242 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I1009 12:51:30.078754    4242 config.go:182] Loaded profile config "NoKubernetes-206000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I1009 12:51:30.078826    4242 config.go:182] Loaded profile config "multinode-341000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I1009 12:51:30.078882    4242 driver.go:394] Setting default libvirt URI to qemu:///system

	I1009 12:51:30.083488    4242 out.go:177] * Using the qemu2 driver based on user configuration

	I1009 12:51:30.098006    4242 start.go:297] selected driver: qemu2

	I1009 12:51:30.098012    4242 start.go:901] validating driver "qemu2" against <nil>

	I1009 12:51:30.098017    4242 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I1009 12:51:30.100354    4242 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I1009 12:51:30.103424    4242 out.go:177] * Automatically selected the socket_vmnet network

	I1009 12:51:30.106544    4242 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]

	I1009 12:51:30.106557    4242 cni.go:84] Creating CNI manager for ""

	I1009 12:51:30.106575    4242 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I1009 12:51:30.106578    4242 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I1009 12:51:30.106605    4242 start.go:340] cluster config:

	{Name:force-systemd-flag-666000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:force-systemd-flag-666000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster

.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet Static

IP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1009 12:51:30.110742    4242 iso.go:125] acquiring lock: {Name:mka6a0d59ae6cc32794e4fbfa8e5c6ce6a65e504 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1009 12:51:30.119519    4242 out.go:177] * Starting "force-systemd-flag-666000" primary control-plane node in "force-systemd-flag-666000" cluster

	I1009 12:51:30.123304    4242 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime docker

	I1009 12:51:30.123319    4242 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19780-1164/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4

	I1009 12:51:30.123324    4242 cache.go:56] Caching tarball of preloaded images

	I1009 12:51:30.123391    4242 preload.go:172] Found /Users/jenkins/minikube-integration/19780-1164/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I1009 12:51:30.123396    4242 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on docker

	I1009 12:51:30.123441    4242 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/force-systemd-flag-666000/config.json ...

	I1009 12:51:30.123451    4242 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/force-systemd-flag-666000/config.json: {Name:mk0b5424d9b780b214e3c85a435c488454d71e58 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1009 12:51:30.123854    4242 start.go:360] acquireMachinesLock for force-systemd-flag-666000: {Name:mk6dc29eb74286120c58954bae0cd65a85a89b02 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1009 12:51:32.217603    4242 start.go:364] duration metric: took 2.093791541s to acquireMachinesLock for "force-systemd-flag-666000"

	I1009 12:51:32.217751    4242 start.go:93] Provisioning new machine with config: &{Name:force-systemd-flag-666000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19774/minikube-v1.34.0-1728382514-19774-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernetes

Config:{KubernetesVersion:v1.31.1 ClusterName:force-systemd-flag-666000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror

: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1009 12:51:32.218030    4242 start.go:125] createHost starting for "" (driver="qemu2")

	I1009 12:51:32.227397    4242 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I1009 12:51:32.277912    4242 start.go:159] libmachine.API.Create for "force-systemd-flag-666000" (driver="qemu2")

	I1009 12:51:32.277972    4242 client.go:168] LocalClient.Create starting

	I1009 12:51:32.278106    4242 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19780-1164/.minikube/certs/ca.pem

	I1009 12:51:32.278178    4242 main.go:141] libmachine: Decoding PEM data...

	I1009 12:51:32.278200    4242 main.go:141] libmachine: Parsing certificate...

	I1009 12:51:32.278270    4242 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19780-1164/.minikube/certs/cert.pem

	I1009 12:51:32.278328    4242 main.go:141] libmachine: Decoding PEM data...

	I1009 12:51:32.278343    4242 main.go:141] libmachine: Parsing certificate...

	I1009 12:51:32.279024    4242 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19780-1164/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19780-1164/.minikube/cache/iso/arm64/minikube-v1.34.0-1728382514-19774-arm64.iso...

	I1009 12:51:32.522663    4242 main.go:141] libmachine: Creating SSH key...

	I1009 12:51:32.673668    4242 main.go:141] libmachine: Creating Disk image...

	I1009 12:51:32.673675    4242 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I1009 12:51:32.673883    4242 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/force-systemd-flag-666000/disk.qcow2.raw /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/force-systemd-flag-666000/disk.qcow2

	I1009 12:51:32.684223    4242 main.go:141] libmachine: STDOUT: 

	I1009 12:51:32.684240    4242 main.go:141] libmachine: STDERR: 

	I1009 12:51:32.684316    4242 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/force-systemd-flag-666000/disk.qcow2 +20000M

	I1009 12:51:32.692745    4242 main.go:141] libmachine: STDOUT: Image resized.

	I1009 12:51:32.692760    4242 main.go:141] libmachine: STDERR: 

	I1009 12:51:32.692778    4242 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/force-systemd-flag-666000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/force-systemd-flag-666000/disk.qcow2

	I1009 12:51:32.692783    4242 main.go:141] libmachine: Starting QEMU VM...

	I1009 12:51:32.692796    4242 qemu.go:418] Using hvf for hardware acceleration

	I1009 12:51:32.692826    4242 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/force-systemd-flag-666000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19780-1164/.minikube/machines/force-systemd-flag-666000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/force-systemd-flag-666000/qemu.pid -device virtio-net-pci,netdev=net0,mac=66:dc:ec:c3:47:9c -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/force-systemd-flag-666000/disk.qcow2

	I1009 12:51:32.694606    4242 main.go:141] libmachine: STDOUT: 

	I1009 12:51:32.694627    4242 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I1009 12:51:32.694649    4242 client.go:171] duration metric: took 416.685334ms to LocalClient.Create

	I1009 12:51:34.696769    4242 start.go:128] duration metric: took 2.478760416s to createHost

	I1009 12:51:34.696868    4242 start.go:83] releasing machines lock for "force-systemd-flag-666000", held for 2.479304292s

	W1009 12:51:34.696938    4242 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I1009 12:51:34.713145    4242 out.go:177] * Deleting "force-systemd-flag-666000" in qemu2 ...

	W1009 12:51:34.740127    4242 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I1009 12:51:34.740156    4242 start.go:729] Will try again in 5 seconds ...

	I1009 12:51:39.742185    4242 start.go:360] acquireMachinesLock for force-systemd-flag-666000: {Name:mk6dc29eb74286120c58954bae0cd65a85a89b02 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1009 12:51:39.755343    4242 start.go:364] duration metric: took 13.076583ms to acquireMachinesLock for "force-systemd-flag-666000"

	I1009 12:51:39.755400    4242 start.go:93] Provisioning new machine with config: &{Name:force-systemd-flag-666000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19774/minikube-v1.34.0-1728382514-19774-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernetes

Config:{KubernetesVersion:v1.31.1 ClusterName:force-systemd-flag-666000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror

: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1009 12:51:39.755598    4242 start.go:125] createHost starting for "" (driver="qemu2")

	I1009 12:51:39.768347    4242 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I1009 12:51:39.816058    4242 start.go:159] libmachine.API.Create for "force-systemd-flag-666000" (driver="qemu2")

	I1009 12:51:39.816112    4242 client.go:168] LocalClient.Create starting

	I1009 12:51:39.816219    4242 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19780-1164/.minikube/certs/ca.pem

	I1009 12:51:39.816301    4242 main.go:141] libmachine: Decoding PEM data...

	I1009 12:51:39.816325    4242 main.go:141] libmachine: Parsing certificate...

	I1009 12:51:39.816377    4242 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19780-1164/.minikube/certs/cert.pem

	I1009 12:51:39.816432    4242 main.go:141] libmachine: Decoding PEM data...

	I1009 12:51:39.816445    4242 main.go:141] libmachine: Parsing certificate...

	I1009 12:51:39.816989    4242 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19780-1164/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19780-1164/.minikube/cache/iso/arm64/minikube-v1.34.0-1728382514-19774-arm64.iso...

	I1009 12:51:40.069540    4242 main.go:141] libmachine: Creating SSH key...

	I1009 12:51:40.389171    4242 main.go:141] libmachine: Creating Disk image...

	I1009 12:51:40.389182    4242 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I1009 12:51:40.389385    4242 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/force-systemd-flag-666000/disk.qcow2.raw /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/force-systemd-flag-666000/disk.qcow2

	I1009 12:51:40.399625    4242 main.go:141] libmachine: STDOUT: 

	I1009 12:51:40.399646    4242 main.go:141] libmachine: STDERR: 

	I1009 12:51:40.399705    4242 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/force-systemd-flag-666000/disk.qcow2 +20000M

	I1009 12:51:40.408216    4242 main.go:141] libmachine: STDOUT: Image resized.

	I1009 12:51:40.408232    4242 main.go:141] libmachine: STDERR: 

	I1009 12:51:40.408244    4242 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/force-systemd-flag-666000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/force-systemd-flag-666000/disk.qcow2

	I1009 12:51:40.408256    4242 main.go:141] libmachine: Starting QEMU VM...

	I1009 12:51:40.408269    4242 qemu.go:418] Using hvf for hardware acceleration

	I1009 12:51:40.408307    4242 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/force-systemd-flag-666000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19780-1164/.minikube/machines/force-systemd-flag-666000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/force-systemd-flag-666000/qemu.pid -device virtio-net-pci,netdev=net0,mac=0a:ec:1d:c3:12:a9 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/force-systemd-flag-666000/disk.qcow2

	I1009 12:51:40.410104    4242 main.go:141] libmachine: STDOUT: 

	I1009 12:51:40.410126    4242 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I1009 12:51:40.410149    4242 client.go:171] duration metric: took 594.052ms to LocalClient.Create

	I1009 12:51:42.412255    4242 start.go:128] duration metric: took 2.656718833s to createHost

	I1009 12:51:42.412321    4242 start.go:83] releasing machines lock for "force-systemd-flag-666000", held for 2.657036459s

	W1009 12:51:42.412708    4242 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p force-systemd-flag-666000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p force-systemd-flag-666000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I1009 12:51:42.427305    4242 out.go:201] 

	W1009 12:51:42.432213    4242 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W1009 12:51:42.432240    4242 out.go:270] * 

	* 

	W1009 12:51:42.434884    4242 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I1009 12:51:42.443261    4242 out.go:201] 

** /stderr **

docker_test.go:93: failed to start minikube with args: "out/minikube-darwin-arm64 start -p force-systemd-flag-666000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=qemu2 " : exit status 80

docker_test.go:110: (dbg) Run:  out/minikube-darwin-arm64 -p force-systemd-flag-666000 ssh "docker info --format {{.CgroupDriver}}"

docker_test.go:110: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p force-systemd-flag-666000 ssh "docker info --format {{.CgroupDriver}}": exit status 83 (77.013ms)

-- stdout --

	* The control-plane node force-systemd-flag-666000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p force-systemd-flag-666000"

-- /stdout --

docker_test.go:112: failed to get docker cgroup driver. args "out/minikube-darwin-arm64 -p force-systemd-flag-666000 ssh \"docker info --format {{.CgroupDriver}}\"": exit status 83

docker_test.go:106: *** TestForceSystemdFlag FAILED at 2024-10-09 12:51:42.540672 -0700 PDT m=+3968.441501918

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-flag-666000 -n force-systemd-flag-666000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-flag-666000 -n force-systemd-flag-666000: exit status 7 (36.582792ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "force-systemd-flag-666000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "force-systemd-flag-666000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p force-systemd-flag-666000

--- FAIL: TestForceSystemdFlag (12.67s)

=== RUN   TestForceSystemdEnv

=== PAUSE TestForceSystemdEnv

=== CONT  TestForceSystemdEnv

docker_test.go:155: (dbg) Run:  out/minikube-darwin-arm64 start -p force-systemd-env-983000 --memory=2048 --alsologtostderr -v=5 --driver=qemu2 

I1009 12:51:55.882906    1686 install.go:79] stdout: 

W1009 12:51:55.883064    1686 out.go:174] [unset outFile]: * The 'hyperkit' driver requires elevated permissions. The following commands will be executed:

$ sudo chown root:wheel /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestHyperKitDriverInstallOrUpdate3034884057/002/docker-machine-driver-hyperkit 

$ sudo chmod u+s /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestHyperKitDriverInstallOrUpdate3034884057/002/docker-machine-driver-hyperkit 

I1009 12:51:55.883089    1686 install.go:99] testing: [sudo -n chown root:wheel /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestHyperKitDriverInstallOrUpdate3034884057/002/docker-machine-driver-hyperkit]

I1009 12:51:55.896502    1686 install.go:106] running: [sudo chown root:wheel /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestHyperKitDriverInstallOrUpdate3034884057/002/docker-machine-driver-hyperkit]

I1009 12:51:55.907836    1686 install.go:99] testing: [sudo -n chmod u+s /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestHyperKitDriverInstallOrUpdate3034884057/002/docker-machine-driver-hyperkit]

I1009 12:51:55.918445    1686 install.go:106] running: [sudo chmod u+s /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestHyperKitDriverInstallOrUpdate3034884057/002/docker-machine-driver-hyperkit]

docker_test.go:155: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p force-systemd-env-983000 --memory=2048 --alsologtostderr -v=5 --driver=qemu2 : exit status 80 (9.893375625s)

-- stdout --

	* [force-systemd-env-983000] minikube v1.34.0 on Darwin 15.0.1 (arm64)

	  - MINIKUBE_LOCATION=19780

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19780-1164/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19780-1164/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=true

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "force-systemd-env-983000" primary control-plane node in "force-systemd-env-983000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "force-systemd-env-983000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I1009 12:51:55.105485    4345 out.go:345] Setting OutFile to fd 1 ...

	I1009 12:51:55.105641    4345 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:51:55.105645    4345 out.go:358] Setting ErrFile to fd 2...

	I1009 12:51:55.105647    4345 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:51:55.105781    4345 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19780-1164/.minikube/bin

	I1009 12:51:55.106927    4345 out.go:352] Setting JSON to false

	I1009 12:51:55.124491    4345 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":4885,"bootTime":1728498630,"procs":521,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}

	W1009 12:51:55.124562    4345 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I1009 12:51:55.129913    4345 out.go:177] * [force-systemd-env-983000] minikube v1.34.0 on Darwin 15.0.1 (arm64)

	I1009 12:51:55.138116    4345 out.go:177]   - MINIKUBE_LOCATION=19780

	I1009 12:51:55.138170    4345 notify.go:220] Checking for updates...

	I1009 12:51:55.147055    4345 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19780-1164/kubeconfig

	I1009 12:51:55.154006    4345 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I1009 12:51:55.162009    4345 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1009 12:51:55.170025    4345 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19780-1164/.minikube

	I1009 12:51:55.178017    4345 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=true

	I1009 12:51:55.182462    4345 config.go:182] Loaded profile config "multinode-341000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I1009 12:51:55.182510    4345 driver.go:394] Setting default libvirt URI to qemu:///system

	I1009 12:51:55.186853    4345 out.go:177] * Using the qemu2 driver based on user configuration

	I1009 12:51:55.194021    4345 start.go:297] selected driver: qemu2

	I1009 12:51:55.194028    4345 start.go:901] validating driver "qemu2" against <nil>

	I1009 12:51:55.194034    4345 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I1009 12:51:55.196667    4345 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I1009 12:51:55.200837    4345 out.go:177] * Automatically selected the socket_vmnet network

	I1009 12:51:55.205076    4345 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]

	I1009 12:51:55.205092    4345 cni.go:84] Creating CNI manager for ""

	I1009 12:51:55.205123    4345 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I1009 12:51:55.205128    4345 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I1009 12:51:55.205158    4345 start.go:340] cluster config:

	{Name:force-systemd-env-983000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:force-systemd-env-983000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.l

ocal ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP

: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1009 12:51:55.209937    4345 iso.go:125] acquiring lock: {Name:mka6a0d59ae6cc32794e4fbfa8e5c6ce6a65e504 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1009 12:51:55.218002    4345 out.go:177] * Starting "force-systemd-env-983000" primary control-plane node in "force-systemd-env-983000" cluster

	I1009 12:51:55.222010    4345 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime docker

	I1009 12:51:55.222034    4345 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19780-1164/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4

	I1009 12:51:55.222044    4345 cache.go:56] Caching tarball of preloaded images

	I1009 12:51:55.222130    4345 preload.go:172] Found /Users/jenkins/minikube-integration/19780-1164/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I1009 12:51:55.222137    4345 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on docker

	I1009 12:51:55.222216    4345 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/force-systemd-env-983000/config.json ...

	I1009 12:51:55.222231    4345 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/force-systemd-env-983000/config.json: {Name:mkbb27f288ccc67a4fee262fbb42d29f461845c7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1009 12:51:55.222549    4345 start.go:360] acquireMachinesLock for force-systemd-env-983000: {Name:mk6dc29eb74286120c58954bae0cd65a85a89b02 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1009 12:51:55.222606    4345 start.go:364] duration metric: took 47.042µs to acquireMachinesLock for "force-systemd-env-983000"

	I1009 12:51:55.222617    4345 start.go:93] Provisioning new machine with config: &{Name:force-systemd-env-983000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19774/minikube-v1.34.0-1728382514-19774-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC

onfig:{KubernetesVersion:v1.31.1 ClusterName:force-systemd-env-983000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror:

DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1009 12:51:55.222649    4345 start.go:125] createHost starting for "" (driver="qemu2")

	I1009 12:51:55.229969    4345 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I1009 12:51:55.246975    4345 start.go:159] libmachine.API.Create for "force-systemd-env-983000" (driver="qemu2")

	I1009 12:51:55.247000    4345 client.go:168] LocalClient.Create starting

	I1009 12:51:55.247070    4345 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19780-1164/.minikube/certs/ca.pem

	I1009 12:51:55.247107    4345 main.go:141] libmachine: Decoding PEM data...

	I1009 12:51:55.247118    4345 main.go:141] libmachine: Parsing certificate...

	I1009 12:51:55.247155    4345 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19780-1164/.minikube/certs/cert.pem

	I1009 12:51:55.247184    4345 main.go:141] libmachine: Decoding PEM data...

	I1009 12:51:55.247196    4345 main.go:141] libmachine: Parsing certificate...

	I1009 12:51:55.247543    4345 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19780-1164/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19780-1164/.minikube/cache/iso/arm64/minikube-v1.34.0-1728382514-19774-arm64.iso...

	I1009 12:51:55.403359    4345 main.go:141] libmachine: Creating SSH key...

	I1009 12:51:55.559689    4345 main.go:141] libmachine: Creating Disk image...

	I1009 12:51:55.559700    4345 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I1009 12:51:55.559915    4345 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/force-systemd-env-983000/disk.qcow2.raw /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/force-systemd-env-983000/disk.qcow2

	I1009 12:51:55.570113    4345 main.go:141] libmachine: STDOUT: 

	I1009 12:51:55.570130    4345 main.go:141] libmachine: STDERR: 

	I1009 12:51:55.570203    4345 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/force-systemd-env-983000/disk.qcow2 +20000M

	I1009 12:51:55.579108    4345 main.go:141] libmachine: STDOUT: Image resized.

	I1009 12:51:55.579124    4345 main.go:141] libmachine: STDERR: 

	I1009 12:51:55.579141    4345 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/force-systemd-env-983000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/force-systemd-env-983000/disk.qcow2

	I1009 12:51:55.579145    4345 main.go:141] libmachine: Starting QEMU VM...

	I1009 12:51:55.579156    4345 qemu.go:418] Using hvf for hardware acceleration

	I1009 12:51:55.579185    4345 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/force-systemd-env-983000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19780-1164/.minikube/machines/force-systemd-env-983000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/force-systemd-env-983000/qemu.pid -device virtio-net-pci,netdev=net0,mac=2a:87:89:68:79:0e -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/force-systemd-env-983000/disk.qcow2

	I1009 12:51:55.581130    4345 main.go:141] libmachine: STDOUT: 

	I1009 12:51:55.581146    4345 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I1009 12:51:55.581168    4345 client.go:171] duration metric: took 334.17375ms to LocalClient.Create

	I1009 12:51:57.583317    4345 start.go:128] duration metric: took 2.360714s to createHost

	I1009 12:51:57.583431    4345 start.go:83] releasing machines lock for "force-systemd-env-983000", held for 2.360893125s

	W1009 12:51:57.583508    4345 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I1009 12:51:57.601563    4345 out.go:177] * Deleting "force-systemd-env-983000" in qemu2 ...

	W1009 12:51:57.623413    4345 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I1009 12:51:57.623436    4345 start.go:729] Will try again in 5 seconds ...

	I1009 12:52:02.625741    4345 start.go:360] acquireMachinesLock for force-systemd-env-983000: {Name:mk6dc29eb74286120c58954bae0cd65a85a89b02 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1009 12:52:02.626349    4345 start.go:364] duration metric: took 465.084µs to acquireMachinesLock for "force-systemd-env-983000"

	I1009 12:52:02.626509    4345 start.go:93] Provisioning new machine with config: &{Name:force-systemd-env-983000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19774/minikube-v1.34.0-1728382514-19774-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC

onfig:{KubernetesVersion:v1.31.1 ClusterName:force-systemd-env-983000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror:

DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1009 12:52:02.626763    4345 start.go:125] createHost starting for "" (driver="qemu2")

	I1009 12:52:02.632356    4345 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I1009 12:52:02.680873    4345 start.go:159] libmachine.API.Create for "force-systemd-env-983000" (driver="qemu2")

	I1009 12:52:02.680924    4345 client.go:168] LocalClient.Create starting

	I1009 12:52:02.681064    4345 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19780-1164/.minikube/certs/ca.pem

	I1009 12:52:02.681136    4345 main.go:141] libmachine: Decoding PEM data...

	I1009 12:52:02.681150    4345 main.go:141] libmachine: Parsing certificate...

	I1009 12:52:02.681207    4345 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19780-1164/.minikube/certs/cert.pem

	I1009 12:52:02.681266    4345 main.go:141] libmachine: Decoding PEM data...

	I1009 12:52:02.681276    4345 main.go:141] libmachine: Parsing certificate...

	I1009 12:52:02.681939    4345 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19780-1164/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19780-1164/.minikube/cache/iso/arm64/minikube-v1.34.0-1728382514-19774-arm64.iso...

	I1009 12:52:02.848391    4345 main.go:141] libmachine: Creating SSH key...

	I1009 12:52:02.902048    4345 main.go:141] libmachine: Creating Disk image...

	I1009 12:52:02.902054    4345 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I1009 12:52:02.902270    4345 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/force-systemd-env-983000/disk.qcow2.raw /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/force-systemd-env-983000/disk.qcow2

	I1009 12:52:02.912219    4345 main.go:141] libmachine: STDOUT: 

	I1009 12:52:02.912238    4345 main.go:141] libmachine: STDERR: 

	I1009 12:52:02.912295    4345 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/force-systemd-env-983000/disk.qcow2 +20000M

	I1009 12:52:02.920876    4345 main.go:141] libmachine: STDOUT: Image resized.

	I1009 12:52:02.920900    4345 main.go:141] libmachine: STDERR: 

	I1009 12:52:02.920911    4345 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/force-systemd-env-983000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/force-systemd-env-983000/disk.qcow2

	I1009 12:52:02.920916    4345 main.go:141] libmachine: Starting QEMU VM...

	I1009 12:52:02.920926    4345 qemu.go:418] Using hvf for hardware acceleration

	I1009 12:52:02.920954    4345 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/force-systemd-env-983000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19780-1164/.minikube/machines/force-systemd-env-983000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/force-systemd-env-983000/qemu.pid -device virtio-net-pci,netdev=net0,mac=c6:6b:26:da:e8:aa -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/force-systemd-env-983000/disk.qcow2

	I1009 12:52:02.922795    4345 main.go:141] libmachine: STDOUT: 

	I1009 12:52:02.922809    4345 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I1009 12:52:02.922827    4345 client.go:171] duration metric: took 241.904875ms to LocalClient.Create

	I1009 12:52:04.924929    4345 start.go:128] duration metric: took 2.298207333s to createHost

	I1009 12:52:04.925024    4345 start.go:83] releasing machines lock for "force-systemd-env-983000", held for 2.298709375s

	W1009 12:52:04.925460    4345 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p force-systemd-env-983000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p force-systemd-env-983000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I1009 12:52:04.935013    4345 out.go:201] 

	W1009 12:52:04.941060    4345 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W1009 12:52:04.941087    4345 out.go:270] * 

	* 

	W1009 12:52:04.943869    4345 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I1009 12:52:04.952993    4345 out.go:201] 

** /stderr **

docker_test.go:157: failed to start minikube with args: "out/minikube-darwin-arm64 start -p force-systemd-env-983000 --memory=2048 --alsologtostderr -v=5 --driver=qemu2 " : exit status 80

docker_test.go:110: (dbg) Run:  out/minikube-darwin-arm64 -p force-systemd-env-983000 ssh "docker info --format {{.CgroupDriver}}"

docker_test.go:110: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p force-systemd-env-983000 ssh "docker info --format {{.CgroupDriver}}": exit status 83 (80.017083ms)

-- stdout --

	* The control-plane node force-systemd-env-983000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p force-systemd-env-983000"

-- /stdout --

docker_test.go:112: failed to get docker cgroup driver. args "out/minikube-darwin-arm64 -p force-systemd-env-983000 ssh \"docker info --format {{.CgroupDriver}}\"": exit status 83

docker_test.go:166: *** TestForceSystemdEnv FAILED at 2024-10-09 12:52:05.049191 -0700 PDT m=+3990.950773043

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-env-983000 -n force-systemd-env-983000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-env-983000 -n force-systemd-env-983000: exit status 7 (37.541709ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "force-systemd-env-983000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "force-systemd-env-983000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p force-systemd-env-983000

--- FAIL: TestForceSystemdEnv (10.10s)

=== RUN   TestFunctional/parallel/ServiceCmdConnect

=== PAUSE TestFunctional/parallel/ServiceCmdConnect

=== CONT  TestFunctional/parallel/ServiceCmdConnect

functional_test.go:1627: (dbg) Run:  kubectl --context functional-517000 create deployment hello-node-connect --image=registry.k8s.io/echoserver-arm:1.8

functional_test.go:1635: (dbg) Run:  kubectl --context functional-517000 expose deployment hello-node-connect --type=NodePort --port=8080

functional_test.go:1640: (dbg) TestFunctional/parallel/ServiceCmdConnect: waiting 10m0s for pods matching "app=hello-node-connect" in namespace "default" ...

helpers_test.go:344: "hello-node-connect-65d86f57f4-88jjn" [132ecdf9-5e02-4865-a825-6a9ee4e20459] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])

helpers_test.go:344: "hello-node-connect-65d86f57f4-88jjn" [132ecdf9-5e02-4865-a825-6a9ee4e20459] Running / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])

functional_test.go:1640: (dbg) TestFunctional/parallel/ServiceCmdConnect: app=hello-node-connect healthy within 7.003939125s

functional_test.go:1649: (dbg) Run:  out/minikube-darwin-arm64 -p functional-517000 service hello-node-connect --url

functional_test.go:1655: found endpoint for hello-node-connect: http://192.168.105.4:31116

functional_test.go:1661: error fetching http://192.168.105.4:31116: Get "http://192.168.105.4:31116": dial tcp 192.168.105.4:31116: connect: connection refused

I1009 11:52:17.805387    1686 retry.go:31] will retry after 872.733177ms: Get "http://192.168.105.4:31116": dial tcp 192.168.105.4:31116: connect: connection refused

functional_test.go:1661: error fetching http://192.168.105.4:31116: Get "http://192.168.105.4:31116": dial tcp 192.168.105.4:31116: connect: connection refused

I1009 11:52:18.680786    1686 retry.go:31] will retry after 1.483122445s: Get "http://192.168.105.4:31116": dial tcp 192.168.105.4:31116: connect: connection refused

functional_test.go:1661: error fetching http://192.168.105.4:31116: Get "http://192.168.105.4:31116": dial tcp 192.168.105.4:31116: connect: connection refused

I1009 11:52:20.167707    1686 retry.go:31] will retry after 1.796406145s: Get "http://192.168.105.4:31116": dial tcp 192.168.105.4:31116: connect: connection refused

functional_test.go:1661: error fetching http://192.168.105.4:31116: Get "http://192.168.105.4:31116": dial tcp 192.168.105.4:31116: connect: connection refused

I1009 11:52:21.967372    1686 retry.go:31] will retry after 4.265805066s: Get "http://192.168.105.4:31116": dial tcp 192.168.105.4:31116: connect: connection refused

functional_test.go:1661: error fetching http://192.168.105.4:31116: Get "http://192.168.105.4:31116": dial tcp 192.168.105.4:31116: connect: connection refused

I1009 11:52:26.235872    1686 retry.go:31] will retry after 6.611761151s: Get "http://192.168.105.4:31116": dial tcp 192.168.105.4:31116: connect: connection refused

functional_test.go:1661: error fetching http://192.168.105.4:31116: Get "http://192.168.105.4:31116": dial tcp 192.168.105.4:31116: connect: connection refused

I1009 11:52:32.850802    1686 retry.go:31] will retry after 4.360740237s: Get "http://192.168.105.4:31116": dial tcp 192.168.105.4:31116: connect: connection refused

functional_test.go:1661: error fetching http://192.168.105.4:31116: Get "http://192.168.105.4:31116": dial tcp 192.168.105.4:31116: connect: connection refused

functional_test.go:1681: failed to fetch http://192.168.105.4:31116: Get "http://192.168.105.4:31116": dial tcp 192.168.105.4:31116: connect: connection refused

functional_test.go:1598: service test failed - dumping debug information

functional_test.go:1599: -----------------------service failure post-mortem--------------------------------

functional_test.go:1602: (dbg) Run:  kubectl --context functional-517000 describe po hello-node-connect

functional_test.go:1606: hello-node pod describe:

Name:             hello-node-connect-65d86f57f4-88jjn

Namespace:        default

Priority:         0

Service Account:  default

Node:             functional-517000/192.168.105.4

Start Time:       Wed, 09 Oct 2024 11:52:10 -0700

Labels:           app=hello-node-connect

pod-template-hash=65d86f57f4

Annotations:      <none>

Status:           Running

IP:               10.244.0.8

IPs:

IP:           10.244.0.8

Controlled By:  ReplicaSet/hello-node-connect-65d86f57f4

Containers:

echoserver-arm:

Container ID:   docker://93962dd42a5009524726a8dd83795622ace99a226632873d250e32615a7f4e10

Image:          registry.k8s.io/echoserver-arm:1.8

Image ID:       docker-pullable://registry.k8s.io/echoserver-arm@sha256:b33d4cdf6ed097f4e9b77b135d83a596ab73c6268b0342648818eb85f5edfdb5

Port:           <none>

Host Port:      <none>

State:          Terminated

Reason:       Error

Exit Code:    1

Started:      Wed, 09 Oct 2024 11:52:28 -0700

Finished:     Wed, 09 Oct 2024 11:52:28 -0700

Last State:     Terminated

Reason:       Error

Exit Code:    1

Started:      Wed, 09 Oct 2024 11:52:11 -0700

Finished:     Wed, 09 Oct 2024 11:52:11 -0700

Ready:          False

Restart Count:  2

Environment:    <none>

Mounts:

/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-p5n8g (ro)

Conditions:

Type                        Status

PodReadyToStartContainers   True 

Initialized                 True 

Ready                       False 

ContainersReady             False 

PodScheduled                True 

Volumes:

kube-api-access-p5n8g:

Type:                    Projected (a volume that contains injected data from multiple sources)

TokenExpirationSeconds:  3607

ConfigMapName:           kube-root-ca.crt

ConfigMapOptional:       <nil>

DownwardAPI:             true

QoS Class:                   BestEffort

Node-Selectors:              <none>

Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

Events:

Type     Reason     Age               From               Message

----     ------     ----              ----               -------

Normal   Scheduled  26s               default-scheduler  Successfully assigned default/hello-node-connect-65d86f57f4-88jjn to functional-517000

Normal   Pulled     9s (x3 over 26s)  kubelet            Container image "registry.k8s.io/echoserver-arm:1.8" already present on machine

Normal   Created    9s (x3 over 26s)  kubelet            Created container echoserver-arm

Normal   Started    9s (x3 over 26s)  kubelet            Started container echoserver-arm

Warning  BackOff    8s (x2 over 25s)  kubelet            Back-off restarting failed container echoserver-arm in pod hello-node-connect-65d86f57f4-88jjn_default(132ecdf9-5e02-4865-a825-6a9ee4e20459)

functional_test.go:1608: (dbg) Run:  kubectl --context functional-517000 logs -l app=hello-node-connect

functional_test.go:1612: hello-node logs:

exec /usr/sbin/nginx: exec format error

functional_test.go:1614: (dbg) Run:  kubectl --context functional-517000 describe svc hello-node-connect

functional_test.go:1618: hello-node svc describe:

Name:                     hello-node-connect

Namespace:                default

Labels:                   app=hello-node-connect

Annotations:              <none>

Selector:                 app=hello-node-connect

Type:                     NodePort

IP Family Policy:         SingleStack

IP Families:              IPv4

IP:                       10.100.70.29

IPs:                      10.100.70.29

Port:                     <unset>  8080/TCP

TargetPort:               8080/TCP

NodePort:                 <unset>  31116/TCP

Endpoints:                

Session Affinity:         None

External Traffic Policy:  Cluster

Events:                   <none>

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p functional-517000 -n functional-517000

helpers_test.go:244: <<< TestFunctional/parallel/ServiceCmdConnect FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestFunctional/parallel/ServiceCmdConnect]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-darwin-arm64 -p functional-517000 logs -n 25

helpers_test.go:252: TestFunctional/parallel/ServiceCmdConnect logs: 

-- stdout --

	==> Audit <==

	|---------|-----------------------------------------------------------------------------------------------------------------|-------------------|---------|---------|---------------------|---------------------|

	| Command |                                                      Args                                                       |      Profile      |  User   | Version |     Start Time      |      End Time       |

	|---------|-----------------------------------------------------------------------------------------------------------------|-------------------|---------|---------|---------------------|---------------------|

	| image   | functional-517000 image load --daemon                                                                           | functional-517000 | jenkins | v1.34.0 | 09 Oct 24 11:51 PDT | 09 Oct 24 11:51 PDT |

	|         | kicbase/echo-server:functional-517000                                                                           |                   |         |         |                     |                     |

	|         | --alsologtostderr                                                                                               |                   |         |         |                     |                     |

	| image   | functional-517000 image ls                                                                                      | functional-517000 | jenkins | v1.34.0 | 09 Oct 24 11:51 PDT | 09 Oct 24 11:51 PDT |

	| image   | functional-517000 image save                                                                                    | functional-517000 | jenkins | v1.34.0 | 09 Oct 24 11:51 PDT | 09 Oct 24 11:51 PDT |

	|         | kicbase/echo-server:functional-517000                                                                           |                   |         |         |                     |                     |

	|         | /Users/jenkins/workspace/echo-server-save.tar                                                                   |                   |         |         |                     |                     |

	|         | --alsologtostderr                                                                                               |                   |         |         |                     |                     |

	| image   | functional-517000 image rm                                                                                      | functional-517000 | jenkins | v1.34.0 | 09 Oct 24 11:51 PDT | 09 Oct 24 11:51 PDT |

	|         | kicbase/echo-server:functional-517000                                                                           |                   |         |         |                     |                     |

	|         | --alsologtostderr                                                                                               |                   |         |         |                     |                     |

	| image   | functional-517000 image ls                                                                                      | functional-517000 | jenkins | v1.34.0 | 09 Oct 24 11:51 PDT | 09 Oct 24 11:51 PDT |

	| image   | functional-517000 image load                                                                                    | functional-517000 | jenkins | v1.34.0 | 09 Oct 24 11:51 PDT | 09 Oct 24 11:51 PDT |

	|         | /Users/jenkins/workspace/echo-server-save.tar                                                                   |                   |         |         |                     |                     |

	|         | --alsologtostderr                                                                                               |                   |         |         |                     |                     |

	| image   | functional-517000 image ls                                                                                      | functional-517000 | jenkins | v1.34.0 | 09 Oct 24 11:51 PDT | 09 Oct 24 11:51 PDT |

	| image   | functional-517000 image save --daemon                                                                           | functional-517000 | jenkins | v1.34.0 | 09 Oct 24 11:51 PDT | 09 Oct 24 11:51 PDT |

	|         | kicbase/echo-server:functional-517000                                                                           |                   |         |         |                     |                     |

	|         | --alsologtostderr                                                                                               |                   |         |         |                     |                     |

	| ssh     | functional-517000 ssh echo                                                                                      | functional-517000 | jenkins | v1.34.0 | 09 Oct 24 11:51 PDT | 09 Oct 24 11:51 PDT |

	|         | hello                                                                                                           |                   |         |         |                     |                     |

	| ssh     | functional-517000 ssh cat                                                                                       | functional-517000 | jenkins | v1.34.0 | 09 Oct 24 11:51 PDT | 09 Oct 24 11:51 PDT |

	|         | /etc/hostname                                                                                                   |                   |         |         |                     |                     |

	| tunnel  | functional-517000 tunnel                                                                                        | functional-517000 | jenkins | v1.34.0 | 09 Oct 24 11:51 PDT |                     |

	|         | --alsologtostderr                                                                                               |                   |         |         |                     |                     |

	| tunnel  | functional-517000 tunnel                                                                                        | functional-517000 | jenkins | v1.34.0 | 09 Oct 24 11:51 PDT |                     |

	|         | --alsologtostderr                                                                                               |                   |         |         |                     |                     |

	| tunnel  | functional-517000 tunnel                                                                                        | functional-517000 | jenkins | v1.34.0 | 09 Oct 24 11:52 PDT |                     |

	|         | --alsologtostderr                                                                                               |                   |         |         |                     |                     |

	| service | functional-517000 service list                                                                                  | functional-517000 | jenkins | v1.34.0 | 09 Oct 24 11:52 PDT | 09 Oct 24 11:52 PDT |

	| service | functional-517000 service list                                                                                  | functional-517000 | jenkins | v1.34.0 | 09 Oct 24 11:52 PDT | 09 Oct 24 11:52 PDT |

	|         | -o json                                                                                                         |                   |         |         |                     |                     |

	| service | functional-517000 service                                                                                       | functional-517000 | jenkins | v1.34.0 | 09 Oct 24 11:52 PDT | 09 Oct 24 11:52 PDT |

	|         | --namespace=default --https                                                                                     |                   |         |         |                     |                     |

	|         | --url hello-node                                                                                                |                   |         |         |                     |                     |

	| service | functional-517000                                                                                               | functional-517000 | jenkins | v1.34.0 | 09 Oct 24 11:52 PDT | 09 Oct 24 11:52 PDT |

	|         | service hello-node --url                                                                                        |                   |         |         |                     |                     |

	|         | --format={{.IP}}                                                                                                |                   |         |         |                     |                     |

	| service | functional-517000 service                                                                                       | functional-517000 | jenkins | v1.34.0 | 09 Oct 24 11:52 PDT | 09 Oct 24 11:52 PDT |

	|         | hello-node --url                                                                                                |                   |         |         |                     |                     |

	| addons  | functional-517000 addons list                                                                                   | functional-517000 | jenkins | v1.34.0 | 09 Oct 24 11:52 PDT | 09 Oct 24 11:52 PDT |

	| addons  | functional-517000 addons list                                                                                   | functional-517000 | jenkins | v1.34.0 | 09 Oct 24 11:52 PDT | 09 Oct 24 11:52 PDT |

	|         | -o json                                                                                                         |                   |         |         |                     |                     |

	| service | functional-517000 service                                                                                       | functional-517000 | jenkins | v1.34.0 | 09 Oct 24 11:52 PDT | 09 Oct 24 11:52 PDT |

	|         | hello-node-connect --url                                                                                        |                   |         |         |                     |                     |

	| ssh     | functional-517000 ssh findmnt                                                                                   | functional-517000 | jenkins | v1.34.0 | 09 Oct 24 11:52 PDT | 09 Oct 24 11:52 PDT |

	|         | -T /mount-9p | grep 9p                                                                                          |                   |         |         |                     |                     |

	| mount   | -p functional-517000                                                                                            | functional-517000 | jenkins | v1.34.0 | 09 Oct 24 11:52 PDT |                     |

	|         | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalparallelMountCmdany-port3362515138/001:/mount-9p |                   |         |         |                     |                     |

	|         | --alsologtostderr -v=1                                                                                          |                   |         |         |                     |                     |

	| ssh     | functional-517000 ssh -- ls                                                                                     | functional-517000 | jenkins | v1.34.0 | 09 Oct 24 11:52 PDT | 09 Oct 24 11:52 PDT |

	|         | -la /mount-9p                                                                                                   |                   |         |         |                     |                     |

	| ssh     | functional-517000 ssh cat                                                                                       | functional-517000 | jenkins | v1.34.0 | 09 Oct 24 11:52 PDT | 09 Oct 24 11:52 PDT |

	|         | /mount-9p/test-1728499954959023000                                                                              |                   |         |         |                     |                     |

	|---------|-----------------------------------------------------------------------------------------------------------------|-------------------|---------|---------|---------------------|---------------------|

	==> Last Start <==

	Log file created at: 2024/10/09 11:51:14

	Running on machine: MacOS-M1-Agent-1

	Binary: Built with gc go1.23.1 for darwin/arm64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I1009 11:51:14.861639    1966 out.go:345] Setting OutFile to fd 1 ...

	I1009 11:51:14.861796    1966 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 11:51:14.861798    1966 out.go:358] Setting ErrFile to fd 2...

	I1009 11:51:14.861800    1966 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 11:51:14.861944    1966 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19780-1164/.minikube/bin

	I1009 11:51:14.863021    1966 out.go:352] Setting JSON to false

	I1009 11:51:14.880854    1966 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":1244,"bootTime":1728498630,"procs":512,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}

	W1009 11:51:14.880930    1966 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I1009 11:51:14.886236    1966 out.go:177] * [functional-517000] minikube v1.34.0 on Darwin 15.0.1 (arm64)

	I1009 11:51:14.895221    1966 out.go:177]   - MINIKUBE_LOCATION=19780

	I1009 11:51:14.895271    1966 notify.go:220] Checking for updates...

	I1009 11:51:14.902149    1966 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19780-1164/kubeconfig

	I1009 11:51:14.905210    1966 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I1009 11:51:14.908138    1966 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1009 11:51:14.911171    1966 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19780-1164/.minikube

	I1009 11:51:14.914191    1966 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I1009 11:51:14.915831    1966 config.go:182] Loaded profile config "functional-517000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I1009 11:51:14.915882    1966 driver.go:394] Setting default libvirt URI to qemu:///system

	I1009 11:51:14.920143    1966 out.go:177] * Using the qemu2 driver based on existing profile

	I1009 11:51:14.927025    1966 start.go:297] selected driver: qemu2

	I1009 11:51:14.927029    1966 start.go:901] validating driver "qemu2" against &{Name:functional-517000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19774/minikube-v1.34.0-1728382514-19774-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kub

ernetesVersion:v1.31.1 ClusterName:functional-517000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.4 Port:8441 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2

000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1009 11:51:14.927070    1966 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I1009 11:51:14.929556    1966 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I1009 11:51:14.929574    1966 cni.go:84] Creating CNI manager for ""

	I1009 11:51:14.929608    1966 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I1009 11:51:14.929648    1966 start.go:340] cluster config:

	{Name:functional-517000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19774/minikube-v1.34.0-1728382514-19774-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:functional-517000 Namespace:default APIServe

rHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.4 Port:8441 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2

000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1009 11:51:14.933962    1966 iso.go:125] acquiring lock: {Name:mka6a0d59ae6cc32794e4fbfa8e5c6ce6a65e504 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1009 11:51:14.945218    1966 out.go:177] * Starting "functional-517000" primary control-plane node in "functional-517000" cluster

	I1009 11:51:14.949172    1966 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime docker

	I1009 11:51:14.949183    1966 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19780-1164/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4

	I1009 11:51:14.949195    1966 cache.go:56] Caching tarball of preloaded images

	I1009 11:51:14.949262    1966 preload.go:172] Found /Users/jenkins/minikube-integration/19780-1164/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I1009 11:51:14.949266    1966 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on docker

	I1009 11:51:14.949314    1966 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/functional-517000/config.json ...

	I1009 11:51:14.949840    1966 start.go:360] acquireMachinesLock for functional-517000: {Name:mk6dc29eb74286120c58954bae0cd65a85a89b02 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1009 11:51:14.949888    1966 start.go:364] duration metric: took 43.084µs to acquireMachinesLock for "functional-517000"

	I1009 11:51:14.949895    1966 start.go:96] Skipping create...Using existing machine configuration

	I1009 11:51:14.949897    1966 fix.go:54] fixHost starting: 

	I1009 11:51:14.950522    1966 fix.go:112] recreateIfNeeded on functional-517000: state=Running err=<nil>

	W1009 11:51:14.950529    1966 fix.go:138] unexpected machine state, will restart: <nil>

	I1009 11:51:14.958115    1966 out.go:177] * Updating the running qemu2 "functional-517000" VM ...

	I1009 11:51:14.962172    1966 machine.go:93] provisionDockerMachine start ...

	I1009 11:51:14.962213    1966 main.go:141] libmachine: Using SSH client type: native

	I1009 11:51:14.962339    1966 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1006fa480] 0x1006fccc0 <nil>  [] 0s} 192.168.105.4 22 <nil> <nil>}

	I1009 11:51:14.962342    1966 main.go:141] libmachine: About to run SSH command:

	hostname

	I1009 11:51:15.005606    1966 main.go:141] libmachine: SSH cmd err, output: <nil>: functional-517000

	I1009 11:51:15.005620    1966 buildroot.go:166] provisioning hostname "functional-517000"

	I1009 11:51:15.005673    1966 main.go:141] libmachine: Using SSH client type: native

	I1009 11:51:15.005777    1966 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1006fa480] 0x1006fccc0 <nil>  [] 0s} 192.168.105.4 22 <nil> <nil>}

	I1009 11:51:15.005781    1966 main.go:141] libmachine: About to run SSH command:

	sudo hostname functional-517000 && echo "functional-517000" | sudo tee /etc/hostname

	I1009 11:51:15.051791    1966 main.go:141] libmachine: SSH cmd err, output: <nil>: functional-517000

	I1009 11:51:15.051844    1966 main.go:141] libmachine: Using SSH client type: native

	I1009 11:51:15.051947    1966 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1006fa480] 0x1006fccc0 <nil>  [] 0s} 192.168.105.4 22 <nil> <nil>}

	I1009 11:51:15.051953    1966 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sfunctional-517000' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 functional-517000/g' /etc/hosts;

				else 

					echo '127.0.1.1 functional-517000' | sudo tee -a /etc/hosts; 

				fi

			fi

	I1009 11:51:15.090797    1966 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I1009 11:51:15.090804    1966 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/19780-1164/.minikube CaCertPath:/Users/jenkins/minikube-integration/19780-1164/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/19780-1164/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/19780-1164/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/19780-1164/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/19780-1164/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/19780-1164/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/19780-1164/.minikube}

	I1009 11:51:15.090810    1966 buildroot.go:174] setting up certificates

	I1009 11:51:15.090814    1966 provision.go:84] configureAuth start

	I1009 11:51:15.090821    1966 provision.go:143] copyHostCerts

	I1009 11:51:15.090889    1966 exec_runner.go:144] found /Users/jenkins/minikube-integration/19780-1164/.minikube/ca.pem, removing ...

	I1009 11:51:15.090893    1966 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/19780-1164/.minikube/ca.pem

	I1009 11:51:15.091146    1966 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19780-1164/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/19780-1164/.minikube/ca.pem (1078 bytes)

	I1009 11:51:15.091340    1966 exec_runner.go:144] found /Users/jenkins/minikube-integration/19780-1164/.minikube/cert.pem, removing ...

	I1009 11:51:15.091343    1966 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/19780-1164/.minikube/cert.pem

	I1009 11:51:15.091404    1966 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19780-1164/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/19780-1164/.minikube/cert.pem (1123 bytes)

	I1009 11:51:15.091526    1966 exec_runner.go:144] found /Users/jenkins/minikube-integration/19780-1164/.minikube/key.pem, removing ...

	I1009 11:51:15.091528    1966 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/19780-1164/.minikube/key.pem

	I1009 11:51:15.091582    1966 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19780-1164/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/19780-1164/.minikube/key.pem (1679 bytes)

	I1009 11:51:15.091662    1966 provision.go:117] generating server cert: /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/19780-1164/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/19780-1164/.minikube/certs/ca-key.pem org=jenkins.functional-517000 san=[127.0.0.1 192.168.105.4 functional-517000 localhost minikube]

	I1009 11:51:15.264353    1966 provision.go:177] copyRemoteCerts

	I1009 11:51:15.264426    1966 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I1009 11:51:15.264434    1966 sshutil.go:53] new ssh client: &{IP:192.168.105.4 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19780-1164/.minikube/machines/functional-517000/id_rsa Username:docker}

	I1009 11:51:15.289197    1966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19780-1164/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I1009 11:51:15.298324    1966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)

	I1009 11:51:15.306810    1966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I1009 11:51:15.317817    1966 provision.go:87] duration metric: took 226.995167ms to configureAuth

	I1009 11:51:15.317825    1966 buildroot.go:189] setting minikube options for container-runtime

	I1009 11:51:15.317940    1966 config.go:182] Loaded profile config "functional-517000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I1009 11:51:15.317988    1966 main.go:141] libmachine: Using SSH client type: native

	I1009 11:51:15.318107    1966 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1006fa480] 0x1006fccc0 <nil>  [] 0s} 192.168.105.4 22 <nil> <nil>}

	I1009 11:51:15.318111    1966 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I1009 11:51:15.357728    1966 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I1009 11:51:15.357734    1966 buildroot.go:70] root file system type: tmpfs

	I1009 11:51:15.357783    1966 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...

	I1009 11:51:15.357844    1966 main.go:141] libmachine: Using SSH client type: native

	I1009 11:51:15.357958    1966 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1006fa480] 0x1006fccc0 <nil>  [] 0s} 192.168.105.4 22 <nil> <nil>}

	I1009 11:51:15.357988    1966 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %s "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I1009 11:51:15.403602    1966 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I1009 11:51:15.403659    1966 main.go:141] libmachine: Using SSH client type: native

	I1009 11:51:15.403783    1966 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1006fa480] 0x1006fccc0 <nil>  [] 0s} 192.168.105.4 22 <nil> <nil>}

	I1009 11:51:15.403790    1966 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I1009 11:51:15.445474    1966 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I1009 11:51:15.445480    1966 machine.go:96] duration metric: took 483.306459ms to provisionDockerMachine

	I1009 11:51:15.445484    1966 start.go:293] postStartSetup for "functional-517000" (driver="qemu2")

	I1009 11:51:15.445489    1966 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I1009 11:51:15.445539    1966 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I1009 11:51:15.445545    1966 sshutil.go:53] new ssh client: &{IP:192.168.105.4 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19780-1164/.minikube/machines/functional-517000/id_rsa Username:docker}

	I1009 11:51:15.466930    1966 ssh_runner.go:195] Run: cat /etc/os-release

	I1009 11:51:15.468501    1966 info.go:137] Remote host: Buildroot 2023.02.9

	I1009 11:51:15.468506    1966 filesync.go:126] Scanning /Users/jenkins/minikube-integration/19780-1164/.minikube/addons for local assets ...

	I1009 11:51:15.468590    1966 filesync.go:126] Scanning /Users/jenkins/minikube-integration/19780-1164/.minikube/files for local assets ...

	I1009 11:51:15.468732    1966 filesync.go:149] local asset: /Users/jenkins/minikube-integration/19780-1164/.minikube/files/etc/ssl/certs/16862.pem -> 16862.pem in /etc/ssl/certs

	I1009 11:51:15.468882    1966 filesync.go:149] local asset: /Users/jenkins/minikube-integration/19780-1164/.minikube/files/etc/test/nested/copy/1686/hosts -> hosts in /etc/test/nested/copy/1686

	I1009 11:51:15.468926    1966 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs /etc/test/nested/copy/1686

	I1009 11:51:15.472820    1966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19780-1164/.minikube/files/etc/ssl/certs/16862.pem --> /etc/ssl/certs/16862.pem (1708 bytes)

	I1009 11:51:15.481672    1966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19780-1164/.minikube/files/etc/test/nested/copy/1686/hosts --> /etc/test/nested/copy/1686/hosts (40 bytes)

	I1009 11:51:15.490097    1966 start.go:296] duration metric: took 44.608708ms for postStartSetup

	I1009 11:51:15.490107    1966 fix.go:56] duration metric: took 540.21125ms for fixHost

	I1009 11:51:15.490148    1966 main.go:141] libmachine: Using SSH client type: native

	I1009 11:51:15.490241    1966 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1006fa480] 0x1006fccc0 <nil>  [] 0s} 192.168.105.4 22 <nil> <nil>}

	I1009 11:51:15.490244    1966 main.go:141] libmachine: About to run SSH command:

	date +%s.%N

	I1009 11:51:15.530018    1966 main.go:141] libmachine: SSH cmd err, output: <nil>: 1728499875.562135089

	I1009 11:51:15.530024    1966 fix.go:216] guest clock: 1728499875.562135089

	I1009 11:51:15.530027    1966 fix.go:229] Guest: 2024-10-09 11:51:15.562135089 -0700 PDT Remote: 2024-10-09 11:51:15.490109 -0700 PDT m=+0.649767585 (delta=72.026089ms)

	I1009 11:51:15.530037    1966 fix.go:200] guest clock delta is within tolerance: 72.026089ms

	I1009 11:51:15.530039    1966 start.go:83] releasing machines lock for "functional-517000", held for 580.149833ms

	I1009 11:51:15.530381    1966 ssh_runner.go:195] Run: cat /version.json

	I1009 11:51:15.530387    1966 sshutil.go:53] new ssh client: &{IP:192.168.105.4 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19780-1164/.minikube/machines/functional-517000/id_rsa Username:docker}

	I1009 11:51:15.530407    1966 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I1009 11:51:15.530428    1966 sshutil.go:53] new ssh client: &{IP:192.168.105.4 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19780-1164/.minikube/machines/functional-517000/id_rsa Username:docker}

	I1009 11:51:15.553077    1966 ssh_runner.go:195] Run: systemctl --version

	I1009 11:51:15.594053    1966 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W1009 11:51:15.596046    1966 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I1009 11:51:15.596084    1966 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I1009 11:51:15.599963    1966 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable

	I1009 11:51:15.599968    1966 start.go:495] detecting cgroup driver to use...

	I1009 11:51:15.600033    1966 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I1009 11:51:15.606573    1966 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"

	I1009 11:51:15.610210    1966 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I1009 11:51:15.614164    1966 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...

	I1009 11:51:15.614191    1966 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I1009 11:51:15.617915    1966 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I1009 11:51:15.621896    1966 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I1009 11:51:15.625761    1966 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I1009 11:51:15.629587    1966 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I1009 11:51:15.633504    1966 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I1009 11:51:15.637660    1966 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"

	I1009 11:51:15.641759    1966 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1  enable_unprivileged_ports = true|' /etc/containerd/config.toml"

	I1009 11:51:15.645692    1966 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I1009 11:51:15.649673    1966 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I1009 11:51:15.653669    1966 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1009 11:51:15.756412    1966 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I1009 11:51:15.767097    1966 start.go:495] detecting cgroup driver to use...

	I1009 11:51:15.767187    1966 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I1009 11:51:15.773002    1966 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1009 11:51:15.779495    1966 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I1009 11:51:15.789962    1966 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1009 11:51:15.795698    1966 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I1009 11:51:15.800843    1966 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I1009 11:51:15.807613    1966 ssh_runner.go:195] Run: which cri-dockerd

	I1009 11:51:15.809013    1966 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I1009 11:51:15.812856    1966 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (190 bytes)

	I1009 11:51:15.819312    1966 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I1009 11:51:15.911852    1966 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I1009 11:51:16.004860    1966 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...

	I1009 11:51:16.004922    1966 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)

	I1009 11:51:16.011804    1966 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1009 11:51:16.122915    1966 ssh_runner.go:195] Run: sudo systemctl restart docker

	I1009 11:51:28.507156    1966 ssh_runner.go:235] Completed: sudo systemctl restart docker: (12.384301458s)

	I1009 11:51:28.507240    1966 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket

	I1009 11:51:28.512754    1966 ssh_runner.go:195] Run: sudo systemctl stop cri-docker.socket

	I1009 11:51:28.520634    1966 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service

	I1009 11:51:28.526547    1966 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I1009 11:51:28.612120    1966 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I1009 11:51:28.698533    1966 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1009 11:51:28.791093    1966 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I1009 11:51:28.797972    1966 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service

	I1009 11:51:28.803379    1966 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1009 11:51:28.891004    1966 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service

	I1009 11:51:28.919806    1966 start.go:542] Will wait 60s for socket path /var/run/cri-dockerd.sock

	I1009 11:51:28.919911    1966 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I1009 11:51:28.922216    1966 start.go:563] Will wait 60s for crictl version

	I1009 11:51:28.922279    1966 ssh_runner.go:195] Run: which crictl

	I1009 11:51:28.924051    1966 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I1009 11:51:28.944862    1966 start.go:579] Version:  0.1.0

	RuntimeName:  docker

	RuntimeVersion:  27.3.1

	RuntimeApiVersion:  v1

	I1009 11:51:28.944941    1966 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1009 11:51:28.952326    1966 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I1009 11:51:28.968387    1966 out.go:235] * Preparing Kubernetes v1.31.1 on Docker 27.3.1 ...

	I1009 11:51:28.968544    1966 ssh_runner.go:195] Run: grep 192.168.105.1	host.minikube.internal$ /etc/hosts

	I1009 11:51:28.976257    1966 out.go:177]   - apiserver.enable-admission-plugins=NamespaceAutoProvision

	I1009 11:51:28.979266    1966 kubeadm.go:883] updating cluster {Name:functional-517000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19774/minikube-v1.34.0-1728382514-19774-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v

1.31.1 ClusterName:functional-517000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.4 Port:8441 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s M

ount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I1009 11:51:28.979327    1966 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime docker

	I1009 11:51:28.979394    1966 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I1009 11:51:28.985373    1966 docker.go:685] Got preloaded images: -- stdout --

	minikube-local-cache-test:functional-517000

	registry.k8s.io/kube-apiserver:v1.31.1

	registry.k8s.io/kube-controller-manager:v1.31.1

	registry.k8s.io/kube-scheduler:v1.31.1

	registry.k8s.io/kube-proxy:v1.31.1

	registry.k8s.io/coredns/coredns:v1.11.3

	registry.k8s.io/etcd:3.5.15-0

	registry.k8s.io/pause:3.10

	gcr.io/k8s-minikube/storage-provisioner:v5

	registry.k8s.io/pause:3.3

	registry.k8s.io/pause:3.1

	registry.k8s.io/pause:latest

	-- /stdout --

	I1009 11:51:28.985377    1966 docker.go:615] Images already preloaded, skipping extraction

	I1009 11:51:28.985432    1966 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I1009 11:51:28.994675    1966 docker.go:685] Got preloaded images: -- stdout --

	minikube-local-cache-test:functional-517000

	registry.k8s.io/kube-apiserver:v1.31.1

	registry.k8s.io/kube-scheduler:v1.31.1

	registry.k8s.io/kube-controller-manager:v1.31.1

	registry.k8s.io/kube-proxy:v1.31.1

	registry.k8s.io/coredns/coredns:v1.11.3

	registry.k8s.io/etcd:3.5.15-0

	registry.k8s.io/pause:3.10

	gcr.io/k8s-minikube/storage-provisioner:v5

	registry.k8s.io/pause:3.3

	registry.k8s.io/pause:3.1

	registry.k8s.io/pause:latest

	-- /stdout --

	I1009 11:51:28.994680    1966 cache_images.go:84] Images are preloaded, skipping loading

	I1009 11:51:28.994690    1966 kubeadm.go:934] updating node { 192.168.105.4 8441 v1.31.1 docker true true} ...

	I1009 11:51:28.994787    1966 kubeadm.go:946] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.31.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=functional-517000 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.105.4

	[Install]

	 config:

	{KubernetesVersion:v1.31.1 ClusterName:functional-517000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I1009 11:51:28.994853    1966 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I1009 11:51:29.010306    1966 extraconfig.go:124] Overwriting default enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota with user provided enable-admission-plugins=NamespaceAutoProvision for component apiserver

	I1009 11:51:29.010321    1966 cni.go:84] Creating CNI manager for ""

	I1009 11:51:29.010327    1966 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I1009 11:51:29.010331    1966 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16

	I1009 11:51:29.010340    1966 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.105.4 APIServerPort:8441 KubernetesVersion:v1.31.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:functional-517000 NodeName:functional-517000 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceAutoProvision] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.105.4"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.105.4 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOp

ts:map[containerRuntimeEndpoint:unix:///var/run/cri-dockerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I1009 11:51:29.010406    1966 kubeadm.go:187] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.105.4

	  bindPort: 8441

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/cri-dockerd.sock

	  name: "functional-517000"

	  kubeletExtraArgs:

	    node-ip: 192.168.105.4

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.105.4"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceAutoProvision"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8441

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.31.1

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/cri-dockerd.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%"

	  nodefs.inodesFree: "0%"

	  imagefs.available: "0%"

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I1009 11:51:29.010477    1966 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.1

	I1009 11:51:29.014475    1966 binaries.go:44] Found k8s binaries, skipping transfer

	I1009 11:51:29.014507    1966 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I1009 11:51:29.018207    1966 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (317 bytes)

	I1009 11:51:29.024335    1966 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I1009 11:51:29.030286    1966 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2012 bytes)

	I1009 11:51:29.036515    1966 ssh_runner.go:195] Run: grep 192.168.105.4	control-plane.minikube.internal$ /etc/hosts

	I1009 11:51:29.038075    1966 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1009 11:51:29.128149    1966 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I1009 11:51:29.134435    1966 certs.go:68] Setting up /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/functional-517000 for IP: 192.168.105.4

	I1009 11:51:29.134439    1966 certs.go:194] generating shared ca certs ...

	I1009 11:51:29.134447    1966 certs.go:226] acquiring lock for ca certs: {Name:mkbf858b3b2074a12d126c3a2fed20f98f420e90 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1009 11:51:29.134621    1966 certs.go:235] skipping valid "minikubeCA" ca cert: /Users/jenkins/minikube-integration/19780-1164/.minikube/ca.key

	I1009 11:51:29.134689    1966 certs.go:235] skipping valid "proxyClientCA" ca cert: /Users/jenkins/minikube-integration/19780-1164/.minikube/proxy-client-ca.key

	I1009 11:51:29.134694    1966 certs.go:256] generating profile certs ...

	I1009 11:51:29.134757    1966 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/functional-517000/client.key

	I1009 11:51:29.134818    1966 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/functional-517000/apiserver.key.ade58ebf

	I1009 11:51:29.134877    1966 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/functional-517000/proxy-client.key

	I1009 11:51:29.135047    1966 certs.go:484] found cert: /Users/jenkins/minikube-integration/19780-1164/.minikube/certs/1686.pem (1338 bytes)

	W1009 11:51:29.135079    1966 certs.go:480] ignoring /Users/jenkins/minikube-integration/19780-1164/.minikube/certs/1686_empty.pem, impossibly tiny 0 bytes

	I1009 11:51:29.135083    1966 certs.go:484] found cert: /Users/jenkins/minikube-integration/19780-1164/.minikube/certs/ca-key.pem (1675 bytes)

	I1009 11:51:29.135100    1966 certs.go:484] found cert: /Users/jenkins/minikube-integration/19780-1164/.minikube/certs/ca.pem (1078 bytes)

	I1009 11:51:29.135122    1966 certs.go:484] found cert: /Users/jenkins/minikube-integration/19780-1164/.minikube/certs/cert.pem (1123 bytes)

	I1009 11:51:29.135141    1966 certs.go:484] found cert: /Users/jenkins/minikube-integration/19780-1164/.minikube/certs/key.pem (1679 bytes)

	I1009 11:51:29.135179    1966 certs.go:484] found cert: /Users/jenkins/minikube-integration/19780-1164/.minikube/files/etc/ssl/certs/16862.pem (1708 bytes)

	I1009 11:51:29.135507    1966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19780-1164/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I1009 11:51:29.144146    1966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19780-1164/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I1009 11:51:29.152532    1966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19780-1164/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I1009 11:51:29.161223    1966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19780-1164/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I1009 11:51:29.169617    1966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/functional-517000/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)

	I1009 11:51:29.178368    1966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/functional-517000/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I1009 11:51:29.186360    1966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/functional-517000/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I1009 11:51:29.194899    1966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/functional-517000/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I1009 11:51:29.202877    1966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19780-1164/.minikube/files/etc/ssl/certs/16862.pem --> /usr/share/ca-certificates/16862.pem (1708 bytes)

	I1009 11:51:29.210992    1966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19780-1164/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I1009 11:51:29.219281    1966 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19780-1164/.minikube/certs/1686.pem --> /usr/share/ca-certificates/1686.pem (1338 bytes)

	I1009 11:51:29.227324    1966 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I1009 11:51:29.233334    1966 ssh_runner.go:195] Run: openssl version

	I1009 11:51:29.235381    1966 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I1009 11:51:29.239160    1966 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I1009 11:51:29.240976    1966 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Oct  9 18:48 /usr/share/ca-certificates/minikubeCA.pem

	I1009 11:51:29.241009    1966 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I1009 11:51:29.243048    1966 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I1009 11:51:29.246650    1966 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1686.pem && ln -fs /usr/share/ca-certificates/1686.pem /etc/ssl/certs/1686.pem"

	I1009 11:51:29.250925    1966 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1686.pem

	I1009 11:51:29.252496    1966 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Oct  9 18:49 /usr/share/ca-certificates/1686.pem

	I1009 11:51:29.252523    1966 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1686.pem

	I1009 11:51:29.254537    1966 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1686.pem /etc/ssl/certs/51391683.0"

	I1009 11:51:29.258377    1966 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/16862.pem && ln -fs /usr/share/ca-certificates/16862.pem /etc/ssl/certs/16862.pem"

	I1009 11:51:29.262073    1966 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/16862.pem

	I1009 11:51:29.263809    1966 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Oct  9 18:49 /usr/share/ca-certificates/16862.pem

	I1009 11:51:29.263832    1966 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/16862.pem

	I1009 11:51:29.265899    1966 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/16862.pem /etc/ssl/certs/3ec20f2e.0"

	I1009 11:51:29.269710    1966 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I1009 11:51:29.271379    1966 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400

	I1009 11:51:29.273448    1966 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400

	I1009 11:51:29.275585    1966 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400

	I1009 11:51:29.277566    1966 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400

	I1009 11:51:29.279869    1966 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400

	I1009 11:51:29.281851    1966 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400

	I1009 11:51:29.283901    1966 kubeadm.go:392] StartCluster: {Name:functional-517000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19774/minikube-v1.34.0-1728382514-19774-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.3

1.1 ClusterName:functional-517000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.4 Port:8441 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Moun

t:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1009 11:51:29.283984    1966 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I1009 11:51:29.296030    1966 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I1009 11:51:29.299596    1966 kubeadm.go:408] found existing configuration files, will attempt cluster restart

	I1009 11:51:29.299600    1966 kubeadm.go:593] restartPrimaryControlPlane start ...

	I1009 11:51:29.299631    1966 ssh_runner.go:195] Run: sudo test -d /data/minikube

	I1009 11:51:29.302821    1966 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1

	stdout:

	stderr:

	I1009 11:51:29.303094    1966 kubeconfig.go:125] found "functional-517000" server: "https://192.168.105.4:8441"

	I1009 11:51:29.303769    1966 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new

	I1009 11:51:29.306942    1966 kubeadm.go:640] detected kubeadm config drift (will reconfigure cluster from new /var/tmp/minikube/kubeadm.yaml):

	-- stdout --

	--- /var/tmp/minikube/kubeadm.yaml

	+++ /var/tmp/minikube/kubeadm.yaml.new

	@@ -22,7 +22,7 @@

	 apiServer:

	   certSANs: ["127.0.0.1", "localhost", "192.168.105.4"]

	   extraArgs:

	-    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	+    enable-admission-plugins: "NamespaceAutoProvision"

	 controllerManager:

	   extraArgs:

	     allocate-node-cidrs: "true"

	-- /stdout --

	I1009 11:51:29.306946    1966 kubeadm.go:1160] stopping kube-system containers ...

	I1009 11:51:29.306989    1966 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I1009 11:51:29.314187    1966 docker.go:483] Stopping containers: [dcaae86796df dbe381aa7d6b a190ed3834e8 5afa893214c4 01e7426defe4 ba6efbc178a8 b08e92efa185 b07d41e12b9c 038318400a7c 41dcefdb4ed2 4f41513d2449 b1e05be534ee 4000ae9084ab 86844d172193 8153b9c9da23 d026f504b83b 46c5ef79dcbb de2c75f7785f 3a9ac5a6df53 d8aa327d0528 115ea7f8e9a9 f76bbe1eae4f 752b13160370 13831e0bb808 0ff22bd87cc5 427ddead555b e53bf767705c ac2677f72458]

	I1009 11:51:29.314264    1966 ssh_runner.go:195] Run: docker stop dcaae86796df dbe381aa7d6b a190ed3834e8 5afa893214c4 01e7426defe4 ba6efbc178a8 b08e92efa185 b07d41e12b9c 038318400a7c 41dcefdb4ed2 4f41513d2449 b1e05be534ee 4000ae9084ab 86844d172193 8153b9c9da23 d026f504b83b 46c5ef79dcbb de2c75f7785f 3a9ac5a6df53 d8aa327d0528 115ea7f8e9a9 f76bbe1eae4f 752b13160370 13831e0bb808 0ff22bd87cc5 427ddead555b e53bf767705c ac2677f72458

	I1009 11:51:29.321816    1966 ssh_runner.go:195] Run: sudo systemctl stop kubelet

	I1009 11:51:29.436545    1966 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I1009 11:51:29.442916    1966 kubeadm.go:157] found existing configuration files:

	-rw------- 1 root root 5647 Oct  9 18:49 /etc/kubernetes/admin.conf

	-rw------- 1 root root 5653 Oct  9 18:50 /etc/kubernetes/controller-manager.conf

	-rw------- 1 root root 2007 Oct  9 18:49 /etc/kubernetes/kubelet.conf

	-rw------- 1 root root 5605 Oct  9 18:50 /etc/kubernetes/scheduler.conf

	I1009 11:51:29.442977    1966 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/admin.conf

	I1009 11:51:29.448284    1966 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/kubelet.conf

	I1009 11:51:29.452873    1966 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/controller-manager.conf

	I1009 11:51:29.457523    1966 kubeadm.go:163] "https://control-plane.minikube.internal:8441" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/controller-manager.conf: Process exited with status 1

	stdout:

	stderr:

	I1009 11:51:29.457553    1966 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I1009 11:51:29.462006    1966 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/scheduler.conf

	I1009 11:51:29.466038    1966 kubeadm.go:163] "https://control-plane.minikube.internal:8441" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/scheduler.conf: Process exited with status 1

	stdout:

	stderr:

	I1009 11:51:29.466067    1966 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I1009 11:51:29.469937    1966 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I1009 11:51:29.474024    1966 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.1:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"

	I1009 11:51:29.491533    1966 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.1:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"

	I1009 11:51:30.116468    1966 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.1:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"

	I1009 11:51:30.240639    1966 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.1:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"

	I1009 11:51:30.259781    1966 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.1:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"

	I1009 11:51:30.286604    1966 api_server.go:52] waiting for apiserver process to appear ...

	I1009 11:51:30.286678    1966 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1009 11:51:30.788783    1966 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1009 11:51:31.288781    1966 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1009 11:51:31.294261    1966 api_server.go:72] duration metric: took 1.007666292s to wait for apiserver process to appear ...

	I1009 11:51:31.294271    1966 api_server.go:88] waiting for apiserver healthz status ...

	I1009 11:51:31.294282    1966 api_server.go:253] Checking apiserver healthz at https://192.168.105.4:8441/healthz ...

	I1009 11:51:32.716538    1966 api_server.go:279] https://192.168.105.4:8441/healthz returned 403:

	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}

	W1009 11:51:32.716547    1966 api_server.go:103] status: https://192.168.105.4:8441/healthz returned error 403:

	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}

	I1009 11:51:32.716553    1966 api_server.go:253] Checking apiserver healthz at https://192.168.105.4:8441/healthz ...

	I1009 11:51:32.756299    1966 api_server.go:279] https://192.168.105.4:8441/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/storage-object-count-tracker-hook ok

	[+]poststarthook/start-apiextensions-informers ok

	[-]poststarthook/start-apiextensions-controllers failed: reason withheld

	[-]poststarthook/crd-informer-synced failed: reason withheld

	[+]poststarthook/start-system-namespaces-controller ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-legacy-token-tracking-controller ok

	[+]poststarthook/start-service-ip-repair-controllers ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[-]poststarthook/priority-and-fairness-config-producer failed: reason withheld

	[-]poststarthook/bootstrap-controller failed: reason withheld

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-status-local-available-controller ok

	[+]poststarthook/apiservice-status-remote-available-controller ok

	[-]poststarthook/apiservice-registration-controller failed: reason withheld

	[-]poststarthook/apiservice-discovery-controller failed: reason withheld

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	[+]poststarthook/apiservice-openapiv3-controller ok

	healthz check failed

	W1009 11:51:32.756310    1966 api_server.go:103] status: https://192.168.105.4:8441/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/storage-object-count-tracker-hook ok

	[+]poststarthook/start-apiextensions-informers ok

	[-]poststarthook/start-apiextensions-controllers failed: reason withheld

	[-]poststarthook/crd-informer-synced failed: reason withheld

	[+]poststarthook/start-system-namespaces-controller ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-legacy-token-tracking-controller ok

	[+]poststarthook/start-service-ip-repair-controllers ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[-]poststarthook/priority-and-fairness-config-producer failed: reason withheld

	[-]poststarthook/bootstrap-controller failed: reason withheld

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-status-local-available-controller ok

	[+]poststarthook/apiservice-status-remote-available-controller ok

	[-]poststarthook/apiservice-registration-controller failed: reason withheld

	[-]poststarthook/apiservice-discovery-controller failed: reason withheld

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	[+]poststarthook/apiservice-openapiv3-controller ok

	healthz check failed

	I1009 11:51:32.796316    1966 api_server.go:253] Checking apiserver healthz at https://192.168.105.4:8441/healthz ...

	I1009 11:51:32.799324    1966 api_server.go:279] https://192.168.105.4:8441/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/storage-object-count-tracker-hook ok

	[+]poststarthook/start-apiextensions-informers ok

	[-]poststarthook/start-apiextensions-controllers failed: reason withheld

	[-]poststarthook/crd-informer-synced failed: reason withheld

	[+]poststarthook/start-system-namespaces-controller ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-legacy-token-tracking-controller ok

	[+]poststarthook/start-service-ip-repair-controllers ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[-]poststarthook/priority-and-fairness-config-producer failed: reason withheld

	[-]poststarthook/bootstrap-controller failed: reason withheld

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-status-local-available-controller ok

	[+]poststarthook/apiservice-status-remote-available-controller ok

	[-]poststarthook/apiservice-registration-controller failed: reason withheld

	[-]poststarthook/apiservice-discovery-controller failed: reason withheld

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	[+]poststarthook/apiservice-openapiv3-controller ok

	healthz check failed

	W1009 11:51:32.799329    1966 api_server.go:103] status: https://192.168.105.4:8441/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/storage-object-count-tracker-hook ok

	[+]poststarthook/start-apiextensions-informers ok

	[-]poststarthook/start-apiextensions-controllers failed: reason withheld

	[-]poststarthook/crd-informer-synced failed: reason withheld

	[+]poststarthook/start-system-namespaces-controller ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-legacy-token-tracking-controller ok

	[+]poststarthook/start-service-ip-repair-controllers ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[-]poststarthook/priority-and-fairness-config-producer failed: reason withheld

	[-]poststarthook/bootstrap-controller failed: reason withheld

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-status-local-available-controller ok

	[+]poststarthook/apiservice-status-remote-available-controller ok

	[-]poststarthook/apiservice-registration-controller failed: reason withheld

	[-]poststarthook/apiservice-discovery-controller failed: reason withheld

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	[+]poststarthook/apiservice-openapiv3-controller ok

	healthz check failed

	I1009 11:51:33.296452    1966 api_server.go:253] Checking apiserver healthz at https://192.168.105.4:8441/healthz ...

	I1009 11:51:33.306744    1966 api_server.go:279] https://192.168.105.4:8441/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/storage-object-count-tracker-hook ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/start-system-namespaces-controller ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-legacy-token-tracking-controller ok

	[+]poststarthook/start-service-ip-repair-controllers ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/bootstrap-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-status-local-available-controller ok

	[+]poststarthook/apiservice-status-remote-available-controller ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-discovery-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	[+]poststarthook/apiservice-openapiv3-controller ok

	healthz check failed

	W1009 11:51:33.306763    1966 api_server.go:103] status: https://192.168.105.4:8441/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/storage-object-count-tracker-hook ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/start-system-namespaces-controller ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-legacy-token-tracking-controller ok

	[+]poststarthook/start-service-ip-repair-controllers ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/bootstrap-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-status-local-available-controller ok

	[+]poststarthook/apiservice-status-remote-available-controller ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-discovery-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	[+]poststarthook/apiservice-openapiv3-controller ok

	healthz check failed

	I1009 11:51:33.796325    1966 api_server.go:253] Checking apiserver healthz at https://192.168.105.4:8441/healthz ...

	I1009 11:51:33.800735    1966 api_server.go:279] https://192.168.105.4:8441/healthz returned 200:

	ok

	I1009 11:51:33.805293    1966 api_server.go:141] control plane version: v1.31.1

	I1009 11:51:33.805302    1966 api_server.go:131] duration metric: took 2.511051125s to wait for apiserver health ...

	I1009 11:51:33.805307    1966 cni.go:84] Creating CNI manager for ""

	I1009 11:51:33.805312    1966 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I1009 11:51:33.809437    1966 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...

	I1009 11:51:33.815562    1966 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d

	I1009 11:51:33.820020    1966 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (496 bytes)

	I1009 11:51:33.832372    1966 system_pods.go:43] waiting for kube-system pods to appear ...

	I1009 11:51:33.838394    1966 system_pods.go:59] 7 kube-system pods found

	I1009 11:51:33.838406    1966 system_pods.go:61] "coredns-7c65d6cfc9-6j6vh" [05c8a09a-ae06-4452-bf84-f712285c7254] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])

	I1009 11:51:33.838409    1966 system_pods.go:61] "etcd-functional-517000" [7dea046a-e827-439b-afc3-98887e760090] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])

	I1009 11:51:33.838411    1966 system_pods.go:61] "kube-apiserver-functional-517000" [c9bbc2f3-16d2-4403-b764-c5b995c5b19a] Pending

	I1009 11:51:33.838414    1966 system_pods.go:61] "kube-controller-manager-functional-517000" [4630e5ce-eda8-4368-bfec-8099aadbded6] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])

	I1009 11:51:33.838416    1966 system_pods.go:61] "kube-proxy-62vrr" [6f50aac0-4d19-49cb-b19b-714f93ff18c4] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])

	I1009 11:51:33.838418    1966 system_pods.go:61] "kube-scheduler-functional-517000" [68fc1c48-f211-4c6e-b36e-48964349e8fd] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])

	I1009 11:51:33.838419    1966 system_pods.go:61] "storage-provisioner" [ac845b3d-9cbd-47f6-b00b-1a147a94e1fc] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])

	I1009 11:51:33.838422    1966 system_pods.go:74] duration metric: took 6.044583ms to wait for pod list to return data ...

	I1009 11:51:33.838425    1966 node_conditions.go:102] verifying NodePressure condition ...

	I1009 11:51:33.841799    1966 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I1009 11:51:33.841807    1966 node_conditions.go:123] node cpu capacity is 2

	I1009 11:51:33.841812    1966 node_conditions.go:105] duration metric: took 3.384666ms to run NodePressure ...

	I1009 11:51:33.841820    1966 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.1:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"

	I1009 11:51:34.075744    1966 kubeadm.go:724] waiting for restarted kubelet to initialise ...

	I1009 11:51:34.078199    1966 kubeadm.go:739] kubelet initialised

	I1009 11:51:34.078203    1966 kubeadm.go:740] duration metric: took 2.451667ms waiting for restarted kubelet to initialise ...

	I1009 11:51:34.078207    1966 pod_ready.go:36] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1009 11:51:34.080790    1966 pod_ready.go:79] waiting up to 4m0s for pod "coredns-7c65d6cfc9-6j6vh" in "kube-system" namespace to be "Ready" ...

	I1009 11:51:36.085672    1966 pod_ready.go:103] pod "coredns-7c65d6cfc9-6j6vh" in "kube-system" namespace has status "Ready":"False"

	I1009 11:51:38.095719    1966 pod_ready.go:103] pod "coredns-7c65d6cfc9-6j6vh" in "kube-system" namespace has status "Ready":"False"

	I1009 11:51:40.594406    1966 pod_ready.go:103] pod "coredns-7c65d6cfc9-6j6vh" in "kube-system" namespace has status "Ready":"False"

	I1009 11:51:42.595656    1966 pod_ready.go:103] pod "coredns-7c65d6cfc9-6j6vh" in "kube-system" namespace has status "Ready":"False"

	I1009 11:51:43.094519    1966 pod_ready.go:93] pod "coredns-7c65d6cfc9-6j6vh" in "kube-system" namespace has status "Ready":"True"

	I1009 11:51:43.094540    1966 pod_ready.go:82] duration metric: took 9.013831292s for pod "coredns-7c65d6cfc9-6j6vh" in "kube-system" namespace to be "Ready" ...

	I1009 11:51:43.094557    1966 pod_ready.go:79] waiting up to 4m0s for pod "etcd-functional-517000" in "kube-system" namespace to be "Ready" ...

	I1009 11:51:45.104822    1966 pod_ready.go:93] pod "etcd-functional-517000" in "kube-system" namespace has status "Ready":"True"

	I1009 11:51:45.104839    1966 pod_ready.go:82] duration metric: took 2.010294625s for pod "etcd-functional-517000" in "kube-system" namespace to be "Ready" ...

	I1009 11:51:45.104849    1966 pod_ready.go:79] waiting up to 4m0s for pod "kube-apiserver-functional-517000" in "kube-system" namespace to be "Ready" ...

	I1009 11:51:45.111388    1966 pod_ready.go:93] pod "kube-apiserver-functional-517000" in "kube-system" namespace has status "Ready":"True"

	I1009 11:51:45.111396    1966 pod_ready.go:82] duration metric: took 6.54025ms for pod "kube-apiserver-functional-517000" in "kube-system" namespace to be "Ready" ...

	I1009 11:51:45.111405    1966 pod_ready.go:79] waiting up to 4m0s for pod "kube-controller-manager-functional-517000" in "kube-system" namespace to be "Ready" ...

	I1009 11:51:45.116594    1966 pod_ready.go:93] pod "kube-controller-manager-functional-517000" in "kube-system" namespace has status "Ready":"True"

	I1009 11:51:45.116601    1966 pod_ready.go:82] duration metric: took 5.190458ms for pod "kube-controller-manager-functional-517000" in "kube-system" namespace to be "Ready" ...

	I1009 11:51:45.116608    1966 pod_ready.go:79] waiting up to 4m0s for pod "kube-proxy-62vrr" in "kube-system" namespace to be "Ready" ...

	I1009 11:51:45.122194    1966 pod_ready.go:93] pod "kube-proxy-62vrr" in "kube-system" namespace has status "Ready":"True"

	I1009 11:51:45.122200    1966 pod_ready.go:82] duration metric: took 5.588042ms for pod "kube-proxy-62vrr" in "kube-system" namespace to be "Ready" ...

	I1009 11:51:45.122206    1966 pod_ready.go:79] waiting up to 4m0s for pod "kube-scheduler-functional-517000" in "kube-system" namespace to be "Ready" ...

	I1009 11:51:45.637554    1966 pod_ready.go:93] pod "kube-scheduler-functional-517000" in "kube-system" namespace has status "Ready":"True"

	I1009 11:51:45.637580    1966 pod_ready.go:82] duration metric: took 515.368792ms for pod "kube-scheduler-functional-517000" in "kube-system" namespace to be "Ready" ...

	I1009 11:51:45.637604    1966 pod_ready.go:39] duration metric: took 11.559504833s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1009 11:51:45.637648    1966 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I1009 11:51:45.652239    1966 ops.go:34] apiserver oom_adj: -16

	I1009 11:51:45.652252    1966 kubeadm.go:597] duration metric: took 16.352804417s to restartPrimaryControlPlane

	I1009 11:51:45.652261    1966 kubeadm.go:394] duration metric: took 16.3685205s to StartCluster

	I1009 11:51:45.652291    1966 settings.go:142] acquiring lock: {Name:mk60ce4ac2055fafaa579c122d2ddfc9feae1fb6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1009 11:51:45.652574    1966 settings.go:150] Updating kubeconfig:  /Users/jenkins/minikube-integration/19780-1164/kubeconfig

	I1009 11:51:45.653621    1966 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19780-1164/kubeconfig: {Name:mk4c1705278acf5bca231aaf8d903f2912375394 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1009 11:51:45.654308    1966 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.105.4 Port:8441 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1009 11:51:45.654352    1966 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]

	I1009 11:51:45.654476    1966 addons.go:69] Setting storage-provisioner=true in profile "functional-517000"

	I1009 11:51:45.654523    1966 addons.go:234] Setting addon storage-provisioner=true in "functional-517000"

	W1009 11:51:45.654531    1966 addons.go:243] addon storage-provisioner should already be in state true

	I1009 11:51:45.654514    1966 addons.go:69] Setting default-storageclass=true in profile "functional-517000"

	I1009 11:51:45.654547    1966 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "functional-517000"

	I1009 11:51:45.654558    1966 host.go:66] Checking if "functional-517000" exists ...

	I1009 11:51:45.654597    1966 config.go:182] Loaded profile config "functional-517000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I1009 11:51:45.657202    1966 addons.go:234] Setting addon default-storageclass=true in "functional-517000"

	W1009 11:51:45.657211    1966 addons.go:243] addon default-storageclass should already be in state true

	I1009 11:51:45.657230    1966 host.go:66] Checking if "functional-517000" exists ...

	I1009 11:51:45.658312    1966 out.go:177] * Verifying Kubernetes components...

	I1009 11:51:45.663165    1966 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml

	I1009 11:51:45.663175    1966 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I1009 11:51:45.663187    1966 sshutil.go:53] new ssh client: &{IP:192.168.105.4 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19780-1164/.minikube/machines/functional-517000/id_rsa Username:docker}

	I1009 11:51:45.665276    1966 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I1009 11:51:45.665383    1966 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1009 11:51:45.669359    1966 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I1009 11:51:45.669367    1966 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I1009 11:51:45.669377    1966 sshutil.go:53] new ssh client: &{IP:192.168.105.4 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19780-1164/.minikube/machines/functional-517000/id_rsa Username:docker}

	I1009 11:51:45.793335    1966 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I1009 11:51:45.799183    1966 node_ready.go:35] waiting up to 6m0s for node "functional-517000" to be "Ready" ...

	I1009 11:51:45.800633    1966 node_ready.go:49] node "functional-517000" has status "Ready":"True"

	I1009 11:51:45.800641    1966 node_ready.go:38] duration metric: took 1.44675ms for node "functional-517000" to be "Ready" ...

	I1009 11:51:45.800643    1966 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1009 11:51:45.866335    1966 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I1009 11:51:45.877907    1966 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I1009 11:51:45.901562    1966 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-6j6vh" in "kube-system" namespace to be "Ready" ...

	I1009 11:51:46.166197    1966 out.go:177] * Enabled addons: default-storageclass, storage-provisioner

	I1009 11:51:46.170148    1966 addons.go:510] duration metric: took 515.832167ms for enable addons: enabled=[default-storageclass storage-provisioner]

	I1009 11:51:46.300320    1966 pod_ready.go:93] pod "coredns-7c65d6cfc9-6j6vh" in "kube-system" namespace has status "Ready":"True"

	I1009 11:51:46.300325    1966 pod_ready.go:82] duration metric: took 398.759833ms for pod "coredns-7c65d6cfc9-6j6vh" in "kube-system" namespace to be "Ready" ...

	I1009 11:51:46.300329    1966 pod_ready.go:79] waiting up to 6m0s for pod "etcd-functional-517000" in "kube-system" namespace to be "Ready" ...

	I1009 11:51:46.707055    1966 pod_ready.go:93] pod "etcd-functional-517000" in "kube-system" namespace has status "Ready":"True"

	I1009 11:51:46.707083    1966 pod_ready.go:82] duration metric: took 406.745291ms for pod "etcd-functional-517000" in "kube-system" namespace to be "Ready" ...

	I1009 11:51:46.707105    1966 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-functional-517000" in "kube-system" namespace to be "Ready" ...

	I1009 11:51:47.105666    1966 pod_ready.go:93] pod "kube-apiserver-functional-517000" in "kube-system" namespace has status "Ready":"True"

	I1009 11:51:47.105695    1966 pod_ready.go:82] duration metric: took 398.574834ms for pod "kube-apiserver-functional-517000" in "kube-system" namespace to be "Ready" ...

	I1009 11:51:47.105714    1966 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-functional-517000" in "kube-system" namespace to be "Ready" ...

	I1009 11:51:47.506886    1966 pod_ready.go:93] pod "kube-controller-manager-functional-517000" in "kube-system" namespace has status "Ready":"True"

	I1009 11:51:47.506918    1966 pod_ready.go:82] duration metric: took 401.192791ms for pod "kube-controller-manager-functional-517000" in "kube-system" namespace to be "Ready" ...

	I1009 11:51:47.506949    1966 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-62vrr" in "kube-system" namespace to be "Ready" ...

	I1009 11:51:47.906144    1966 pod_ready.go:93] pod "kube-proxy-62vrr" in "kube-system" namespace has status "Ready":"True"

	I1009 11:51:47.906171    1966 pod_ready.go:82] duration metric: took 399.209875ms for pod "kube-proxy-62vrr" in "kube-system" namespace to be "Ready" ...

	I1009 11:51:47.906199    1966 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-functional-517000" in "kube-system" namespace to be "Ready" ...

	I1009 11:51:48.302137    1966 pod_ready.go:93] pod "kube-scheduler-functional-517000" in "kube-system" namespace has status "Ready":"True"

	I1009 11:51:48.302151    1966 pod_ready.go:82] duration metric: took 395.946583ms for pod "kube-scheduler-functional-517000" in "kube-system" namespace to be "Ready" ...

	I1009 11:51:48.302165    1966 pod_ready.go:39] duration metric: took 2.5015425s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1009 11:51:48.302190    1966 api_server.go:52] waiting for apiserver process to appear ...

	I1009 11:51:48.302406    1966 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1009 11:51:48.318404    1966 api_server.go:72] duration metric: took 2.664100291s to wait for apiserver process to appear ...

	I1009 11:51:48.318419    1966 api_server.go:88] waiting for apiserver healthz status ...

	I1009 11:51:48.318435    1966 api_server.go:253] Checking apiserver healthz at https://192.168.105.4:8441/healthz ...

	I1009 11:51:48.324853    1966 api_server.go:279] https://192.168.105.4:8441/healthz returned 200:

	ok

	I1009 11:51:48.325611    1966 api_server.go:141] control plane version: v1.31.1

	I1009 11:51:48.325617    1966 api_server.go:131] duration metric: took 7.194667ms to wait for apiserver health ...

	I1009 11:51:48.325622    1966 system_pods.go:43] waiting for kube-system pods to appear ...

	I1009 11:51:48.514974    1966 system_pods.go:59] 7 kube-system pods found

	I1009 11:51:48.515012    1966 system_pods.go:61] "coredns-7c65d6cfc9-6j6vh" [05c8a09a-ae06-4452-bf84-f712285c7254] Running

	I1009 11:51:48.515023    1966 system_pods.go:61] "etcd-functional-517000" [7dea046a-e827-439b-afc3-98887e760090] Running

	I1009 11:51:48.515030    1966 system_pods.go:61] "kube-apiserver-functional-517000" [c9bbc2f3-16d2-4403-b764-c5b995c5b19a] Running

	I1009 11:51:48.515035    1966 system_pods.go:61] "kube-controller-manager-functional-517000" [4630e5ce-eda8-4368-bfec-8099aadbded6] Running

	I1009 11:51:48.515039    1966 system_pods.go:61] "kube-proxy-62vrr" [6f50aac0-4d19-49cb-b19b-714f93ff18c4] Running

	I1009 11:51:48.515046    1966 system_pods.go:61] "kube-scheduler-functional-517000" [68fc1c48-f211-4c6e-b36e-48964349e8fd] Running

	I1009 11:51:48.515051    1966 system_pods.go:61] "storage-provisioner" [ac845b3d-9cbd-47f6-b00b-1a147a94e1fc] Running

	I1009 11:51:48.515061    1966 system_pods.go:74] duration metric: took 189.435959ms to wait for pod list to return data ...

	I1009 11:51:48.515074    1966 default_sa.go:34] waiting for default service account to be created ...

	I1009 11:51:48.705512    1966 default_sa.go:45] found service account: "default"

	I1009 11:51:48.705544    1966 default_sa.go:55] duration metric: took 190.458333ms for default service account to be created ...

	I1009 11:51:48.705566    1966 system_pods.go:116] waiting for k8s-apps to be running ...

	I1009 11:51:48.910298    1966 system_pods.go:86] 7 kube-system pods found

	I1009 11:51:48.910325    1966 system_pods.go:89] "coredns-7c65d6cfc9-6j6vh" [05c8a09a-ae06-4452-bf84-f712285c7254] Running

	I1009 11:51:48.910334    1966 system_pods.go:89] "etcd-functional-517000" [7dea046a-e827-439b-afc3-98887e760090] Running

	I1009 11:51:48.910341    1966 system_pods.go:89] "kube-apiserver-functional-517000" [c9bbc2f3-16d2-4403-b764-c5b995c5b19a] Running

	I1009 11:51:48.910346    1966 system_pods.go:89] "kube-controller-manager-functional-517000" [4630e5ce-eda8-4368-bfec-8099aadbded6] Running

	I1009 11:51:48.910352    1966 system_pods.go:89] "kube-proxy-62vrr" [6f50aac0-4d19-49cb-b19b-714f93ff18c4] Running

	I1009 11:51:48.910356    1966 system_pods.go:89] "kube-scheduler-functional-517000" [68fc1c48-f211-4c6e-b36e-48964349e8fd] Running

	I1009 11:51:48.910361    1966 system_pods.go:89] "storage-provisioner" [ac845b3d-9cbd-47f6-b00b-1a147a94e1fc] Running

	I1009 11:51:48.910372    1966 system_pods.go:126] duration metric: took 204.802292ms to wait for k8s-apps to be running ...

	I1009 11:51:48.910382    1966 system_svc.go:44] waiting for kubelet service to be running ....

	I1009 11:51:48.910620    1966 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1009 11:51:48.930616    1966 system_svc.go:56] duration metric: took 20.213167ms WaitForService to wait for kubelet

	I1009 11:51:48.930633    1966 kubeadm.go:582] duration metric: took 3.276336416s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I1009 11:51:48.930655    1966 node_conditions.go:102] verifying NodePressure condition ...

	I1009 11:51:49.105530    1966 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I1009 11:51:49.105559    1966 node_conditions.go:123] node cpu capacity is 2

	I1009 11:51:49.105595    1966 node_conditions.go:105] duration metric: took 174.929458ms to run NodePressure ...

	I1009 11:51:49.105626    1966 start.go:241] waiting for startup goroutines ...

	I1009 11:51:49.105644    1966 start.go:246] waiting for cluster config update ...

	I1009 11:51:49.105668    1966 start.go:255] writing updated cluster config ...

	I1009 11:51:49.107113    1966 ssh_runner.go:195] Run: rm -f paused

	I1009 11:51:49.177337    1966 start.go:600] kubectl: 1.30.2, cluster: 1.31.1 (minor skew: 1)

	I1009 11:51:49.181977    1966 out.go:177] * Done! kubectl is now configured to use "functional-517000" cluster and "default" namespace by default

	==> Docker <==

	Oct 09 18:52:26 functional-517000 dockerd[5795]: time="2024-10-09T18:52:26.270495183Z" level=warning msg="cleaning up after shim disconnected" id=568a1997e1e7afeecae3d71325b8d184e43727b45adcb987e40ea39491cb6011 namespace=moby

	Oct 09 18:52:26 functional-517000 dockerd[5795]: time="2024-10-09T18:52:26.270507812Z" level=info msg="cleaning up dead shim" namespace=moby

	Oct 09 18:52:27 functional-517000 dockerd[5795]: time="2024-10-09T18:52:27.885705893Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Oct 09 18:52:27 functional-517000 dockerd[5795]: time="2024-10-09T18:52:27.885803841Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Oct 09 18:52:27 functional-517000 dockerd[5795]: time="2024-10-09T18:52:27.885829683Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Oct 09 18:52:27 functional-517000 dockerd[5795]: time="2024-10-09T18:52:27.885923589Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Oct 09 18:52:27 functional-517000 cri-dockerd[6051]: time="2024-10-09T18:52:27Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/ad9c994675f9584f824764a5c5e5b04a697d8ba6edecc06a5ebfbe543c59b585/resolv.conf as [nameserver 10.96.0.10 search default.svc.cluster.local svc.cluster.local cluster.local options ndots:5]"

	Oct 09 18:52:28 functional-517000 dockerd[5795]: time="2024-10-09T18:52:28.398492728Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Oct 09 18:52:28 functional-517000 dockerd[5795]: time="2024-10-09T18:52:28.398561084Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Oct 09 18:52:28 functional-517000 dockerd[5795]: time="2024-10-09T18:52:28.398578548Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Oct 09 18:52:28 functional-517000 dockerd[5795]: time="2024-10-09T18:52:28.398620269Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Oct 09 18:52:28 functional-517000 dockerd[5789]: time="2024-10-09T18:52:28.419118066Z" level=info msg="ignoring event" container=93962dd42a5009524726a8dd83795622ace99a226632873d250e32615a7f4e10 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Oct 09 18:52:28 functional-517000 dockerd[5795]: time="2024-10-09T18:52:28.419182128Z" level=info msg="shim disconnected" id=93962dd42a5009524726a8dd83795622ace99a226632873d250e32615a7f4e10 namespace=moby

	Oct 09 18:52:28 functional-517000 dockerd[5795]: time="2024-10-09T18:52:28.419209054Z" level=warning msg="cleaning up after shim disconnected" id=93962dd42a5009524726a8dd83795622ace99a226632873d250e32615a7f4e10 namespace=moby

	Oct 09 18:52:28 functional-517000 dockerd[5795]: time="2024-10-09T18:52:28.419213138Z" level=info msg="cleaning up dead shim" namespace=moby

	Oct 09 18:52:28 functional-517000 cri-dockerd[6051]: time="2024-10-09T18:52:28Z" level=info msg="Stop pulling image docker.io/nginx:latest: Status: Image is up to date for nginx:latest"

	Oct 09 18:52:28 functional-517000 dockerd[5795]: time="2024-10-09T18:52:28.710207715Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Oct 09 18:52:28 functional-517000 dockerd[5795]: time="2024-10-09T18:52:28.710412073Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Oct 09 18:52:28 functional-517000 dockerd[5795]: time="2024-10-09T18:52:28.710535946Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Oct 09 18:52:28 functional-517000 dockerd[5795]: time="2024-10-09T18:52:28.710601759Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Oct 09 18:52:37 functional-517000 dockerd[5795]: time="2024-10-09T18:52:37.067417201Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Oct 09 18:52:37 functional-517000 dockerd[5795]: time="2024-10-09T18:52:37.067667907Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Oct 09 18:52:37 functional-517000 dockerd[5795]: time="2024-10-09T18:52:37.067684538Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Oct 09 18:52:37 functional-517000 dockerd[5795]: time="2024-10-09T18:52:37.067784820Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Oct 09 18:52:37 functional-517000 cri-dockerd[6051]: time="2024-10-09T18:52:37Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/df53843b0041186fee68a57f7cb060261bb44c8da8a963b14c6f4f51e153d633/resolv.conf as [nameserver 10.96.0.10 search default.svc.cluster.local svc.cluster.local cluster.local options ndots:5]"

	==> container status <==

	CONTAINER           IMAGE                                                                           CREATED              STATE               NAME                      ATTEMPT             POD ID              POD

	9cdfd063e91bf       nginx@sha256:d2eb56950b84efe34f966a2b92efb1a1a2ea53e7e93b94cdf45a27cf3cd47fc0   9 seconds ago        Running             myfrontend                0                   ad9c994675f95       sp-pod

	93962dd42a500       72565bf5bbedf                                                                   9 seconds ago        Exited              echoserver-arm            2                   9f59a8bed3674       hello-node-connect-65d86f57f4-88jjn

	f3d812a18b35d       72565bf5bbedf                                                                   21 seconds ago       Exited              echoserver-arm            2                   bc6598b480243       hello-node-64b4f8f9ff-5rqvj

	781391d067f01       nginx@sha256:2140dad235c130ac861018a4e13a6bc8aea3a35f3a40e20c1b060d51a7efd250   33 seconds ago       Running             nginx                     0                   7cd22cf79cf6f       nginx-svc

	c27a4b3fe7834       2f6c962e7b831                                                                   About a minute ago   Running             coredns                   2                   7d319cb5ed043       coredns-7c65d6cfc9-6j6vh

	0e3ab9139e53f       ba04bb24b9575                                                                   About a minute ago   Running             storage-provisioner       3                   7565b3b425de7       storage-provisioner

	3afd220050b21       24a140c548c07                                                                   About a minute ago   Running             kube-proxy                2                   19668966b82cf       kube-proxy-62vrr

	8ea1f92e3e2d0       7f8aa378bb47d                                                                   About a minute ago   Running             kube-scheduler            2                   5731d379623f1       kube-scheduler-functional-517000

	53f95f20007e6       279f381cb3736                                                                   About a minute ago   Running             kube-controller-manager   2                   ceefda59fd399       kube-controller-manager-functional-517000

	2dccc5d4420b4       27e3830e14027                                                                   About a minute ago   Running             etcd                      2                   d3363dfabf0db       etcd-functional-517000

	65be091b3bee4       d3f53a98c0a9d                                                                   About a minute ago   Running             kube-apiserver            0                   76939de013ece       kube-apiserver-functional-517000

	dcaae86796dfe       ba04bb24b9575                                                                   About a minute ago   Exited              storage-provisioner       2                   b08e92efa1856       storage-provisioner

	dbe381aa7d6b0       2f6c962e7b831                                                                   2 minutes ago        Exited              coredns                   1                   01e7426defe46       coredns-7c65d6cfc9-6j6vh

	a190ed3834e8e       24a140c548c07                                                                   2 minutes ago        Exited              kube-proxy                1                   ba6efbc178a82       kube-proxy-62vrr

	b07d41e12b9c4       27e3830e14027                                                                   2 minutes ago        Exited              etcd                      1                   b1e05be534eef       etcd-functional-517000

	41dcefdb4ed21       7f8aa378bb47d                                                                   2 minutes ago        Exited              kube-scheduler            1                   8153b9c9da23e       kube-scheduler-functional-517000

	4f41513d24496       279f381cb3736                                                                   2 minutes ago        Exited              kube-controller-manager   1                   86844d1721936       kube-controller-manager-functional-517000

	==> coredns [c27a4b3fe783] <==

	.:53

	[INFO] plugin/reload: Running configuration SHA512 = ea7a0d73d9d208f758b1f67640ef03c58089b9d9366cf3478df3bb369b210e39f213811b46224f8a04380814b6e0890ccd358f5b5e8c80bc22ac19c8601ee35b

	CoreDNS-1.11.3

	linux/arm64, go1.21.11, a6338e9

	[INFO] 127.0.0.1:34446 - 30731 "HINFO IN 2650072419900657538.849304516600701137. udp 56 false 512" NXDOMAIN qr,rd,ra 131 0.059671421s

	[INFO] 10.244.0.1:42681 - 7045 "A IN nginx-svc.default.svc.cluster.local. udp 64 false 4096" NOERROR qr,aa,rd 104 0.00011083s

	[INFO] 10.244.0.1:48083 - 9139 "AAAA IN nginx-svc.default.svc.cluster.local. udp 53 false 512" NOERROR qr,aa,rd 146 0.000161722s

	[INFO] 10.244.0.1:14086 - 36552 "A IN nginx-svc.default.svc.cluster.local. udp 53 false 512" NOERROR qr,aa,rd 104 0.00002555s

	[INFO] 10.244.0.1:13040 - 27304 "SVCB IN _dns.resolver.arpa. udp 36 false 512" NXDOMAIN qr,rd,ra 116 0.001819584s

	[INFO] 10.244.0.1:44204 - 8210 "A IN nginx-svc.default.svc.cluster.local. udp 64 false 1232" NOERROR qr,aa,rd 104 0.000069941s

	[INFO] 10.244.0.1:59866 - 34279 "AAAA IN nginx-svc.default.svc.cluster.local. udp 64 false 1232" NOERROR qr,aa,rd 146 0.000311732s

	==> coredns [dbe381aa7d6b] <==

	[WARNING] plugin/kubernetes: starting server with unsynced Kubernetes API

	.:53

	[INFO] plugin/reload: Running configuration SHA512 = ea7a0d73d9d208f758b1f67640ef03c58089b9d9366cf3478df3bb369b210e39f213811b46224f8a04380814b6e0890ccd358f5b5e8c80bc22ac19c8601ee35b

	CoreDNS-1.11.3

	linux/arm64, go1.21.11, a6338e9

	[INFO] 127.0.0.1:49618 - 2934 "HINFO IN 6437480209382109792.5253849857295745775. udp 57 false 512" NXDOMAIN qr,rd,ra 132 0.012101399s

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.29.3/tools/cache/reflector.go:229: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	[INFO] plugin/kubernetes: Trace[436258579]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.29.3/tools/cache/reflector.go:229 (09-Oct-2024 18:50:29.296) (total time: 30001ms):

	Trace[436258579]: ---"Objects listed" error:Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout 30000ms (18:50:59.297)

	Trace[436258579]: [30.001124306s] [30.001124306s] END

	[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.29.3/tools/cache/reflector.go:229: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.29.3/tools/cache/reflector.go:229: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	[INFO] plugin/kubernetes: Trace[344287071]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.29.3/tools/cache/reflector.go:229 (09-Oct-2024 18:50:29.296) (total time: 30001ms):

	Trace[344287071]: ---"Objects listed" error:Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout 30001ms (18:50:59.297)

	Trace[344287071]: [30.001514781s] [30.001514781s] END

	[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.29.3/tools/cache/reflector.go:229: Failed to watch *v1.Namespace: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.29.3/tools/cache/reflector.go:229: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	[INFO] plugin/kubernetes: Trace[2055850872]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.29.3/tools/cache/reflector.go:229 (09-Oct-2024 18:50:29.297) (total time: 30001ms):

	Trace[2055850872]: ---"Objects listed" error:Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout 30000ms (18:50:59.298)

	Trace[2055850872]: [30.001247337s] [30.001247337s] END

	[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.29.3/tools/cache/reflector.go:229: Failed to watch *v1.EndpointSlice: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	[INFO] SIGTERM: Shutting down servers then terminating

	[INFO] plugin/health: Going into lameduck mode for 5s

	==> describe nodes <==

	Name:               functional-517000

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=arm64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=arm64

	                    kubernetes.io/hostname=functional-517000

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=0f31bfe1a852f6cc79fedfeb2462ff6b6d86b5e4

	                    minikube.k8s.io/name=functional-517000

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2024_10_09T11_49_58_0700

	                    minikube.k8s.io/version=v1.34.0

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Wed, 09 Oct 2024 18:49:55 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  functional-517000

	  AcquireTime:     <unset>

	  RenewTime:       Wed, 09 Oct 2024 18:52:33 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Wed, 09 Oct 2024 18:52:33 +0000   Wed, 09 Oct 2024 18:49:55 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Wed, 09 Oct 2024 18:52:33 +0000   Wed, 09 Oct 2024 18:49:55 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Wed, 09 Oct 2024 18:52:33 +0000   Wed, 09 Oct 2024 18:49:55 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Wed, 09 Oct 2024 18:52:33 +0000   Wed, 09 Oct 2024 18:50:01 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.105.4

	  Hostname:    functional-517000

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3904744Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3904744Ki

	  pods:               110

	System Info:

	  Machine ID:                 ecefc873954f49feb75cbc20966cff64

	  System UUID:                ecefc873954f49feb75cbc20966cff64

	  Boot ID:                    d322641c-c347-4fe5-8d74-e2b9baad9736

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               arm64

	  Container Runtime Version:  docker://27.3.1

	  Kubelet Version:            v1.31.1

	  Kube-Proxy Version:         v1.31.1

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (12 in total)

	  Namespace                   Name                                         CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                         ------------  ----------  ---------------  -------------  ---

	  default                     busybox-mount                                0 (0%)        0 (0%)      0 (0%)           0 (0%)         1s

	  default                     hello-node-64b4f8f9ff-5rqvj                  0 (0%)        0 (0%)      0 (0%)           0 (0%)         41s

	  default                     hello-node-connect-65d86f57f4-88jjn          0 (0%)        0 (0%)      0 (0%)           0 (0%)         27s

	  default                     nginx-svc                                    0 (0%)        0 (0%)      0 (0%)           0 (0%)         37s

	  default                     sp-pod                                       0 (0%)        0 (0%)      0 (0%)           0 (0%)         10s

	  kube-system                 coredns-7c65d6cfc9-6j6vh                     100m (5%)     0 (0%)      70Mi (1%)        170Mi (4%)     2m34s

	  kube-system                 etcd-functional-517000                       100m (5%)     0 (0%)      100Mi (2%)       0 (0%)         2m40s

	  kube-system                 kube-apiserver-functional-517000             250m (12%)    0 (0%)      0 (0%)           0 (0%)         64s

	  kube-system                 kube-controller-manager-functional-517000    200m (10%)    0 (0%)      0 (0%)           0 (0%)         2m40s

	  kube-system                 kube-proxy-62vrr                             0 (0%)        0 (0%)      0 (0%)           0 (0%)         2m35s

	  kube-system                 kube-scheduler-functional-517000             100m (5%)     0 (0%)      0 (0%)           0 (0%)         2m40s

	  kube-system                 storage-provisioner                          0 (0%)        0 (0%)      0 (0%)           0 (0%)         2m34s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%)  0 (0%)

	  memory             170Mi (4%)  170Mi (4%)

	  ephemeral-storage  0 (0%)      0 (0%)

	  hugepages-1Gi      0 (0%)      0 (0%)

	  hugepages-2Mi      0 (0%)      0 (0%)

	  hugepages-32Mi     0 (0%)      0 (0%)

	  hugepages-64Ki     0 (0%)      0 (0%)

	Events:

	  Type    Reason                   Age                    From             Message

	  ----    ------                   ----                   ----             -------

	  Normal  Starting                 2m34s                  kube-proxy       

	  Normal  Starting                 63s                    kube-proxy       

	  Normal  Starting                 2m8s                   kube-proxy       

	  Normal  NodeHasNoDiskPressure    2m40s (x2 over 2m40s)  kubelet          Node functional-517000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientMemory  2m40s (x2 over 2m40s)  kubelet          Node functional-517000 status is now: NodeHasSufficientMemory

	  Normal  NodeHasSufficientPID     2m40s (x2 over 2m40s)  kubelet          Node functional-517000 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  2m40s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  Starting                 2m40s                  kubelet          Starting kubelet.

	  Normal  NodeReady                2m36s                  kubelet          Node functional-517000 status is now: NodeReady

	  Normal  RegisteredNode           2m35s                  node-controller  Node functional-517000 event: Registered Node functional-517000 in Controller

	  Normal  NodeHasNoDiskPressure    2m12s (x8 over 2m12s)  kubelet          Node functional-517000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientMemory  2m12s (x8 over 2m12s)  kubelet          Node functional-517000 status is now: NodeHasSufficientMemory

	  Normal  Starting                 2m12s                  kubelet          Starting kubelet.

	  Normal  NodeHasSufficientPID     2m12s (x7 over 2m12s)  kubelet          Node functional-517000 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  2m12s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           2m6s                   node-controller  Node functional-517000 event: Registered Node functional-517000 in Controller

	  Normal  Starting                 67s                    kubelet          Starting kubelet.

	  Normal  NodeHasSufficientMemory  67s (x8 over 67s)      kubelet          Node functional-517000 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    67s (x8 over 67s)      kubelet          Node functional-517000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     67s (x7 over 67s)      kubelet          Node functional-517000 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  67s                    kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           61s                    node-controller  Node functional-517000 event: Registered Node functional-517000 in Controller

	==> dmesg <==

	[  +3.405106] kauditd_printk_skb: 199 callbacks suppressed

	[ +12.775678] kauditd_printk_skb: 34 callbacks suppressed

	[Oct 9 18:51] systemd-fstab-generator[4871]: Ignoring "noauto" option for root device

	[ +11.639316] systemd-fstab-generator[5310]: Ignoring "noauto" option for root device

	[  +0.056173] kauditd_printk_skb: 14 callbacks suppressed

	[  +0.106328] systemd-fstab-generator[5345]: Ignoring "noauto" option for root device

	[  +0.093248] systemd-fstab-generator[5357]: Ignoring "noauto" option for root device

	[  +0.113474] systemd-fstab-generator[5371]: Ignoring "noauto" option for root device

	[  +5.135183] kauditd_printk_skb: 89 callbacks suppressed

	[  +7.373111] systemd-fstab-generator[6004]: Ignoring "noauto" option for root device

	[  +0.088118] systemd-fstab-generator[6016]: Ignoring "noauto" option for root device

	[  +0.091961] systemd-fstab-generator[6028]: Ignoring "noauto" option for root device

	[  +0.099711] systemd-fstab-generator[6043]: Ignoring "noauto" option for root device

	[  +0.236351] systemd-fstab-generator[6209]: Ignoring "noauto" option for root device

	[  +1.104919] systemd-fstab-generator[6332]: Ignoring "noauto" option for root device

	[  +3.415097] kauditd_printk_skb: 199 callbacks suppressed

	[  +9.168942] kauditd_printk_skb: 33 callbacks suppressed

	[  +2.953614] systemd-fstab-generator[7362]: Ignoring "noauto" option for root device

	[  +4.852907] kauditd_printk_skb: 14 callbacks suppressed

	[  +5.598316] kauditd_printk_skb: 19 callbacks suppressed

	[Oct 9 18:52] kauditd_printk_skb: 22 callbacks suppressed

	[  +9.026190] kauditd_printk_skb: 13 callbacks suppressed

	[  +5.752392] kauditd_printk_skb: 32 callbacks suppressed

	[  +9.702454] kauditd_printk_skb: 1 callbacks suppressed

	[ +10.872257] kauditd_printk_skb: 21 callbacks suppressed

	==> etcd [2dccc5d4420b] <==

	{"level":"info","ts":"2024-10-09T18:51:31.133112Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"80e92d98c466b02f","local-member-id":"7520ddf439b1d16","added-peer-id":"7520ddf439b1d16","added-peer-peer-urls":["https://192.168.105.4:2380"]}

	{"level":"info","ts":"2024-10-09T18:51:31.133152Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"80e92d98c466b02f","local-member-id":"7520ddf439b1d16","cluster-version":"3.5"}

	{"level":"info","ts":"2024-10-09T18:51:31.133195Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}

	{"level":"info","ts":"2024-10-09T18:51:31.134230Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}

	{"level":"info","ts":"2024-10-09T18:51:31.134828Z","caller":"embed/etcd.go:728","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}

	{"level":"info","ts":"2024-10-09T18:51:31.134910Z","caller":"embed/etcd.go:599","msg":"serving peer traffic","address":"192.168.105.4:2380"}

	{"level":"info","ts":"2024-10-09T18:51:31.134924Z","caller":"embed/etcd.go:571","msg":"cmux::serve","address":"192.168.105.4:2380"}

	{"level":"info","ts":"2024-10-09T18:51:31.135799Z","caller":"embed/etcd.go:279","msg":"now serving peer/client/metrics","local-member-id":"7520ddf439b1d16","initial-advertise-peer-urls":["https://192.168.105.4:2380"],"listen-peer-urls":["https://192.168.105.4:2380"],"advertise-client-urls":["https://192.168.105.4:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.105.4:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}

	{"level":"info","ts":"2024-10-09T18:51:31.135823Z","caller":"embed/etcd.go:870","msg":"serving metrics","address":"http://127.0.0.1:2381"}

	{"level":"info","ts":"2024-10-09T18:51:32.228197Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 is starting a new election at term 3"}

	{"level":"info","ts":"2024-10-09T18:51:32.228356Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became pre-candidate at term 3"}

	{"level":"info","ts":"2024-10-09T18:51:32.228432Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 received MsgPreVoteResp from 7520ddf439b1d16 at term 3"}

	{"level":"info","ts":"2024-10-09T18:51:32.228475Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became candidate at term 4"}

	{"level":"info","ts":"2024-10-09T18:51:32.228514Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 received MsgVoteResp from 7520ddf439b1d16 at term 4"}

	{"level":"info","ts":"2024-10-09T18:51:32.228546Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became leader at term 4"}

	{"level":"info","ts":"2024-10-09T18:51:32.228586Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 7520ddf439b1d16 elected leader 7520ddf439b1d16 at term 4"}

	{"level":"info","ts":"2024-10-09T18:51:32.233748Z","caller":"etcdserver/server.go:2118","msg":"published local member to cluster through raft","local-member-id":"7520ddf439b1d16","local-member-attributes":"{Name:functional-517000 ClientURLs:[https://192.168.105.4:2379]}","request-path":"/0/members/7520ddf439b1d16/attributes","cluster-id":"80e92d98c466b02f","publish-timeout":"7s"}

	{"level":"info","ts":"2024-10-09T18:51:32.233875Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2024-10-09T18:51:32.234454Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2024-10-09T18:51:32.235197Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}

	{"level":"info","ts":"2024-10-09T18:51:32.235345Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}

	{"level":"info","ts":"2024-10-09T18:51:32.236443Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}

	{"level":"info","ts":"2024-10-09T18:51:32.236444Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}

	{"level":"info","ts":"2024-10-09T18:51:32.238109Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.105.4:2379"}

	{"level":"info","ts":"2024-10-09T18:51:32.238789Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}

	==> etcd [b07d41e12b9c] <==

	{"level":"info","ts":"2024-10-09T18:50:27.646303Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became pre-candidate at term 2"}

	{"level":"info","ts":"2024-10-09T18:50:27.646366Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 received MsgPreVoteResp from 7520ddf439b1d16 at term 2"}

	{"level":"info","ts":"2024-10-09T18:50:27.646399Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became candidate at term 3"}

	{"level":"info","ts":"2024-10-09T18:50:27.646416Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 received MsgVoteResp from 7520ddf439b1d16 at term 3"}

	{"level":"info","ts":"2024-10-09T18:50:27.646470Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became leader at term 3"}

	{"level":"info","ts":"2024-10-09T18:50:27.646540Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 7520ddf439b1d16 elected leader 7520ddf439b1d16 at term 3"}

	{"level":"info","ts":"2024-10-09T18:50:27.651872Z","caller":"etcdserver/server.go:2118","msg":"published local member to cluster through raft","local-member-id":"7520ddf439b1d16","local-member-attributes":"{Name:functional-517000 ClientURLs:[https://192.168.105.4:2379]}","request-path":"/0/members/7520ddf439b1d16/attributes","cluster-id":"80e92d98c466b02f","publish-timeout":"7s"}

	{"level":"info","ts":"2024-10-09T18:50:27.652145Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2024-10-09T18:50:27.652422Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}

	{"level":"info","ts":"2024-10-09T18:50:27.652479Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}

	{"level":"info","ts":"2024-10-09T18:50:27.652523Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2024-10-09T18:50:27.654638Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}

	{"level":"info","ts":"2024-10-09T18:50:27.654638Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}

	{"level":"info","ts":"2024-10-09T18:50:27.657211Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}

	{"level":"info","ts":"2024-10-09T18:50:27.658378Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.105.4:2379"}

	{"level":"info","ts":"2024-10-09T18:51:16.168042Z","caller":"osutil/interrupt_unix.go:64","msg":"received signal; shutting down","signal":"terminated"}

	{"level":"info","ts":"2024-10-09T18:51:16.168072Z","caller":"embed/etcd.go:377","msg":"closing etcd server","name":"functional-517000","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.105.4:2380"],"advertise-client-urls":["https://192.168.105.4:2379"]}

	{"level":"warn","ts":"2024-10-09T18:51:16.168124Z","caller":"embed/serve.go:212","msg":"stopping secure grpc server due to error","error":"accept tcp 127.0.0.1:2379: use of closed network connection"}

	{"level":"warn","ts":"2024-10-09T18:51:16.168169Z","caller":"embed/serve.go:214","msg":"stopped secure grpc server due to error","error":"accept tcp 127.0.0.1:2379: use of closed network connection"}

	{"level":"warn","ts":"2024-10-09T18:51:16.178430Z","caller":"embed/serve.go:212","msg":"stopping secure grpc server due to error","error":"accept tcp 192.168.105.4:2379: use of closed network connection"}

	{"level":"warn","ts":"2024-10-09T18:51:16.178455Z","caller":"embed/serve.go:214","msg":"stopped secure grpc server due to error","error":"accept tcp 192.168.105.4:2379: use of closed network connection"}

	{"level":"info","ts":"2024-10-09T18:51:16.178478Z","caller":"etcdserver/server.go:1521","msg":"skipped leadership transfer for single voting member cluster","local-member-id":"7520ddf439b1d16","current-leader-member-id":"7520ddf439b1d16"}

	{"level":"info","ts":"2024-10-09T18:51:16.182604Z","caller":"embed/etcd.go:581","msg":"stopping serving peer traffic","address":"192.168.105.4:2380"}

	{"level":"info","ts":"2024-10-09T18:51:16.182655Z","caller":"embed/etcd.go:586","msg":"stopped serving peer traffic","address":"192.168.105.4:2380"}

	{"level":"info","ts":"2024-10-09T18:51:16.182659Z","caller":"embed/etcd.go:379","msg":"closed etcd server","name":"functional-517000","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.105.4:2380"],"advertise-client-urls":["https://192.168.105.4:2379"]}

	==> kernel <==

	 18:52:37 up 3 min,  0 users,  load average: 0.49, 0.35, 0.14

	Linux functional-517000 5.10.207 #1 SMP PREEMPT Tue Oct 8 12:02:09 UTC 2024 aarch64 GNU/Linux

	PRETTY_NAME="Buildroot 2023.02.9"

	==> kube-apiserver [65be091b3bee] <==

	I1009 18:51:32.836564       1 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process

	I1009 18:51:32.836519       1 shared_informer.go:320] Caches are synced for crd-autoregister

	I1009 18:51:32.836524       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller

	I1009 18:51:32.836933       1 aggregator.go:171] initial CRD sync complete...

	I1009 18:51:32.836941       1 autoregister_controller.go:144] Starting autoregister controller

	I1009 18:51:32.836943       1 cache.go:32] Waiting for caches to sync for autoregister controller

	I1009 18:51:32.836946       1 cache.go:39] Caches are synced for autoregister controller

	I1009 18:51:32.839643       1 handler_discovery.go:450] Starting ResourceDiscoveryManager

	E1009 18:51:32.840780       1 controller.go:97] Error removing old endpoints from kubernetes service: no API server IP addresses were listed in storage, refusing to erase all endpoints for the kubernetes Service

	I1009 18:51:32.876001       1 controller.go:615] quota admission added evaluator for: leases.coordination.k8s.io

	I1009 18:51:33.737492       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.

	I1009 18:51:33.928504       1 controller.go:615] quota admission added evaluator for: serviceaccounts

	I1009 18:51:33.937371       1 controller.go:615] quota admission added evaluator for: deployments.apps

	I1009 18:51:33.954402       1 controller.go:615] quota admission added evaluator for: daemonsets.apps

	I1009 18:51:33.962758       1 controller.go:615] quota admission added evaluator for: roles.rbac.authorization.k8s.io

	I1009 18:51:33.964929       1 controller.go:615] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io

	I1009 18:51:36.156363       1 controller.go:615] quota admission added evaluator for: endpoints

	I1009 18:51:36.514141       1 controller.go:615] quota admission added evaluator for: endpointslices.discovery.k8s.io

	I1009 18:51:50.617172       1 alloc.go:330] "allocated clusterIPs" service="default/invalid-svc" clusterIPs={"IPv4":"10.104.83.31"}

	I1009 18:51:56.171593       1 controller.go:615] quota admission added evaluator for: replicasets.apps

	I1009 18:51:56.217101       1 alloc.go:330] "allocated clusterIPs" service="default/hello-node" clusterIPs={"IPv4":"10.109.49.26"}

	I1009 18:52:00.271014       1 alloc.go:330] "allocated clusterIPs" service="default/nginx-svc" clusterIPs={"IPv4":"10.110.161.56"}

	I1009 18:52:10.738965       1 alloc.go:330] "allocated clusterIPs" service="default/hello-node-connect" clusterIPs={"IPv4":"10.100.70.29"}

	E1009 18:52:26.105619       1 conn.go:339] Error on socket receive: read tcp 192.168.105.4:8441->192.168.105.1:49608: use of closed network connection

	E1009 18:52:34.343315       1 conn.go:339] Error on socket receive: read tcp 192.168.105.4:8441->192.168.105.1:49614: use of closed network connection

	==> kube-controller-manager [4f41513d2449] <==

	I1009 18:50:31.446043       1 shared_informer.go:313] Waiting for caches to sync for garbage collector

	I1009 18:50:31.447849       1 shared_informer.go:320] Caches are synced for namespace

	I1009 18:50:31.491931       1 shared_informer.go:320] Caches are synced for persistent volume

	I1009 18:50:31.491961       1 shared_informer.go:320] Caches are synced for ephemeral

	I1009 18:50:31.491972       1 shared_informer.go:320] Caches are synced for taint

	I1009 18:50:31.492056       1 node_lifecycle_controller.go:1232] "Initializing eviction metric for zone" logger="node-lifecycle-controller" zone=""

	I1009 18:50:31.492102       1 node_lifecycle_controller.go:884] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="functional-517000"

	I1009 18:50:31.492146       1 node_lifecycle_controller.go:1078] "Controller detected that zone is now in new state" logger="node-lifecycle-controller" zone="" newState="Normal"

	I1009 18:50:31.491976       1 shared_informer.go:320] Caches are synced for taint-eviction-controller

	I1009 18:50:31.494077       1 shared_informer.go:320] Caches are synced for deployment

	I1009 18:50:31.494111       1 shared_informer.go:320] Caches are synced for job

	I1009 18:50:31.495283       1 shared_informer.go:320] Caches are synced for attach detach

	I1009 18:50:31.495807       1 shared_informer.go:320] Caches are synced for disruption

	I1009 18:50:31.498668       1 shared_informer.go:320] Caches are synced for endpoint_slice

	I1009 18:50:31.591686       1 shared_informer.go:320] Caches are synced for endpoint_slice_mirroring

	I1009 18:50:31.597264       1 shared_informer.go:320] Caches are synced for resource quota

	I1009 18:50:31.610814       1 shared_informer.go:320] Caches are synced for cronjob

	I1009 18:50:31.645542       1 shared_informer.go:320] Caches are synced for resource quota

	I1009 18:50:31.883596       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7c65d6cfc9" duration="441.460713ms"

	I1009 18:50:31.883732       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7c65d6cfc9" duration="42.279µs"

	I1009 18:50:32.046099       1 shared_informer.go:320] Caches are synced for garbage collector

	I1009 18:50:32.144697       1 shared_informer.go:320] Caches are synced for garbage collector

	I1009 18:50:32.144775       1 garbagecollector.go:157] "All resource monitors have synced. Proceeding to collect garbage" logger="garbage-collector-controller"

	I1009 18:51:03.237275       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7c65d6cfc9" duration="8.581032ms"

	I1009 18:51:03.237463       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7c65d6cfc9" duration="33.56µs"

	==> kube-controller-manager [53f95f20007e] <==

	I1009 18:51:36.359996       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7c65d6cfc9" duration="19.004µs"

	I1009 18:51:36.726636       1 shared_informer.go:320] Caches are synced for garbage collector

	I1009 18:51:36.805146       1 shared_informer.go:320] Caches are synced for garbage collector

	I1009 18:51:36.805353       1 garbagecollector.go:157] "All resource monitors have synced. Proceeding to collect garbage" logger="garbage-collector-controller"

	I1009 18:51:42.805929       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7c65d6cfc9" duration="8.76869ms"

	I1009 18:51:42.806852       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7c65d6cfc9" duration="28.714µs"

	I1009 18:51:56.179925       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-64b4f8f9ff" duration="6.816455ms"

	I1009 18:51:56.184788       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-64b4f8f9ff" duration="4.645158ms"

	I1009 18:51:56.192963       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-64b4f8f9ff" duration="8.046884ms"

	I1009 18:51:56.193123       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-64b4f8f9ff" duration="115.498µs"

	I1009 18:52:01.751335       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-64b4f8f9ff" duration="22.383µs"

	I1009 18:52:02.794106       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-64b4f8f9ff" duration="39.722µs"

	I1009 18:52:03.199286       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="functional-517000"

	I1009 18:52:03.798035       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-64b4f8f9ff" duration="24.3µs"

	I1009 18:52:10.697745       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-connect-65d86f57f4" duration="5.66103ms"

	I1009 18:52:10.702909       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-connect-65d86f57f4" duration="5.121928ms"

	I1009 18:52:10.730593       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-connect-65d86f57f4" duration="27.658844ms"

	I1009 18:52:10.730754       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-connect-65d86f57f4" duration="28.969µs"

	I1009 18:52:11.902453       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-connect-65d86f57f4" duration="28.093µs"

	I1009 18:52:12.938626       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-connect-65d86f57f4" duration="55.81µs"

	I1009 18:52:16.978678       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-64b4f8f9ff" duration="26.218µs"

	I1009 18:52:28.354944       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-64b4f8f9ff" duration="120.581µs"

	I1009 18:52:28.363944       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-connect-65d86f57f4" duration="24.342µs"

	I1009 18:52:29.177434       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-connect-65d86f57f4" duration="68.272µs"

	I1009 18:52:33.943954       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="functional-517000"

	==> kube-proxy [3afd220050b2] <==

		add table ip kube-proxy

		^^^^^^^^^^^^^^^^^^^^^^^^

	 >

	E1009 18:51:33.928148       1 proxier.go:734] "Error cleaning up nftables rules" err=<

		could not run nftables command: /dev/stdin:1:1-25: Error: Could not process rule: Operation not supported

		add table ip6 kube-proxy

		^^^^^^^^^^^^^^^^^^^^^^^^^

	 >

	I1009 18:51:33.931682       1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.105.4"]

	E1009 18:51:33.931751       1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"

	I1009 18:51:33.939626       1 server_linux.go:146] "No iptables support for family" ipFamily="IPv6"

	I1009 18:51:33.939683       1 server.go:245] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I1009 18:51:33.939714       1 server_linux.go:169] "Using iptables Proxier"

	I1009 18:51:33.940695       1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"

	I1009 18:51:33.941055       1 server.go:483] "Version info" version="v1.31.1"

	I1009 18:51:33.941066       1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I1009 18:51:33.941774       1 config.go:199] "Starting service config controller"

	I1009 18:51:33.941889       1 shared_informer.go:313] Waiting for caches to sync for service config

	I1009 18:51:33.941906       1 config.go:105] "Starting endpoint slice config controller"

	I1009 18:51:33.941978       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config

	I1009 18:51:33.942279       1 config.go:328] "Starting node config controller"

	I1009 18:51:33.942309       1 shared_informer.go:313] Waiting for caches to sync for node config

	I1009 18:51:34.046238       1 shared_informer.go:320] Caches are synced for node config

	I1009 18:51:34.046310       1 shared_informer.go:320] Caches are synced for service config

	I1009 18:51:34.046320       1 shared_informer.go:320] Caches are synced for endpoint slice config

	==> kube-proxy [a190ed3834e8] <==

		add table ip kube-proxy

		^^^^^^^^^^^^^^^^^^^^^^^^

	 >

	E1009 18:50:29.295698       1 proxier.go:734] "Error cleaning up nftables rules" err=<

		could not run nftables command: /dev/stdin:1:1-25: Error: Could not process rule: Operation not supported

		add table ip6 kube-proxy

		^^^^^^^^^^^^^^^^^^^^^^^^^

	 >

	I1009 18:50:29.300246       1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.105.4"]

	E1009 18:50:29.300276       1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"

	I1009 18:50:29.307841       1 server_linux.go:146] "No iptables support for family" ipFamily="IPv6"

	I1009 18:50:29.307857       1 server.go:245] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I1009 18:50:29.307867       1 server_linux.go:169] "Using iptables Proxier"

	I1009 18:50:29.308552       1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"

	I1009 18:50:29.308650       1 server.go:483] "Version info" version="v1.31.1"

	I1009 18:50:29.308658       1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I1009 18:50:29.309078       1 config.go:199] "Starting service config controller"

	I1009 18:50:29.309087       1 shared_informer.go:313] Waiting for caches to sync for service config

	I1009 18:50:29.309098       1 config.go:105] "Starting endpoint slice config controller"

	I1009 18:50:29.309100       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config

	I1009 18:50:29.309278       1 config.go:328] "Starting node config controller"

	I1009 18:50:29.309280       1 shared_informer.go:313] Waiting for caches to sync for node config

	I1009 18:50:29.409279       1 shared_informer.go:320] Caches are synced for endpoint slice config

	I1009 18:50:29.409302       1 shared_informer.go:320] Caches are synced for node config

	I1009 18:50:29.409308       1 shared_informer.go:320] Caches are synced for service config

	==> kube-scheduler [41dcefdb4ed2] <==

	I1009 18:50:26.917891       1 serving.go:386] Generated self-signed cert in-memory

	W1009 18:50:28.187286       1 requestheader_controller.go:196] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'

	W1009 18:50:28.187410       1 authentication.go:370] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"

	W1009 18:50:28.187436       1 authentication.go:371] Continuing without authentication configuration. This may treat all requests as anonymous.

	W1009 18:50:28.187471       1 authentication.go:372] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false

	I1009 18:50:28.211541       1 server.go:167] "Starting Kubernetes Scheduler" version="v1.31.1"

	I1009 18:50:28.211555       1 server.go:169] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I1009 18:50:28.212452       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"

	I1009 18:50:28.212488       1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I1009 18:50:28.212555       1 secure_serving.go:213] Serving securely on 127.0.0.1:10259

	I1009 18:50:28.212591       1 tlsconfig.go:243] "Starting DynamicServingCertificateController"

	I1009 18:50:28.313444       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	E1009 18:51:16.176997       1 run.go:72] "command failed" err="finished without leader elect"

	==> kube-scheduler [8ea1f92e3e2d] <==

	I1009 18:51:31.606982       1 serving.go:386] Generated self-signed cert in-memory

	W1009 18:51:32.762648       1 requestheader_controller.go:196] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'

	W1009 18:51:32.762664       1 authentication.go:370] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"

	W1009 18:51:32.762669       1 authentication.go:371] Continuing without authentication configuration. This may treat all requests as anonymous.

	W1009 18:51:32.762672       1 authentication.go:372] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false

	I1009 18:51:32.781057       1 server.go:167] "Starting Kubernetes Scheduler" version="v1.31.1"

	I1009 18:51:32.785882       1 server.go:169] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I1009 18:51:32.786840       1 secure_serving.go:213] Serving securely on 127.0.0.1:10259

	I1009 18:51:32.786913       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"

	I1009 18:51:32.786955       1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I1009 18:51:32.786980       1 tlsconfig.go:243] "Starting DynamicServingCertificateController"

	I1009 18:51:32.887131       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	==> kubelet <==

	Oct 09 18:52:26 functional-517000 kubelet[6339]: I1009 18:52:26.507628    6339 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-xf2fw\" (UniqueName: \"kubernetes.io/projected/253b33d5-24b7-4ae5-bfcd-d4efcb2dd404-kube-api-access-xf2fw\") on node \"functional-517000\" DevicePath \"\""

	Oct 09 18:52:27 functional-517000 kubelet[6339]: I1009 18:52:27.129528    6339 scope.go:117] "RemoveContainer" containerID="a0c7baf0d213204a1786e5ef5bc2866848d9140e33735af557168835f808d4f4"

	Oct 09 18:52:27 functional-517000 kubelet[6339]: I1009 18:52:27.151706    6339 scope.go:117] "RemoveContainer" containerID="a0c7baf0d213204a1786e5ef5bc2866848d9140e33735af557168835f808d4f4"

	Oct 09 18:52:27 functional-517000 kubelet[6339]: E1009 18:52:27.152654    6339 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = Unknown desc = Error response from daemon: No such container: a0c7baf0d213204a1786e5ef5bc2866848d9140e33735af557168835f808d4f4" containerID="a0c7baf0d213204a1786e5ef5bc2866848d9140e33735af557168835f808d4f4"

	Oct 09 18:52:27 functional-517000 kubelet[6339]: I1009 18:52:27.152695    6339 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"docker","ID":"a0c7baf0d213204a1786e5ef5bc2866848d9140e33735af557168835f808d4f4"} err="failed to get container status \"a0c7baf0d213204a1786e5ef5bc2866848d9140e33735af557168835f808d4f4\": rpc error: code = Unknown desc = Error response from daemon: No such container: a0c7baf0d213204a1786e5ef5bc2866848d9140e33735af557168835f808d4f4"

	Oct 09 18:52:27 functional-517000 kubelet[6339]: E1009 18:52:27.226450    6339 cpu_manager.go:395] "RemoveStaleState: removing container" podUID="253b33d5-24b7-4ae5-bfcd-d4efcb2dd404" containerName="myfrontend"

	Oct 09 18:52:27 functional-517000 kubelet[6339]: I1009 18:52:27.226484    6339 memory_manager.go:354] "RemoveStaleState removing state" podUID="253b33d5-24b7-4ae5-bfcd-d4efcb2dd404" containerName="myfrontend"

	Oct 09 18:52:27 functional-517000 kubelet[6339]: I1009 18:52:27.418434    6339 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zlpr\" (UniqueName: \"kubernetes.io/projected/27c51341-669e-4026-b47c-799bff69ad8d-kube-api-access-7zlpr\") pod \"sp-pod\" (UID: \"27c51341-669e-4026-b47c-799bff69ad8d\") " pod="default/sp-pod"

	Oct 09 18:52:27 functional-517000 kubelet[6339]: I1009 18:52:27.418468    6339 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-763519d8-64e0-4a50-86fa-8e1c5c946c9b\" (UniqueName: \"kubernetes.io/host-path/27c51341-669e-4026-b47c-799bff69ad8d-pvc-763519d8-64e0-4a50-86fa-8e1c5c946c9b\") pod \"sp-pod\" (UID: \"27c51341-669e-4026-b47c-799bff69ad8d\") " pod="default/sp-pod"

	Oct 09 18:52:28 functional-517000 kubelet[6339]: I1009 18:52:28.344725    6339 scope.go:117] "RemoveContainer" containerID="f3d812a18b35dd523c636f83bf1a0e67613a07aa92e24576ae01e01195b58427"

	Oct 09 18:52:28 functional-517000 kubelet[6339]: E1009 18:52:28.344898    6339 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echoserver-arm\" with CrashLoopBackOff: \"back-off 20s restarting failed container=echoserver-arm pod=hello-node-64b4f8f9ff-5rqvj_default(2afe3a72-b0b3-4d6f-a81a-8ccadcc5b83b)\"" pod="default/hello-node-64b4f8f9ff-5rqvj" podUID="2afe3a72-b0b3-4d6f-a81a-8ccadcc5b83b"

	Oct 09 18:52:28 functional-517000 kubelet[6339]: I1009 18:52:28.345380    6339 scope.go:117] "RemoveContainer" containerID="ffefef26381de5b6d3876f8d375fcf467d521dbc034bcac664a39e4cc4d07d26"

	Oct 09 18:52:28 functional-517000 kubelet[6339]: I1009 18:52:28.353051    6339 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="253b33d5-24b7-4ae5-bfcd-d4efcb2dd404" path="/var/lib/kubelet/pods/253b33d5-24b7-4ae5-bfcd-d4efcb2dd404/volumes"

	Oct 09 18:52:29 functional-517000 kubelet[6339]: I1009 18:52:29.168280    6339 scope.go:117] "RemoveContainer" containerID="ffefef26381de5b6d3876f8d375fcf467d521dbc034bcac664a39e4cc4d07d26"

	Oct 09 18:52:29 functional-517000 kubelet[6339]: I1009 18:52:29.168610    6339 scope.go:117] "RemoveContainer" containerID="93962dd42a5009524726a8dd83795622ace99a226632873d250e32615a7f4e10"

	Oct 09 18:52:29 functional-517000 kubelet[6339]: E1009 18:52:29.168753    6339 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echoserver-arm\" with CrashLoopBackOff: \"back-off 20s restarting failed container=echoserver-arm pod=hello-node-connect-65d86f57f4-88jjn_default(132ecdf9-5e02-4865-a825-6a9ee4e20459)\"" pod="default/hello-node-connect-65d86f57f4-88jjn" podUID="132ecdf9-5e02-4865-a825-6a9ee4e20459"

	Oct 09 18:52:29 functional-517000 kubelet[6339]: I1009 18:52:29.190980    6339 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="default/sp-pod" podStartSLOduration=1.46262694 podStartE2EDuration="2.190963866s" podCreationTimestamp="2024-10-09 18:52:27 +0000 UTC" firstStartedPulling="2024-10-09 18:52:27.951490921 +0000 UTC m=+57.677953463" lastFinishedPulling="2024-10-09 18:52:28.679827847 +0000 UTC m=+58.406290389" observedRunningTime="2024-10-09 18:52:29.190730415 +0000 UTC m=+58.917192957" watchObservedRunningTime="2024-10-09 18:52:29.190963866 +0000 UTC m=+58.917426408"

	Oct 09 18:52:30 functional-517000 kubelet[6339]: E1009 18:52:30.350162    6339 iptables.go:577] "Could not set up iptables canary" err=<

	Oct 09 18:52:30 functional-517000 kubelet[6339]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Oct 09 18:52:30 functional-517000 kubelet[6339]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Oct 09 18:52:30 functional-517000 kubelet[6339]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Oct 09 18:52:30 functional-517000 kubelet[6339]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Oct 09 18:52:30 functional-517000 kubelet[6339]: I1009 18:52:30.414612    6339 scope.go:117] "RemoveContainer" containerID="038318400a7c4918abd93e51f230b4c263d77ac221167d0c17e4eabaeba94ae1"

	Oct 09 18:52:36 functional-517000 kubelet[6339]: I1009 18:52:36.820056    6339 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-volume\" (UniqueName: \"kubernetes.io/host-path/13c3b555-4808-498a-823e-c7a3b19d83de-test-volume\") pod \"busybox-mount\" (UID: \"13c3b555-4808-498a-823e-c7a3b19d83de\") " pod="default/busybox-mount"

	Oct 09 18:52:36 functional-517000 kubelet[6339]: I1009 18:52:36.820099    6339 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5zpk\" (UniqueName: \"kubernetes.io/projected/13c3b555-4808-498a-823e-c7a3b19d83de-kube-api-access-s5zpk\") pod \"busybox-mount\" (UID: \"13c3b555-4808-498a-823e-c7a3b19d83de\") " pod="default/busybox-mount"

	==> storage-provisioner [0e3ab9139e53] <==

	I1009 18:51:33.864064       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I1009 18:51:33.874348       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I1009 18:51:33.874371       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I1009 18:51:51.294148       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I1009 18:51:51.294235       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_functional-517000_5c007312-c6d3-472d-93ed-ed6e35fffb77!

	I1009 18:51:51.294357       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"02e034d7-b5aa-457e-9bad-251a4e3e094f", APIVersion:"v1", ResourceVersion:"627", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' functional-517000_5c007312-c6d3-472d-93ed-ed6e35fffb77 became leader

	I1009 18:51:51.397632       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_functional-517000_5c007312-c6d3-472d-93ed-ed6e35fffb77!

	I1009 18:52:13.885790       1 controller.go:1332] provision "default/myclaim" class "standard": started

	I1009 18:52:13.886204       1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"myclaim", UID:"763519d8-64e0-4a50-86fa-8e1c5c946c9b", APIVersion:"v1", ResourceVersion:"749", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/myclaim"

	I1009 18:52:13.885893       1 storage_provisioner.go:61] Provisioning volume {&StorageClass{ObjectMeta:{standard    723a013f-6e9b-46d8-a28a-8b5817613a1c 330 0 2024-10-09 18:50:03 +0000 UTC <nil> <nil> map[addonmanager.kubernetes.io/mode:EnsureExists] map[kubectl.kubernetes.io/last-applied-configuration:{"apiVersion":"storage.k8s.io/v1","kind":"StorageClass","metadata":{"annotations":{"storageclass.kubernetes.io/is-default-class":"true"},"labels":{"addonmanager.kubernetes.io/mode":"EnsureExists"},"name":"standard"},"provisioner":"k8s.io/minikube-hostpath"}

	 storageclass.kubernetes.io/is-default-class:true] [] []  [{kubectl-client-side-apply Update storage.k8s.io/v1 2024-10-09 18:50:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubectl.kubernetes.io/last-applied-configuration":{},"f:storageclass.kubernetes.io/is-default-class":{}},"f:labels":{".":{},"f:addonmanager.kubernetes.io/mode":{}}},"f:provisioner":{},"f:reclaimPolicy":{},"f:volumeBindingMode":{}}}]},Provisioner:k8s.io/minikube-hostpath,Parameters:map[string]string{},ReclaimPolicy:*Delete,MountOptions:[],AllowVolumeExpansion:nil,VolumeBindingMode:*Immediate,AllowedTopologies:[]TopologySelectorTerm{},} pvc-763519d8-64e0-4a50-86fa-8e1c5c946c9b &PersistentVolumeClaim{ObjectMeta:{myclaim  default  763519d8-64e0-4a50-86fa-8e1c5c946c9b 749 0 2024-10-09 18:52:13 +0000 UTC <nil> <nil> map[] map[kubectl.kubernetes.io/last-applied-configuration:{"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"name":"myclaim","namespace":"default"},"spec":{"accessModes":["Rea

dWriteOnce"],"resources":{"requests":{"storage":"500Mi"}},"volumeMode":"Filesystem"}}

	 volume.beta.kubernetes.io/storage-provisioner:k8s.io/minikube-hostpath volume.kubernetes.io/storage-provisioner:k8s.io/minikube-hostpath] [] [kubernetes.io/pvc-protection]  [{kube-controller-manager Update v1 2024-10-09 18:52:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:volume.beta.kubernetes.io/storage-provisioner":{},"f:volume.kubernetes.io/storage-provisioner":{}}}}} {kubectl-client-side-apply Update v1 2024-10-09 18:52:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubectl.kubernetes.io/last-applied-configuration":{}}},"f:spec":{"f:accessModes":{},"f:resources":{"f:requests":{".":{},"f:storage":{}}},"f:volumeMode":{}}}}]},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{524288000 0} {<nil>} 500Mi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*standard,VolumeMode:*Filesystem,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:

ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},},} nil} to /tmp/hostpath-provisioner/default/myclaim

	I1009 18:52:13.887320       1 controller.go:1439] provision "default/myclaim" class "standard": volume "pvc-763519d8-64e0-4a50-86fa-8e1c5c946c9b" provisioned

	I1009 18:52:13.887376       1 controller.go:1456] provision "default/myclaim" class "standard": succeeded

	I1009 18:52:13.887930       1 volume_store.go:212] Trying to save persistentvolume "pvc-763519d8-64e0-4a50-86fa-8e1c5c946c9b"

	I1009 18:52:13.894322       1 volume_store.go:219] persistentvolume "pvc-763519d8-64e0-4a50-86fa-8e1c5c946c9b" saved

	I1009 18:52:13.895533       1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"myclaim", UID:"763519d8-64e0-4a50-86fa-8e1c5c946c9b", APIVersion:"v1", ResourceVersion:"749", FieldPath:""}): type: 'Normal' reason: 'ProvisioningSucceeded' Successfully provisioned volume pvc-763519d8-64e0-4a50-86fa-8e1c5c946c9b

	==> storage-provisioner [dcaae86796df] <==

	I1009 18:50:41.842806       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I1009 18:50:41.848131       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I1009 18:50:41.848150       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I1009 18:50:59.253533       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I1009 18:50:59.253671       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_functional-517000_bfd41cbb-8737-45ab-8552-9c9e57dadfc2!

	I1009 18:50:59.253726       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"02e034d7-b5aa-457e-9bad-251a4e3e094f", APIVersion:"v1", ResourceVersion:"503", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' functional-517000_bfd41cbb-8737-45ab-8552-9c9e57dadfc2 became leader

	I1009 18:50:59.355081       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_functional-517000_bfd41cbb-8737-45ab-8552-9c9e57dadfc2!

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.APIServer}} -p functional-517000 -n functional-517000

helpers_test.go:261: (dbg) Run:  kubectl --context functional-517000 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:272: non-running pods: busybox-mount

helpers_test.go:274: ======> post-mortem[TestFunctional/parallel/ServiceCmdConnect]: describe non-running pods <======

helpers_test.go:277: (dbg) Run:  kubectl --context functional-517000 describe pod busybox-mount

helpers_test.go:282: (dbg) kubectl --context functional-517000 describe pod busybox-mount:

-- stdout --

	Name:             busybox-mount

	Namespace:        default

	Priority:         0

	Service Account:  default

	Node:             functional-517000/192.168.105.4

	Start Time:       Wed, 09 Oct 2024 11:52:36 -0700

	Labels:           integration-test=busybox-mount

	Annotations:      <none>

	Status:           Pending

	IP:               

	IPs:              <none>

	Containers:

	  mount-munger:

	    Container ID:  

	    Image:         gcr.io/k8s-minikube/busybox:1.28.4-glibc

	    Image ID:      

	    Port:          <none>

	    Host Port:     <none>

	    Command:

	      /bin/sh

	      -c

	      --

	    Args:

	      cat /mount-9p/created-by-test; echo test > /mount-9p/created-by-pod; rm /mount-9p/created-by-test-removed-by-pod; echo test > /mount-9p/created-by-pod-removed-by-test date >> /mount-9p/pod-dates

	    State:          Waiting

	      Reason:       ContainerCreating

	    Ready:          False

	    Restart Count:  0

	    Environment:    <none>

	    Mounts:

	      /mount-9p from test-volume (rw)

	      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-s5zpk (ro)

	Conditions:

	  Type                        Status

	  PodReadyToStartContainers   False 

	  Initialized                 True 

	  Ready                       False 

	  ContainersReady             False 

	  PodScheduled                True 

	Volumes:

	  test-volume:

	    Type:          HostPath (bare host directory volume)

	    Path:          /mount-9p

	    HostPathType:  

	  kube-api-access-s5zpk:

	    Type:                    Projected (a volume that contains injected data from multiple sources)

	    TokenExpirationSeconds:  3607

	    ConfigMapName:           kube-root-ca.crt

	    ConfigMapOptional:       <nil>

	    DownwardAPI:             true

	QoS Class:                   BestEffort

	Node-Selectors:              <none>

	Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

	                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

	Events:

	  Type    Reason     Age   From               Message

	  ----    ------     ----  ----               -------

	  Normal  Scheduled  1s    default-scheduler  Successfully assigned default/busybox-mount to functional-517000

	  Normal  Pulling    1s    kubelet            Pulling image "gcr.io/k8s-minikube/busybox:1.28.4-glibc"

-- /stdout --

helpers_test.go:285: <<< TestFunctional/parallel/ServiceCmdConnect FAILED: end of post-mortem logs <<<

helpers_test.go:286: ---------------------/post-mortem---------------------------------

--- FAIL: TestFunctional/parallel/ServiceCmdConnect (27.64s)

=== RUN   TestMultiControlPlane/serial/StartCluster

ha_test.go:101: (dbg) Run:  out/minikube-darwin-arm64 start -p ha-845000 --wait=true --memory=2200 --ha -v=7 --alsologtostderr --driver=qemu2 

E1009 11:56:56.178250    1686 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/functional-517000/client.crt: no such file or directory" logger="UnhandledError"

E1009 11:56:56.185998    1686 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/functional-517000/client.crt: no such file or directory" logger="UnhandledError"

E1009 11:56:56.199393    1686 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/functional-517000/client.crt: no such file or directory" logger="UnhandledError"

E1009 11:56:56.222623    1686 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/functional-517000/client.crt: no such file or directory" logger="UnhandledError"

E1009 11:56:56.266065    1686 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/functional-517000/client.crt: no such file or directory" logger="UnhandledError"

E1009 11:56:56.349523    1686 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/functional-517000/client.crt: no such file or directory" logger="UnhandledError"

E1009 11:56:56.512965    1686 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/functional-517000/client.crt: no such file or directory" logger="UnhandledError"

E1009 11:56:56.836680    1686 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/functional-517000/client.crt: no such file or directory" logger="UnhandledError"

E1009 11:56:57.480373    1686 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/functional-517000/client.crt: no such file or directory" logger="UnhandledError"

E1009 11:56:58.764186    1686 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/functional-517000/client.crt: no such file or directory" logger="UnhandledError"

E1009 11:57:01.327960    1686 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/functional-517000/client.crt: no such file or directory" logger="UnhandledError"

E1009 11:57:06.451636    1686 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/functional-517000/client.crt: no such file or directory" logger="UnhandledError"

E1009 11:57:16.695262    1686 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/functional-517000/client.crt: no such file or directory" logger="UnhandledError"

E1009 11:57:37.178817    1686 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/functional-517000/client.crt: no such file or directory" logger="UnhandledError"

E1009 11:58:18.142114    1686 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/functional-517000/client.crt: no such file or directory" logger="UnhandledError"

E1009 11:59:40.064935    1686 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/functional-517000/client.crt: no such file or directory" logger="UnhandledError"

E1009 12:01:56.174172    1686 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/functional-517000/client.crt: no such file or directory" logger="UnhandledError"

E1009 12:02:23.906759    1686 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/functional-517000/client.crt: no such file or directory" logger="UnhandledError"

ha_test.go:101: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p ha-845000 --wait=true --memory=2200 --ha -v=7 --alsologtostderr --driver=qemu2 : exit status 52 (12m5.311550625s)

-- stdout --

	* [ha-845000] minikube v1.34.0 on Darwin 15.0.1 (arm64)

	  - MINIKUBE_LOCATION=19780

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19780-1164/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19780-1164/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "ha-845000" primary control-plane node in "ha-845000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	* Deleting "ha-845000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

-- /stdout --

** stderr ** 

	I1009 11:52:52.354322    2345 out.go:345] Setting OutFile to fd 1 ...

	I1009 11:52:52.354466    2345 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 11:52:52.354469    2345 out.go:358] Setting ErrFile to fd 2...

	I1009 11:52:52.354472    2345 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 11:52:52.354624    2345 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19780-1164/.minikube/bin

	I1009 11:52:52.355781    2345 out.go:352] Setting JSON to false

	I1009 11:52:52.375288    2345 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":1342,"bootTime":1728498630,"procs":512,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}

	W1009 11:52:52.375391    2345 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I1009 11:52:52.378925    2345 out.go:177] * [ha-845000] minikube v1.34.0 on Darwin 15.0.1 (arm64)

	I1009 11:52:52.387009    2345 out.go:177]   - MINIKUBE_LOCATION=19780

	I1009 11:52:52.387029    2345 notify.go:220] Checking for updates...

	I1009 11:52:52.393930    2345 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19780-1164/kubeconfig

	I1009 11:52:52.401932    2345 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I1009 11:52:52.409947    2345 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1009 11:52:52.413957    2345 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19780-1164/.minikube

	I1009 11:52:52.416985    2345 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I1009 11:52:52.420131    2345 driver.go:394] Setting default libvirt URI to qemu:///system

	I1009 11:52:52.423868    2345 out.go:177] * Using the qemu2 driver based on user configuration

	I1009 11:52:52.430948    2345 start.go:297] selected driver: qemu2

	I1009 11:52:52.430956    2345 start.go:901] validating driver "qemu2" against <nil>

	I1009 11:52:52.430962    2345 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I1009 11:52:52.433869    2345 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I1009 11:52:52.436929    2345 out.go:177] * Automatically selected the socket_vmnet network

	I1009 11:52:52.440042    2345 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I1009 11:52:52.440061    2345 cni.go:84] Creating CNI manager for ""

	I1009 11:52:52.440079    2345 cni.go:136] multinode detected (0 nodes found), recommending kindnet

	I1009 11:52:52.440082    2345 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni

	I1009 11:52:52.440123    2345 start.go:340] cluster config:

	{Name:ha-845000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:ha-845000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker C

RISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client Soc

ketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1009 11:52:52.444946    2345 iso.go:125] acquiring lock: {Name:mka6a0d59ae6cc32794e4fbfa8e5c6ce6a65e504 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1009 11:52:52.452936    2345 out.go:177] * Starting "ha-845000" primary control-plane node in "ha-845000" cluster

	I1009 11:52:52.456959    2345 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime docker

	I1009 11:52:52.456980    2345 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19780-1164/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4

	I1009 11:52:52.456993    2345 cache.go:56] Caching tarball of preloaded images

	I1009 11:52:52.457068    2345 preload.go:172] Found /Users/jenkins/minikube-integration/19780-1164/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I1009 11:52:52.457073    2345 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on docker

	I1009 11:52:52.457296    2345 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/ha-845000/config.json ...

	I1009 11:52:52.457306    2345 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/ha-845000/config.json: {Name:mk06ce34843d17a9d7a74714120ca6bbe30954eb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1009 11:52:52.457619    2345 start.go:360] acquireMachinesLock for ha-845000: {Name:mk6dc29eb74286120c58954bae0cd65a85a89b02 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1009 11:52:52.457661    2345 start.go:364] duration metric: took 37.041µs to acquireMachinesLock for "ha-845000"

	I1009 11:52:52.457670    2345 start.go:93] Provisioning new machine with config: &{Name:ha-845000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19774/minikube-v1.34.0-1728382514-19774-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernet

esVersion:v1.31.1 ClusterName:ha-845000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0

MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1009 11:52:52.457703    2345 start.go:125] createHost starting for "" (driver="qemu2")

	I1009 11:52:52.460999    2345 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I1009 11:52:52.482585    2345 start.go:159] libmachine.API.Create for "ha-845000" (driver="qemu2")

	I1009 11:52:52.482611    2345 client.go:168] LocalClient.Create starting

	I1009 11:52:52.482695    2345 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19780-1164/.minikube/certs/ca.pem

	I1009 11:52:52.482733    2345 main.go:141] libmachine: Decoding PEM data...

	I1009 11:52:52.482750    2345 main.go:141] libmachine: Parsing certificate...

	I1009 11:52:52.482793    2345 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19780-1164/.minikube/certs/cert.pem

	I1009 11:52:52.482823    2345 main.go:141] libmachine: Decoding PEM data...

	I1009 11:52:52.482830    2345 main.go:141] libmachine: Parsing certificate...

	I1009 11:52:52.483170    2345 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19780-1164/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19780-1164/.minikube/cache/iso/arm64/minikube-v1.34.0-1728382514-19774-arm64.iso...

	I1009 11:52:52.750714    2345 main.go:141] libmachine: Creating SSH key...

	I1009 11:52:52.830799    2345 main.go:141] libmachine: Creating Disk image...

	I1009 11:52:52.830805    2345 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I1009 11:52:52.830996    2345 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/ha-845000/disk.qcow2.raw /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/ha-845000/disk.qcow2

	I1009 11:52:52.842452    2345 main.go:141] libmachine: STDOUT: 

	I1009 11:52:52.842470    2345 main.go:141] libmachine: STDERR: 

	I1009 11:52:52.842533    2345 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/ha-845000/disk.qcow2 +20000M

	I1009 11:52:52.851114    2345 main.go:141] libmachine: STDOUT: Image resized.

	I1009 11:52:52.851131    2345 main.go:141] libmachine: STDERR: 

	I1009 11:52:52.851142    2345 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/ha-845000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/ha-845000/disk.qcow2

	I1009 11:52:52.851155    2345 main.go:141] libmachine: Starting QEMU VM...

	I1009 11:52:52.851166    2345 qemu.go:418] Using hvf for hardware acceleration

	I1009 11:52:52.851199    2345 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/ha-845000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19780-1164/.minikube/machines/ha-845000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/ha-845000/qemu.pid -device virtio-net-pci,netdev=net0,mac=62:47:a4:45:59:9e -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/ha-845000/disk.qcow2

	I1009 11:52:52.890484    2345 main.go:141] libmachine: STDOUT: 

	I1009 11:52:52.890510    2345 main.go:141] libmachine: STDERR: 

	I1009 11:52:52.890515    2345 main.go:141] libmachine: Attempt 0

	I1009 11:52:52.890530    2345 main.go:141] libmachine: Searching for 62:47:a4:45:59:9e in /var/db/dhcpd_leases ...

	I1009 11:52:52.890624    2345 main.go:141] libmachine: Found 4 entries in /var/db/dhcpd_leases!

	I1009 11:52:52.890645    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.4 HWAddress:de:f4:9f:dd:3:a5 ID:1,de:f4:9f:dd:3:a5 Lease:0x6706de52}

	I1009 11:52:52.890658    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.3 HWAddress:6:de:1f:71:7f:2 ID:1,6:de:1f:71:7f:2 Lease:0x6706d000}

	I1009 11:52:52.890670    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:fa:15:2:2:89:77 ID:1,fa:15:2:2:89:77 Lease:0x6706dd99}

	I1009 11:52:52.890677    2345 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:da:98:b3:c0:e3:d9 ID:1,da:98:b3:c0:e3:d9 Lease:0x6706d9ed}

	I1009 11:52:54.892841    2345 main.go:141] libmachine: Attempt 1

	I1009 11:52:54.892915    2345 main.go:141] libmachine: Searching for 62:47:a4:45:59:9e in /var/db/dhcpd_leases ...

	I1009 11:52:54.893304    2345 main.go:141] libmachine: Found 4 entries in /var/db/dhcpd_leases!

	I1009 11:52:54.893359    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.4 HWAddress:de:f4:9f:dd:3:a5 ID:1,de:f4:9f:dd:3:a5 Lease:0x6706de52}

	I1009 11:52:54.893429    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.3 HWAddress:6:de:1f:71:7f:2 ID:1,6:de:1f:71:7f:2 Lease:0x6706d000}

	I1009 11:52:54.893463    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:fa:15:2:2:89:77 ID:1,fa:15:2:2:89:77 Lease:0x6706dd99}

	I1009 11:52:54.893499    2345 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:da:98:b3:c0:e3:d9 ID:1,da:98:b3:c0:e3:d9 Lease:0x6706d9ed}

	I1009 11:52:56.895698    2345 main.go:141] libmachine: Attempt 2

	I1009 11:52:56.895818    2345 main.go:141] libmachine: Searching for 62:47:a4:45:59:9e in /var/db/dhcpd_leases ...

	I1009 11:52:56.896181    2345 main.go:141] libmachine: Found 4 entries in /var/db/dhcpd_leases!

	I1009 11:52:56.896235    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.4 HWAddress:de:f4:9f:dd:3:a5 ID:1,de:f4:9f:dd:3:a5 Lease:0x6706de52}

	I1009 11:52:56.896271    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.3 HWAddress:6:de:1f:71:7f:2 ID:1,6:de:1f:71:7f:2 Lease:0x6706d000}

	I1009 11:52:56.896346    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:fa:15:2:2:89:77 ID:1,fa:15:2:2:89:77 Lease:0x6706dd99}

	I1009 11:52:56.896380    2345 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:da:98:b3:c0:e3:d9 ID:1,da:98:b3:c0:e3:d9 Lease:0x6706d9ed}

	I1009 11:52:58.898577    2345 main.go:141] libmachine: Attempt 3

	I1009 11:52:58.898619    2345 main.go:141] libmachine: Searching for 62:47:a4:45:59:9e in /var/db/dhcpd_leases ...

	I1009 11:52:58.898766    2345 main.go:141] libmachine: Found 4 entries in /var/db/dhcpd_leases!

	I1009 11:52:58.898781    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.4 HWAddress:de:f4:9f:dd:3:a5 ID:1,de:f4:9f:dd:3:a5 Lease:0x6706de52}

	I1009 11:52:58.898790    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.3 HWAddress:6:de:1f:71:7f:2 ID:1,6:de:1f:71:7f:2 Lease:0x6706d000}

	I1009 11:52:58.898794    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:fa:15:2:2:89:77 ID:1,fa:15:2:2:89:77 Lease:0x6706dd99}

	I1009 11:52:58.898799    2345 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:da:98:b3:c0:e3:d9 ID:1,da:98:b3:c0:e3:d9 Lease:0x6706d9ed}

	I1009 11:53:00.900825    2345 main.go:141] libmachine: Attempt 4

	I1009 11:53:00.900833    2345 main.go:141] libmachine: Searching for 62:47:a4:45:59:9e in /var/db/dhcpd_leases ...

	I1009 11:53:00.900880    2345 main.go:141] libmachine: Found 4 entries in /var/db/dhcpd_leases!

	I1009 11:53:00.900886    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.4 HWAddress:de:f4:9f:dd:3:a5 ID:1,de:f4:9f:dd:3:a5 Lease:0x6706de52}

	I1009 11:53:00.900895    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.3 HWAddress:6:de:1f:71:7f:2 ID:1,6:de:1f:71:7f:2 Lease:0x6706d000}

	I1009 11:53:00.900903    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:fa:15:2:2:89:77 ID:1,fa:15:2:2:89:77 Lease:0x6706dd99}

	I1009 11:53:00.900907    2345 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:da:98:b3:c0:e3:d9 ID:1,da:98:b3:c0:e3:d9 Lease:0x6706d9ed}

	I1009 11:53:02.901953    2345 main.go:141] libmachine: Attempt 5

	I1009 11:53:02.901960    2345 main.go:141] libmachine: Searching for 62:47:a4:45:59:9e in /var/db/dhcpd_leases ...

	I1009 11:53:02.902002    2345 main.go:141] libmachine: Found 4 entries in /var/db/dhcpd_leases!

	I1009 11:53:02.902008    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.4 HWAddress:de:f4:9f:dd:3:a5 ID:1,de:f4:9f:dd:3:a5 Lease:0x6706de52}

	I1009 11:53:02.902014    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.3 HWAddress:6:de:1f:71:7f:2 ID:1,6:de:1f:71:7f:2 Lease:0x6706d000}

	I1009 11:53:02.902019    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:fa:15:2:2:89:77 ID:1,fa:15:2:2:89:77 Lease:0x6706dd99}

	I1009 11:53:02.902024    2345 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:da:98:b3:c0:e3:d9 ID:1,da:98:b3:c0:e3:d9 Lease:0x6706d9ed}

	I1009 11:53:04.904054    2345 main.go:141] libmachine: Attempt 6

	I1009 11:53:04.904079    2345 main.go:141] libmachine: Searching for 62:47:a4:45:59:9e in /var/db/dhcpd_leases ...

	I1009 11:53:04.904167    2345 main.go:141] libmachine: Found 4 entries in /var/db/dhcpd_leases!

	I1009 11:53:04.904180    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.4 HWAddress:de:f4:9f:dd:3:a5 ID:1,de:f4:9f:dd:3:a5 Lease:0x6706de52}

	I1009 11:53:04.904186    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.3 HWAddress:6:de:1f:71:7f:2 ID:1,6:de:1f:71:7f:2 Lease:0x6706d000}

	I1009 11:53:04.904191    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:fa:15:2:2:89:77 ID:1,fa:15:2:2:89:77 Lease:0x6706dd99}

	I1009 11:53:04.904195    2345 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:da:98:b3:c0:e3:d9 ID:1,da:98:b3:c0:e3:d9 Lease:0x6706d9ed}

	I1009 11:53:06.906254    2345 main.go:141] libmachine: Attempt 7

	I1009 11:53:06.906319    2345 main.go:141] libmachine: Searching for 62:47:a4:45:59:9e in /var/db/dhcpd_leases ...

	I1009 11:53:06.906461    2345 main.go:141] libmachine: Found 5 entries in /var/db/dhcpd_leases!

	I1009 11:53:06.906484    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.5 HWAddress:62:47:a4:45:59:9e ID:1,62:47:a4:45:59:9e Lease:0x6706df21}

	I1009 11:53:06.906487    2345 main.go:141] libmachine: Found match: 62:47:a4:45:59:9e

	I1009 11:53:06.906497    2345 main.go:141] libmachine: IP: 192.168.105.5

	I1009 11:53:06.906501    2345 main.go:141] libmachine: Waiting for VM to start (ssh -p 22 docker@192.168.105.5)...

	I1009 11:58:52.480573    2345 start.go:128] duration metric: took 6m0.027171167s to createHost

	I1009 11:58:52.480660    2345 start.go:83] releasing machines lock for "ha-845000", held for 6m0.0273465s

	W1009 11:58:52.481344    2345 start.go:714] error starting host: creating host: create host timed out in 360.000000 seconds

	I1009 11:58:52.491814    2345 out.go:177] * Deleting "ha-845000" in qemu2 ...

	W1009 11:58:52.533419    2345 out.go:270] ! StartHost failed, but will try again: creating host: create host timed out in 360.000000 seconds

	! StartHost failed, but will try again: creating host: create host timed out in 360.000000 seconds

	I1009 11:58:52.533453    2345 start.go:729] Will try again in 5 seconds ...

	I1009 11:58:57.535617    2345 start.go:360] acquireMachinesLock for ha-845000: {Name:mk6dc29eb74286120c58954bae0cd65a85a89b02 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1009 11:58:57.536254    2345 start.go:364] duration metric: took 521.667µs to acquireMachinesLock for "ha-845000"

	I1009 11:58:57.536399    2345 start.go:93] Provisioning new machine with config: &{Name:ha-845000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19774/minikube-v1.34.0-1728382514-19774-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernet

esVersion:v1.31.1 ClusterName:ha-845000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0

MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1009 11:58:57.536686    2345 start.go:125] createHost starting for "" (driver="qemu2")

	I1009 11:58:57.541306    2345 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I1009 11:58:57.592290    2345 start.go:159] libmachine.API.Create for "ha-845000" (driver="qemu2")

	I1009 11:58:57.592339    2345 client.go:168] LocalClient.Create starting

	I1009 11:58:57.592499    2345 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19780-1164/.minikube/certs/ca.pem

	I1009 11:58:57.592580    2345 main.go:141] libmachine: Decoding PEM data...

	I1009 11:58:57.592606    2345 main.go:141] libmachine: Parsing certificate...

	I1009 11:58:57.592675    2345 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19780-1164/.minikube/certs/cert.pem

	I1009 11:58:57.592731    2345 main.go:141] libmachine: Decoding PEM data...

	I1009 11:58:57.592750    2345 main.go:141] libmachine: Parsing certificate...

	I1009 11:58:57.593335    2345 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19780-1164/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19780-1164/.minikube/cache/iso/arm64/minikube-v1.34.0-1728382514-19774-arm64.iso...

	I1009 11:58:57.747565    2345 main.go:141] libmachine: Creating SSH key...

	I1009 11:58:57.779389    2345 main.go:141] libmachine: Creating Disk image...

	I1009 11:58:57.779395    2345 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I1009 11:58:57.779581    2345 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/ha-845000/disk.qcow2.raw /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/ha-845000/disk.qcow2

	I1009 11:58:57.789409    2345 main.go:141] libmachine: STDOUT: 

	I1009 11:58:57.789437    2345 main.go:141] libmachine: STDERR: 

	I1009 11:58:57.789502    2345 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/ha-845000/disk.qcow2 +20000M

	I1009 11:58:57.798102    2345 main.go:141] libmachine: STDOUT: Image resized.

	I1009 11:58:57.798119    2345 main.go:141] libmachine: STDERR: 

	I1009 11:58:57.798135    2345 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/ha-845000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/ha-845000/disk.qcow2

	I1009 11:58:57.798140    2345 main.go:141] libmachine: Starting QEMU VM...

	I1009 11:58:57.798146    2345 qemu.go:418] Using hvf for hardware acceleration

	I1009 11:58:57.798191    2345 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/ha-845000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19780-1164/.minikube/machines/ha-845000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/ha-845000/qemu.pid -device virtio-net-pci,netdev=net0,mac=da:d5:b1:e5:38:54 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/ha-845000/disk.qcow2

	I1009 11:58:57.834754    2345 main.go:141] libmachine: STDOUT: 

	I1009 11:58:57.834783    2345 main.go:141] libmachine: STDERR: 

	I1009 11:58:57.834787    2345 main.go:141] libmachine: Attempt 0

	I1009 11:58:57.834800    2345 main.go:141] libmachine: Searching for da:d5:b1:e5:38:54 in /var/db/dhcpd_leases ...

	I1009 11:58:57.834917    2345 main.go:141] libmachine: Found 5 entries in /var/db/dhcpd_leases!

	I1009 11:58:57.834928    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.5 HWAddress:62:47:a4:45:59:9e ID:1,62:47:a4:45:59:9e Lease:0x6706df21}

	I1009 11:58:57.834938    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.4 HWAddress:de:f4:9f:dd:3:a5 ID:1,de:f4:9f:dd:3:a5 Lease:0x6706de52}

	I1009 11:58:57.834944    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.3 HWAddress:6:de:1f:71:7f:2 ID:1,6:de:1f:71:7f:2 Lease:0x6706d000}

	I1009 11:58:57.834959    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:fa:15:2:2:89:77 ID:1,fa:15:2:2:89:77 Lease:0x6706dd99}

	I1009 11:58:57.834967    2345 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:da:98:b3:c0:e3:d9 ID:1,da:98:b3:c0:e3:d9 Lease:0x6706d9ed}

	I1009 11:58:59.837110    2345 main.go:141] libmachine: Attempt 1

	I1009 11:58:59.837201    2345 main.go:141] libmachine: Searching for da:d5:b1:e5:38:54 in /var/db/dhcpd_leases ...

	I1009 11:58:59.837708    2345 main.go:141] libmachine: Found 5 entries in /var/db/dhcpd_leases!

	I1009 11:58:59.837760    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.5 HWAddress:62:47:a4:45:59:9e ID:1,62:47:a4:45:59:9e Lease:0x6706df21}

	I1009 11:58:59.837790    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.4 HWAddress:de:f4:9f:dd:3:a5 ID:1,de:f4:9f:dd:3:a5 Lease:0x6706de52}

	I1009 11:58:59.837819    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.3 HWAddress:6:de:1f:71:7f:2 ID:1,6:de:1f:71:7f:2 Lease:0x6706d000}

	I1009 11:58:59.837852    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:fa:15:2:2:89:77 ID:1,fa:15:2:2:89:77 Lease:0x6706dd99}

	I1009 11:58:59.837884    2345 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:da:98:b3:c0:e3:d9 ID:1,da:98:b3:c0:e3:d9 Lease:0x6706d9ed}

	I1009 11:59:01.838487    2345 main.go:141] libmachine: Attempt 2

	I1009 11:59:01.838565    2345 main.go:141] libmachine: Searching for da:d5:b1:e5:38:54 in /var/db/dhcpd_leases ...

	I1009 11:59:01.839143    2345 main.go:141] libmachine: Found 5 entries in /var/db/dhcpd_leases!

	I1009 11:59:01.839198    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.5 HWAddress:62:47:a4:45:59:9e ID:1,62:47:a4:45:59:9e Lease:0x6706df21}

	I1009 11:59:01.839228    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.4 HWAddress:de:f4:9f:dd:3:a5 ID:1,de:f4:9f:dd:3:a5 Lease:0x6706de52}

	I1009 11:59:01.839256    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.3 HWAddress:6:de:1f:71:7f:2 ID:1,6:de:1f:71:7f:2 Lease:0x6706d000}

	I1009 11:59:01.839298    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:fa:15:2:2:89:77 ID:1,fa:15:2:2:89:77 Lease:0x6706dd99}

	I1009 11:59:01.839325    2345 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:da:98:b3:c0:e3:d9 ID:1,da:98:b3:c0:e3:d9 Lease:0x6706d9ed}

	I1009 11:59:03.841360    2345 main.go:141] libmachine: Attempt 3

	I1009 11:59:03.841439    2345 main.go:141] libmachine: Searching for da:d5:b1:e5:38:54 in /var/db/dhcpd_leases ...

	I1009 11:59:03.841575    2345 main.go:141] libmachine: Found 5 entries in /var/db/dhcpd_leases!

	I1009 11:59:03.841588    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.5 HWAddress:62:47:a4:45:59:9e ID:1,62:47:a4:45:59:9e Lease:0x6706df21}

	I1009 11:59:03.841598    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.4 HWAddress:de:f4:9f:dd:3:a5 ID:1,de:f4:9f:dd:3:a5 Lease:0x6706de52}

	I1009 11:59:03.841604    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.3 HWAddress:6:de:1f:71:7f:2 ID:1,6:de:1f:71:7f:2 Lease:0x6706d000}

	I1009 11:59:03.841610    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:fa:15:2:2:89:77 ID:1,fa:15:2:2:89:77 Lease:0x6706dd99}

	I1009 11:59:03.841617    2345 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:da:98:b3:c0:e3:d9 ID:1,da:98:b3:c0:e3:d9 Lease:0x6706d9ed}

	I1009 11:59:05.843640    2345 main.go:141] libmachine: Attempt 4

	I1009 11:59:05.843652    2345 main.go:141] libmachine: Searching for da:d5:b1:e5:38:54 in /var/db/dhcpd_leases ...

	I1009 11:59:05.843697    2345 main.go:141] libmachine: Found 5 entries in /var/db/dhcpd_leases!

	I1009 11:59:05.843706    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.5 HWAddress:62:47:a4:45:59:9e ID:1,62:47:a4:45:59:9e Lease:0x6706df21}

	I1009 11:59:05.843713    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.4 HWAddress:de:f4:9f:dd:3:a5 ID:1,de:f4:9f:dd:3:a5 Lease:0x6706de52}

	I1009 11:59:05.843718    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.3 HWAddress:6:de:1f:71:7f:2 ID:1,6:de:1f:71:7f:2 Lease:0x6706d000}

	I1009 11:59:05.843723    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:fa:15:2:2:89:77 ID:1,fa:15:2:2:89:77 Lease:0x6706dd99}

	I1009 11:59:05.843727    2345 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:da:98:b3:c0:e3:d9 ID:1,da:98:b3:c0:e3:d9 Lease:0x6706d9ed}

	I1009 11:59:07.845741    2345 main.go:141] libmachine: Attempt 5

	I1009 11:59:07.845752    2345 main.go:141] libmachine: Searching for da:d5:b1:e5:38:54 in /var/db/dhcpd_leases ...

	I1009 11:59:07.845781    2345 main.go:141] libmachine: Found 5 entries in /var/db/dhcpd_leases!

	I1009 11:59:07.845787    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.5 HWAddress:62:47:a4:45:59:9e ID:1,62:47:a4:45:59:9e Lease:0x6706df21}

	I1009 11:59:07.845791    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.4 HWAddress:de:f4:9f:dd:3:a5 ID:1,de:f4:9f:dd:3:a5 Lease:0x6706de52}

	I1009 11:59:07.845812    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.3 HWAddress:6:de:1f:71:7f:2 ID:1,6:de:1f:71:7f:2 Lease:0x6706d000}

	I1009 11:59:07.845817    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:fa:15:2:2:89:77 ID:1,fa:15:2:2:89:77 Lease:0x6706dd99}

	I1009 11:59:07.845823    2345 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:da:98:b3:c0:e3:d9 ID:1,da:98:b3:c0:e3:d9 Lease:0x6706d9ed}

	I1009 11:59:09.847848    2345 main.go:141] libmachine: Attempt 6

	I1009 11:59:09.847876    2345 main.go:141] libmachine: Searching for da:d5:b1:e5:38:54 in /var/db/dhcpd_leases ...

	I1009 11:59:09.847960    2345 main.go:141] libmachine: Found 5 entries in /var/db/dhcpd_leases!

	I1009 11:59:09.847970    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.5 HWAddress:62:47:a4:45:59:9e ID:1,62:47:a4:45:59:9e Lease:0x6706df21}

	I1009 11:59:09.847976    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.4 HWAddress:de:f4:9f:dd:3:a5 ID:1,de:f4:9f:dd:3:a5 Lease:0x6706de52}

	I1009 11:59:09.847990    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.3 HWAddress:6:de:1f:71:7f:2 ID:1,6:de:1f:71:7f:2 Lease:0x6706d000}

	I1009 11:59:09.847995    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:fa:15:2:2:89:77 ID:1,fa:15:2:2:89:77 Lease:0x6706dd99}

	I1009 11:59:09.848001    2345 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:da:98:b3:c0:e3:d9 ID:1,da:98:b3:c0:e3:d9 Lease:0x6706d9ed}

	I1009 11:59:11.850079    2345 main.go:141] libmachine: Attempt 7

	I1009 11:59:11.850101    2345 main.go:141] libmachine: Searching for da:d5:b1:e5:38:54 in /var/db/dhcpd_leases ...

	I1009 11:59:11.850173    2345 main.go:141] libmachine: Found 6 entries in /var/db/dhcpd_leases!

	I1009 11:59:11.850196    2345 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.6 HWAddress:da:d5:b1:e5:38:54 ID:1,da:d5:b1:e5:38:54 Lease:0x6706e08e}

	I1009 11:59:11.850199    2345 main.go:141] libmachine: Found match: da:d5:b1:e5:38:54

	I1009 11:59:11.850216    2345 main.go:141] libmachine: IP: 192.168.105.6

	I1009 11:59:11.850221    2345 main.go:141] libmachine: Waiting for VM to start (ssh -p 22 docker@192.168.105.6)...

	I1009 12:04:57.590312    2345 start.go:128] duration metric: took 6m0.057926083s to createHost

	I1009 12:04:57.590378    2345 start.go:83] releasing machines lock for "ha-845000", held for 6m0.058455041s

	W1009 12:04:57.590600    2345 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p ha-845000" may fix it: creating host: create host timed out in 360.000000 seconds

	* Failed to start qemu2 VM. Running "minikube delete -p ha-845000" may fix it: creating host: create host timed out in 360.000000 seconds

	I1009 12:04:57.598152    2345 out.go:201] 

	W1009 12:04:57.601275    2345 out.go:270] X Exiting due to DRV_CREATE_TIMEOUT: Failed to start host: creating host: create host timed out in 360.000000 seconds

	X Exiting due to DRV_CREATE_TIMEOUT: Failed to start host: creating host: create host timed out in 360.000000 seconds

	W1009 12:04:57.601362    2345 out.go:270] * Suggestion: Try 'minikube delete', and disable any conflicting VPN or firewall software

	* Suggestion: Try 'minikube delete', and disable any conflicting VPN or firewall software

	W1009 12:04:57.601391    2345 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/7072

	* Related issue: https://github.com/kubernetes/minikube/issues/7072

	I1009 12:04:57.604167    2345 out.go:201] 

** /stderr **

ha_test.go:103: failed to fresh-start ha (multi-control plane) cluster. args "out/minikube-darwin-arm64 start -p ha-845000 --wait=true --memory=2200 --ha -v=7 --alsologtostderr --driver=qemu2 " : exit status 52

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-845000 -n ha-845000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-845000 -n ha-845000: exit status 7 (71.531708ms)

-- stdout --

	Error

-- /stdout --

** stderr ** 

	E1009 12:04:57.695942    2721 status.go:393] failed to get driver ip: parsing IP: 

	E1009 12:04:57.695949    2721 status.go:119] status error: parsing IP: 

** /stderr **

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "ha-845000" host is not running, skipping log retrieval (state="Error")

--- FAIL: TestMultiControlPlane/serial/StartCluster (725.39s)

=== RUN   TestMultiControlPlane/serial/DeployApp

ha_test.go:128: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-845000 -- apply -f ./testdata/ha/ha-pod-dns-test.yaml

ha_test.go:128: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p ha-845000 -- apply -f ./testdata/ha/ha-pod-dns-test.yaml: exit status 1 (69.568084ms)

** stderr ** 

	error: cluster "ha-845000" does not exist

** /stderr **

ha_test.go:130: failed to create busybox deployment to ha (multi-control plane) cluster

ha_test.go:133: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-845000 -- rollout status deployment/busybox

ha_test.go:133: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p ha-845000 -- rollout status deployment/busybox: exit status 1 (63.192542ms)

** stderr ** 

	error: no server found for cluster "ha-845000"

** /stderr **

ha_test.go:135: failed to deploy busybox to ha (multi-control plane) cluster

ha_test.go:140: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-845000 -- get pods -o jsonpath='{.items[*].status.podIP}'

ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p ha-845000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (62.321125ms)

** stderr ** 

	error: no server found for cluster "ha-845000"

** /stderr **

ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1

I1009 12:04:57.892422    1686 retry.go:31] will retry after 958.928882ms: failed to retrieve Pod IPs (may be temporary): exit status 1

ha_test.go:140: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-845000 -- get pods -o jsonpath='{.items[*].status.podIP}'

ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p ha-845000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (107.800541ms)

** stderr ** 

	error: no server found for cluster "ha-845000"

** /stderr **

ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1

I1009 12:04:58.961513    1686 retry.go:31] will retry after 2.052877222s: failed to retrieve Pod IPs (may be temporary): exit status 1

ha_test.go:140: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-845000 -- get pods -o jsonpath='{.items[*].status.podIP}'

ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p ha-845000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (109.658292ms)

** stderr ** 

	error: no server found for cluster "ha-845000"

** /stderr **

ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1

I1009 12:05:01.126383    1686 retry.go:31] will retry after 2.952611142s: failed to retrieve Pod IPs (may be temporary): exit status 1

ha_test.go:140: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-845000 -- get pods -o jsonpath='{.items[*].status.podIP}'

ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p ha-845000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (108.3245ms)

** stderr ** 

	error: no server found for cluster "ha-845000"

** /stderr **

ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1

I1009 12:05:04.189675    1686 retry.go:31] will retry after 1.82468941s: failed to retrieve Pod IPs (may be temporary): exit status 1

ha_test.go:140: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-845000 -- get pods -o jsonpath='{.items[*].status.podIP}'

ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p ha-845000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (103.103833ms)

** stderr ** 

	error: no server found for cluster "ha-845000"

** /stderr **

ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1

I1009 12:05:06.119735    1686 retry.go:31] will retry after 6.758554306s: failed to retrieve Pod IPs (may be temporary): exit status 1

ha_test.go:140: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-845000 -- get pods -o jsonpath='{.items[*].status.podIP}'

ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p ha-845000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (108.466917ms)

** stderr ** 

	error: no server found for cluster "ha-845000"

** /stderr **

ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1

I1009 12:05:12.989128    1686 retry.go:31] will retry after 5.349976576s: failed to retrieve Pod IPs (may be temporary): exit status 1

ha_test.go:140: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-845000 -- get pods -o jsonpath='{.items[*].status.podIP}'

ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p ha-845000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (108.837458ms)

** stderr ** 

	error: no server found for cluster "ha-845000"

** /stderr **

ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1

I1009 12:05:18.450300    1686 retry.go:31] will retry after 11.784852596s: failed to retrieve Pod IPs (may be temporary): exit status 1

ha_test.go:140: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-845000 -- get pods -o jsonpath='{.items[*].status.podIP}'

ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p ha-845000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (111.151209ms)

** stderr ** 

	error: no server found for cluster "ha-845000"

** /stderr **

ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1

I1009 12:05:30.348505    1686 retry.go:31] will retry after 17.261510358s: failed to retrieve Pod IPs (may be temporary): exit status 1

ha_test.go:140: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-845000 -- get pods -o jsonpath='{.items[*].status.podIP}'

ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p ha-845000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (107.936334ms)

** stderr ** 

	error: no server found for cluster "ha-845000"

** /stderr **

ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1

I1009 12:05:47.720265    1686 retry.go:31] will retry after 16.619877644s: failed to retrieve Pod IPs (may be temporary): exit status 1

ha_test.go:140: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-845000 -- get pods -o jsonpath='{.items[*].status.podIP}'

ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p ha-845000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (108.646083ms)

** stderr ** 

	error: no server found for cluster "ha-845000"

** /stderr **

ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1

I1009 12:06:04.451142    1686 retry.go:31] will retry after 50.637462036s: failed to retrieve Pod IPs (may be temporary): exit status 1

ha_test.go:140: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-845000 -- get pods -o jsonpath='{.items[*].status.podIP}'

ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p ha-845000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (109.175375ms)

** stderr ** 

	error: no server found for cluster "ha-845000"

** /stderr **

ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1

ha_test.go:159: failed to resolve pod IPs: failed to retrieve Pod IPs (may be temporary): exit status 1

ha_test.go:163: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-845000 -- get pods -o jsonpath='{.items[*].metadata.name}'

ha_test.go:163: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p ha-845000 -- get pods -o jsonpath='{.items[*].metadata.name}': exit status 1 (61.653667ms)

** stderr ** 

	error: no server found for cluster "ha-845000"

** /stderr **

ha_test.go:165: failed get Pod names

ha_test.go:171: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-845000 -- exec  -- nslookup kubernetes.io

ha_test.go:171: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p ha-845000 -- exec  -- nslookup kubernetes.io: exit status 1 (62.057291ms)

** stderr ** 

	error: no server found for cluster "ha-845000"

** /stderr **

ha_test.go:173: Pod  could not resolve 'kubernetes.io': exit status 1

ha_test.go:181: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-845000 -- exec  -- nslookup kubernetes.default

ha_test.go:181: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p ha-845000 -- exec  -- nslookup kubernetes.default: exit status 1 (62.851ms)

** stderr ** 

	error: no server found for cluster "ha-845000"

** /stderr **

ha_test.go:183: Pod  could not resolve 'kubernetes.default': exit status 1

ha_test.go:189: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-845000 -- exec  -- nslookup kubernetes.default.svc.cluster.local

ha_test.go:189: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p ha-845000 -- exec  -- nslookup kubernetes.default.svc.cluster.local: exit status 1 (62.458625ms)

** stderr ** 

	error: no server found for cluster "ha-845000"

** /stderr **

ha_test.go:191: Pod  could not resolve local service (kubernetes.default.svc.cluster.local): exit status 1

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-845000 -n ha-845000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-845000 -n ha-845000: exit status 7 (35.29425ms)

-- stdout --

	Error

-- /stdout --

** stderr ** 

	E1009 12:06:55.483591    2788 status.go:393] failed to get driver ip: parsing IP: 

	E1009 12:06:55.483603    2788 status.go:119] status error: parsing IP: 

** /stderr **

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "ha-845000" host is not running, skipping log retrieval (state="Error")

--- FAIL: TestMultiControlPlane/serial/DeployApp (117.79s)

=== RUN   TestMultiControlPlane/serial/PingHostFromPods

ha_test.go:199: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p ha-845000 -- get pods -o jsonpath='{.items[*].metadata.name}'

ha_test.go:199: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p ha-845000 -- get pods -o jsonpath='{.items[*].metadata.name}': exit status 1 (61.450917ms)

** stderr ** 

	error: no server found for cluster "ha-845000"

** /stderr **

ha_test.go:201: failed to get Pod names: exit status 1

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-845000 -n ha-845000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-845000 -n ha-845000: exit status 7 (35.144958ms)

-- stdout --

	Error

-- /stdout --

** stderr ** 

	E1009 12:06:55.580395    2793 status.go:393] failed to get driver ip: parsing IP: 

	E1009 12:06:55.580400    2793 status.go:119] status error: parsing IP: 

** /stderr **

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "ha-845000" host is not running, skipping log retrieval (state="Error")

--- FAIL: TestMultiControlPlane/serial/PingHostFromPods (0.10s)

=== RUN   TestMultiControlPlane/serial/AddWorkerNode

ha_test.go:228: (dbg) Run:  out/minikube-darwin-arm64 node add -p ha-845000 -v=7 --alsologtostderr

ha_test.go:228: (dbg) Non-zero exit: out/minikube-darwin-arm64 node add -p ha-845000 -v=7 --alsologtostderr: exit status 50 (50.568792ms)

-- stdout --

-- /stdout --

** stderr ** 

	I1009 12:06:55.613553    2795 out.go:345] Setting OutFile to fd 1 ...

	I1009 12:06:55.613808    2795 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:06:55.613811    2795 out.go:358] Setting ErrFile to fd 2...

	I1009 12:06:55.613814    2795 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:06:55.613950    2795 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19780-1164/.minikube/bin

	I1009 12:06:55.614177    2795 mustload.go:65] Loading cluster: ha-845000

	I1009 12:06:55.614386    2795 config.go:182] Loaded profile config "ha-845000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I1009 12:06:55.615089    2795 host.go:66] Checking if "ha-845000" exists ...

	I1009 12:06:55.620210    2795 out.go:201] 

	W1009 12:06:55.623177    2795 out.go:270] X Exiting due to DRV_CP_ENDPOINT: Unable to get control-plane node ha-845000 endpoint: failed to lookup ip for ""

	X Exiting due to DRV_CP_ENDPOINT: Unable to get control-plane node ha-845000 endpoint: failed to lookup ip for ""

	W1009 12:06:55.623201    2795 out.go:270] * Suggestion: 

	    Recreate the cluster by running:

	    minikube delete <no value>

	    minikube start <no value>

	* Suggestion: 

	    Recreate the cluster by running:

	    minikube delete <no value>

	    minikube start <no value>

	I1009 12:06:55.627208    2795 out.go:201] 

** /stderr **

ha_test.go:230: failed to add worker node to current ha (multi-control plane) cluster. args "out/minikube-darwin-arm64 node add -p ha-845000 -v=7 --alsologtostderr" : exit status 50

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-845000 -n ha-845000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-845000 -n ha-845000: exit status 7 (34.888583ms)

-- stdout --

	Error

-- /stdout --

** stderr ** 

	E1009 12:06:55.666128    2797 status.go:393] failed to get driver ip: parsing IP: 

	E1009 12:06:55.666141    2797 status.go:119] status error: parsing IP: 

** /stderr **

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "ha-845000" host is not running, skipping log retrieval (state="Error")

--- FAIL: TestMultiControlPlane/serial/AddWorkerNode (0.09s)

=== RUN   TestMultiControlPlane/serial/NodeLabels

ha_test.go:255: (dbg) Run:  kubectl --context ha-845000 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]"

ha_test.go:255: (dbg) Non-zero exit: kubectl --context ha-845000 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]": exit status 1 (27.192708ms)

** stderr ** 

	Error in configuration: context was not found for specified context: ha-845000

** /stderr **

ha_test.go:257: failed to 'kubectl get nodes' with args "kubectl --context ha-845000 get nodes -o \"jsonpath=[{range .items[*]}{.metadata.labels},{end}]\"": exit status 1

ha_test.go:264: failed to decode json from label list: args "kubectl --context ha-845000 get nodes -o \"jsonpath=[{range .items[*]}{.metadata.labels},{end}]\"": unexpected end of JSON input

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-845000 -n ha-845000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-845000 -n ha-845000: exit status 7 (35.51125ms)

-- stdout --

	Error

-- /stdout --

** stderr ** 

	E1009 12:06:55.729170    2800 status.go:393] failed to get driver ip: parsing IP: 

	E1009 12:06:55.729177    2800 status.go:119] status error: parsing IP: 

** /stderr **

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "ha-845000" host is not running, skipping log retrieval (state="Error")

--- FAIL: TestMultiControlPlane/serial/NodeLabels (0.06s)

=== RUN   TestMultiControlPlane/serial/HAppyAfterClusterStart

ha_test.go:281: (dbg) Run:  out/minikube-darwin-arm64 profile list --output json

ha_test.go:305: expected profile "ha-845000" in json of 'profile list' to include 4 nodes but have 1 nodes. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-845000\",\"Status\":\"Unknown\",\"Config\":{\"Name\":\"ha-845000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/19774/minikube-v1.34.0-1728382514-19774-arm64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"qemu2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\":1,\"APIServerPo

rt\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.31.1\",\"ClusterName\":\"ha-845000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.1\",\"ContainerRu

ntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"socket_vmnet\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"/opt/socket_vmnet/bin/socket_vmnet_client\",\"SocketVMnetPath\":\"/var/run/socket_vmnet\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHA

gentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":false}]}"*. args: "out/minikube-darwin-arm64 profile list --output json"

ha_test.go:309: expected profile "ha-845000" in json of 'profile list' to have "HAppy" status but have "Unknown" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-845000\",\"Status\":\"Unknown\",\"Config\":{\"Name\":\"ha-845000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/19774/minikube-v1.34.0-1728382514-19774-arm64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"qemu2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\":1,

\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.31.1\",\"ClusterName\":\"ha-845000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.1\",

\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"socket_vmnet\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"/opt/socket_vmnet/bin/socket_vmnet_client\",\"SocketVMnetPath\":\"/var/run/socket_vmnet\",\"StaticIP\":\"\",\"SSHAuthSock\

":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":false}]}"*. args: "out/minikube-darwin-arm64 profile list --output json"

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-845000 -n ha-845000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-845000 -n ha-845000: exit status 7 (35.268125ms)

-- stdout --

	Error

-- /stdout --

** stderr ** 

	E1009 12:06:55.816742    2805 status.go:393] failed to get driver ip: parsing IP: 

	E1009 12:06:55.816750    2805 status.go:119] status error: parsing IP: 

** /stderr **

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "ha-845000" host is not running, skipping log retrieval (state="Error")

--- FAIL: TestMultiControlPlane/serial/HAppyAfterClusterStart (0.09s)

=== RUN   TestMultiControlPlane/serial/StopSecondaryNode

ha_test.go:365: (dbg) Run:  out/minikube-darwin-arm64 -p ha-845000 node stop m02 -v=7 --alsologtostderr

ha_test.go:365: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-845000 node stop m02 -v=7 --alsologtostderr: exit status 85 (51.39875ms)

-- stdout --

-- /stdout --

** stderr ** 

	I1009 12:06:55.886623    2809 out.go:345] Setting OutFile to fd 1 ...

	I1009 12:06:55.886910    2809 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:06:55.886913    2809 out.go:358] Setting ErrFile to fd 2...

	I1009 12:06:55.886915    2809 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:06:55.887041    2809 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19780-1164/.minikube/bin

	I1009 12:06:55.887287    2809 mustload.go:65] Loading cluster: ha-845000

	I1009 12:06:55.887506    2809 config.go:182] Loaded profile config "ha-845000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I1009 12:06:55.891212    2809 out.go:201] 

	W1009 12:06:55.894201    2809 out.go:270] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m02

	X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m02

	W1009 12:06:55.894206    2809 out.go:270] * 

	* 

	W1009 12:06:55.895630    2809 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                         │

	│    * If the above advice does not help, please let us know:                                                             │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

	│                                                                                                                         │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

	│    * Please also attach the following file to the GitHub issue:                                                         │

	│    * - /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube_node_8ce24bb09be8aab84076d51946735f62cbf80299_0.log    │

	│                                                                                                                         │

	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                         │

	│    * If the above advice does not help, please let us know:                                                             │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

	│                                                                                                                         │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

	│    * Please also attach the following file to the GitHub issue:                                                         │

	│    * - /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube_node_8ce24bb09be8aab84076d51946735f62cbf80299_0.log    │

	│                                                                                                                         │

	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	I1009 12:06:55.900128    2809 out.go:201] 

** /stderr **

ha_test.go:367: secondary control-plane node stop returned an error. args "out/minikube-darwin-arm64 -p ha-845000 node stop m02 -v=7 --alsologtostderr": exit status 85

ha_test.go:371: (dbg) Run:  out/minikube-darwin-arm64 -p ha-845000 status -v=7 --alsologtostderr

ha_test.go:377: status says not all three control-plane nodes are present: args "out/minikube-darwin-arm64 -p ha-845000 status -v=7 --alsologtostderr": 

ha_test.go:380: status says not three hosts are running: args "out/minikube-darwin-arm64 -p ha-845000 status -v=7 --alsologtostderr": 

ha_test.go:383: status says not three kubelets are running: args "out/minikube-darwin-arm64 -p ha-845000 status -v=7 --alsologtostderr": 

ha_test.go:386: status says not two apiservers are running: args "out/minikube-darwin-arm64 -p ha-845000 status -v=7 --alsologtostderr": 

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-845000 -n ha-845000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-845000 -n ha-845000: exit status 7 (34.685125ms)

-- stdout --

	Error

-- /stdout --

** stderr ** 

	E1009 12:06:55.973717    2813 status.go:393] failed to get driver ip: parsing IP: 

	E1009 12:06:55.973725    2813 status.go:119] status error: parsing IP: 

** /stderr **

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "ha-845000" host is not running, skipping log retrieval (state="Error")

--- FAIL: TestMultiControlPlane/serial/StopSecondaryNode (0.12s)

=== RUN   TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop

ha_test.go:392: (dbg) Run:  out/minikube-darwin-arm64 profile list --output json

ha_test.go:415: expected profile "ha-845000" in json of 'profile list' to have "Degraded" status but have "Unknown" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-845000\",\"Status\":\"Unknown\",\"Config\":{\"Name\":\"ha-845000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/19774/minikube-v1.34.0-1728382514-19774-arm64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"qemu2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\"

:1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.31.1\",\"ClusterName\":\"ha-845000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.1

\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"socket_vmnet\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"/opt/socket_vmnet/bin/socket_vmnet_client\",\"SocketVMnetPath\":\"/var/run/socket_vmnet\",\"StaticIP\":\"\",\"SSHAuthSo

ck\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":false}]}"*. args: "out/minikube-darwin-arm64 profile list --output json"

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-845000 -n ha-845000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-845000 -n ha-845000: exit status 7 (35.451125ms)

-- stdout --

	Error

-- /stdout --

** stderr ** 

	E1009 12:06:56.061568    2818 status.go:393] failed to get driver ip: parsing IP: 

	E1009 12:06:56.061578    2818 status.go:119] status error: parsing IP: 

** /stderr **

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "ha-845000" host is not running, skipping log retrieval (state="Error")

--- FAIL: TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop (0.09s)

=== RUN   TestMultiControlPlane/serial/RestartSecondaryNode

ha_test.go:422: (dbg) Run:  out/minikube-darwin-arm64 -p ha-845000 node start m02 -v=7 --alsologtostderr

ha_test.go:422: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-845000 node start m02 -v=7 --alsologtostderr: exit status 85 (50.445708ms)

-- stdout --

-- /stdout --

** stderr ** 

	I1009 12:06:56.094650    2820 out.go:345] Setting OutFile to fd 1 ...

	I1009 12:06:56.094921    2820 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:06:56.094925    2820 out.go:358] Setting ErrFile to fd 2...

	I1009 12:06:56.094927    2820 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:06:56.095060    2820 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19780-1164/.minikube/bin

	I1009 12:06:56.095335    2820 mustload.go:65] Loading cluster: ha-845000

	I1009 12:06:56.095543    2820 config.go:182] Loaded profile config "ha-845000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I1009 12:06:56.100226    2820 out.go:201] 

	W1009 12:06:56.103225    2820 out.go:270] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m02

	X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m02

	W1009 12:06:56.103242    2820 out.go:270] * 

	* 

	W1009 12:06:56.104653    2820 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                         │

	│    * If the above advice does not help, please let us know:                                                             │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

	│                                                                                                                         │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

	│    * Please also attach the following file to the GitHub issue:                                                         │

	│    * - /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │

	│                                                                                                                         │

	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                         │

	│    * If the above advice does not help, please let us know:                                                             │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

	│                                                                                                                         │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

	│    * Please also attach the following file to the GitHub issue:                                                         │

	│    * - /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │

	│                                                                                                                         │

	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	I1009 12:06:56.108132    2820 out.go:201] 

** /stderr **

ha_test.go:424: I1009 12:06:56.094650    2820 out.go:345] Setting OutFile to fd 1 ...

I1009 12:06:56.094921    2820 out.go:392] TERM=,COLORTERM=, which probably does not support color

I1009 12:06:56.094925    2820 out.go:358] Setting ErrFile to fd 2...

I1009 12:06:56.094927    2820 out.go:392] TERM=,COLORTERM=, which probably does not support color

I1009 12:06:56.095060    2820 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19780-1164/.minikube/bin

I1009 12:06:56.095335    2820 mustload.go:65] Loading cluster: ha-845000

I1009 12:06:56.095543    2820 config.go:182] Loaded profile config "ha-845000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

I1009 12:06:56.100226    2820 out.go:201] 

W1009 12:06:56.103225    2820 out.go:270] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m02

X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m02

W1009 12:06:56.103242    2820 out.go:270] * 

* 

W1009 12:06:56.104653    2820 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

│                                                                                                                         │

│    * If the above advice does not help, please let us know:                                                             │

│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

│                                                                                                                         │

│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

│    * Please also attach the following file to the GitHub issue:                                                         │

│    * - /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │

│                                                                                                                         │

╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

│                                                                                                                         │

│    * If the above advice does not help, please let us know:                                                             │

│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

│                                                                                                                         │

│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

│    * Please also attach the following file to the GitHub issue:                                                         │

│    * - /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │

│                                                                                                                         │

╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

I1009 12:06:56.108132    2820 out.go:201] 

ha_test.go:425: secondary control-plane node start returned an error. args "out/minikube-darwin-arm64 -p ha-845000 node start m02 -v=7 --alsologtostderr": exit status 85

ha_test.go:430: (dbg) Run:  out/minikube-darwin-arm64 -p ha-845000 status -v=7 --alsologtostderr

ha_test.go:437: status says not all three control-plane nodes are present: args "out/minikube-darwin-arm64 -p ha-845000 status -v=7 --alsologtostderr": 

ha_test.go:440: status says not all four hosts are running: args "out/minikube-darwin-arm64 -p ha-845000 status -v=7 --alsologtostderr": 

ha_test.go:443: status says not all four kubelets are running: args "out/minikube-darwin-arm64 -p ha-845000 status -v=7 --alsologtostderr": 

ha_test.go:446: status says not all three apiservers are running: args "out/minikube-darwin-arm64 -p ha-845000 status -v=7 --alsologtostderr": 

ha_test.go:450: (dbg) Run:  kubectl get nodes

E1009 12:06:56.170121    1686 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/functional-517000/client.crt: no such file or directory" logger="UnhandledError"

ha_test.go:450: (dbg) Non-zero exit: kubectl get nodes: exit status 1 (32.846666ms)

** stderr ** 

	E1009 12:06:56.176903    2825 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused

	E1009 12:06:56.177393    2825 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused

	E1009 12:06:56.178495    2825 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused

	E1009 12:06:56.178790    2825 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused

	E1009 12:06:56.180118    2825 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connect: connection refused

	The connection to the server localhost:8080 was refused - did you specify the right host or port?

** /stderr **

ha_test.go:452: failed to kubectl get nodes. args "kubectl get nodes" : exit status 1

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-845000 -n ha-845000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-845000 -n ha-845000: exit status 7 (35.610875ms)

-- stdout --

	Error

-- /stdout --

** stderr ** 

	E1009 12:06:56.215610    2828 status.go:393] failed to get driver ip: parsing IP: 

	E1009 12:06:56.215616    2828 status.go:119] status error: parsing IP: 

** /stderr **

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "ha-845000" host is not running, skipping log retrieval (state="Error")

--- FAIL: TestMultiControlPlane/serial/RestartSecondaryNode (0.15s)

=== RUN   TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart

ha_test.go:281: (dbg) Run:  out/minikube-darwin-arm64 profile list --output json

ha_test.go:305: expected profile "ha-845000" in json of 'profile list' to include 4 nodes but have 1 nodes. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-845000\",\"Status\":\"Unknown\",\"Config\":{\"Name\":\"ha-845000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/19774/minikube-v1.34.0-1728382514-19774-arm64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"qemu2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\":1,\"APIServerPo

rt\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.31.1\",\"ClusterName\":\"ha-845000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.1\",\"ContainerRu

ntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"socket_vmnet\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"/opt/socket_vmnet/bin/socket_vmnet_client\",\"SocketVMnetPath\":\"/var/run/socket_vmnet\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHA

gentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":false}]}"*. args: "out/minikube-darwin-arm64 profile list --output json"

ha_test.go:309: expected profile "ha-845000" in json of 'profile list' to have "HAppy" status but have "Unknown" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-845000\",\"Status\":\"Unknown\",\"Config\":{\"Name\":\"ha-845000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/19774/minikube-v1.34.0-1728382514-19774-arm64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"qemu2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\":1,

\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.31.1\",\"ClusterName\":\"ha-845000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.1\",

\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"socket_vmnet\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"/opt/socket_vmnet/bin/socket_vmnet_client\",\"SocketVMnetPath\":\"/var/run/socket_vmnet\",\"StaticIP\":\"\",\"SSHAuthSock\

":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":false}]}"*. args: "out/minikube-darwin-arm64 profile list --output json"

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-845000 -n ha-845000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-845000 -n ha-845000: exit status 7 (34.428917ms)

-- stdout --

	Error

-- /stdout --

** stderr ** 

	E1009 12:06:56.304715    2833 status.go:393] failed to get driver ip: parsing IP: 

	E1009 12:06:56.304725    2833 status.go:119] status error: parsing IP: 

** /stderr **

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "ha-845000" host is not running, skipping log retrieval (state="Error")

--- FAIL: TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart (0.09s)

=== RUN   TestMultiControlPlane/serial/RestartClusterKeepsNodes

ha_test.go:458: (dbg) Run:  out/minikube-darwin-arm64 node list -p ha-845000 -v=7 --alsologtostderr

ha_test.go:464: (dbg) Run:  out/minikube-darwin-arm64 stop -p ha-845000 -v=7 --alsologtostderr

ha_test.go:464: (dbg) Done: out/minikube-darwin-arm64 stop -p ha-845000 -v=7 --alsologtostderr: (6.352584917s)

ha_test.go:469: (dbg) Run:  out/minikube-darwin-arm64 start -p ha-845000 --wait=true -v=7 --alsologtostderr

E1009 12:11:56.162036    1686 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/functional-517000/client.crt: no such file or directory" logger="UnhandledError"

E1009 12:13:19.257640    1686 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/functional-517000/client.crt: no such file or directory" logger="UnhandledError"

E1009 12:16:56.158017    1686 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/functional-517000/client.crt: no such file or directory" logger="UnhandledError"

E1009 12:21:56.154048    1686 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/functional-517000/client.crt: no such file or directory" logger="UnhandledError"

ha_test.go:469: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p ha-845000 --wait=true -v=7 --alsologtostderr: signal: killed (15m49.619040125s)

-- stdout --

	* [ha-845000] minikube v1.34.0 on Darwin 15.0.1 (arm64)

	  - MINIKUBE_LOCATION=19780

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19780-1164/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19780-1164/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on existing profile

	* Starting "ha-845000" primary control-plane node in "ha-845000" cluster

	* Restarting existing qemu2 VM for "ha-845000" ...

-- /stdout --

** stderr ** 

	I1009 12:07:02.760402    2857 out.go:345] Setting OutFile to fd 1 ...

	I1009 12:07:02.760580    2857 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:07:02.760584    2857 out.go:358] Setting ErrFile to fd 2...

	I1009 12:07:02.760587    2857 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:07:02.760741    2857 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19780-1164/.minikube/bin

	I1009 12:07:02.761999    2857 out.go:352] Setting JSON to false

	I1009 12:07:02.781646    2857 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":2192,"bootTime":1728498630,"procs":517,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}

	W1009 12:07:02.781713    2857 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I1009 12:07:02.787022    2857 out.go:177] * [ha-845000] minikube v1.34.0 on Darwin 15.0.1 (arm64)

	I1009 12:07:02.794970    2857 out.go:177]   - MINIKUBE_LOCATION=19780

	I1009 12:07:02.795057    2857 notify.go:220] Checking for updates...

	I1009 12:07:02.801941    2857 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19780-1164/kubeconfig

	I1009 12:07:02.804933    2857 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I1009 12:07:02.807857    2857 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1009 12:07:02.810986    2857 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19780-1164/.minikube

	I1009 12:07:02.813960    2857 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I1009 12:07:02.815532    2857 config.go:182] Loaded profile config "ha-845000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I1009 12:07:02.815583    2857 driver.go:394] Setting default libvirt URI to qemu:///system

	I1009 12:07:02.820007    2857 out.go:177] * Using the qemu2 driver based on existing profile

	I1009 12:07:02.826792    2857 start.go:297] selected driver: qemu2

	I1009 12:07:02.826799    2857 start.go:901] validating driver "qemu2" against &{Name:ha-845000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19774/minikube-v1.34.0-1728382514-19774-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesV

ersion:v1.31.1 ClusterName:ha-845000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 Mou

ntType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1009 12:07:02.826854    2857 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I1009 12:07:02.829437    2857 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I1009 12:07:02.829457    2857 cni.go:84] Creating CNI manager for ""

	I1009 12:07:02.829481    2857 cni.go:136] multinode detected (1 nodes found), recommending kindnet

	I1009 12:07:02.829529    2857 start.go:340] cluster config:

	{Name:ha-845000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19774/minikube-v1.34.0-1728382514-19774-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:ha-845000 Namespace:default APIServerHAVIP: APIServe

rName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetri

cs:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1009 12:07:02.833927    2857 iso.go:125] acquiring lock: {Name:mka6a0d59ae6cc32794e4fbfa8e5c6ce6a65e504 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1009 12:07:02.841964    2857 out.go:177] * Starting "ha-845000" primary control-plane node in "ha-845000" cluster

	I1009 12:07:02.845947    2857 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime docker

	I1009 12:07:02.845965    2857 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19780-1164/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4

	I1009 12:07:02.845975    2857 cache.go:56] Caching tarball of preloaded images

	I1009 12:07:02.846058    2857 preload.go:172] Found /Users/jenkins/minikube-integration/19780-1164/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I1009 12:07:02.846064    2857 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on docker

	I1009 12:07:02.846128    2857 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/ha-845000/config.json ...

	I1009 12:07:02.846506    2857 start.go:360] acquireMachinesLock for ha-845000: {Name:mk6dc29eb74286120c58954bae0cd65a85a89b02 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1009 12:07:02.846552    2857 start.go:364] duration metric: took 40.458µs to acquireMachinesLock for "ha-845000"

	I1009 12:07:02.846569    2857 start.go:96] Skipping create...Using existing machine configuration

	I1009 12:07:02.846573    2857 fix.go:54] fixHost starting: 

	I1009 12:07:02.846687    2857 fix.go:112] recreateIfNeeded on ha-845000: state=Stopped err=<nil>

	W1009 12:07:02.846701    2857 fix.go:138] unexpected machine state, will restart: <nil>

	I1009 12:07:02.854893    2857 out.go:177] * Restarting existing qemu2 VM for "ha-845000" ...

	I1009 12:07:02.858926    2857 qemu.go:418] Using hvf for hardware acceleration

	I1009 12:07:02.858972    2857 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/ha-845000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19780-1164/.minikube/machines/ha-845000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/ha-845000/qemu.pid -device virtio-net-pci,netdev=net0,mac=da:d5:b1:e5:38:54 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/ha-845000/disk.qcow2

	I1009 12:07:02.898826    2857 main.go:141] libmachine: STDOUT: 

	I1009 12:07:02.898859    2857 main.go:141] libmachine: STDERR: 

	I1009 12:07:02.898864    2857 main.go:141] libmachine: Attempt 0

	I1009 12:07:02.898876    2857 main.go:141] libmachine: Searching for da:d5:b1:e5:38:54 in /var/db/dhcpd_leases ...

	I1009 12:07:02.898987    2857 main.go:141] libmachine: Found 6 entries in /var/db/dhcpd_leases!

	I1009 12:07:02.899008    2857 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.6 HWAddress:da:d5:b1:e5:38:54 ID:1,da:d5:b1:e5:38:54 Lease:0x6706d453}

	I1009 12:07:02.899018    2857 main.go:141] libmachine: Found match: da:d5:b1:e5:38:54

	I1009 12:07:02.899027    2857 main.go:141] libmachine: IP: 192.168.105.6

	I1009 12:07:02.899032    2857 main.go:141] libmachine: Waiting for VM to start (ssh -p 0 docker@192.168.105.6)...

** /stderr **

ha_test.go:471: failed to run minikube start. args "out/minikube-darwin-arm64 node list -p ha-845000 -v=7 --alsologtostderr" : signal: killed

ha_test.go:474: (dbg) Run:  out/minikube-darwin-arm64 node list -p ha-845000

ha_test.go:474: (dbg) Non-zero exit: out/minikube-darwin-arm64 node list -p ha-845000: context deadline exceeded (542ns)

ha_test.go:476: failed to run node list. args "out/minikube-darwin-arm64 node list -p ha-845000" : context deadline exceeded

ha_test.go:481: reported node list is not the same after restart. Before restart: ha-845000	

After restart: 

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-845000 -n ha-845000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-845000 -n ha-845000: exit status 7 (35.225667ms)

-- stdout --

	Error

-- /stdout --

** stderr ** 

	E1009 12:22:52.329626    2964 status.go:393] failed to get driver ip: parsing IP: 

	E1009 12:22:52.329631    2964 status.go:119] status error: parsing IP: 

** /stderr **

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "ha-845000" host is not running, skipping log retrieval (state="Error")

--- FAIL: TestMultiControlPlane/serial/RestartClusterKeepsNodes (956.04s)

=== RUN   TestJSONOutput/start/Command

json_output_test.go:63: (dbg) Run:  out/minikube-darwin-arm64 start -p json-output-945000 --output=json --user=testUser --memory=2200 --wait=true --driver=qemu2 

E1009 12:26:56.088151    1686 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/functional-517000/client.crt: no such file or directory" logger="UnhandledError"

E1009 12:29:59.182908    1686 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/functional-517000/client.crt: no such file or directory" logger="UnhandledError"

E1009 12:31:56.079447    1686 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/functional-517000/client.crt: no such file or directory" logger="UnhandledError"

json_output_test.go:63: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p json-output-945000 --output=json --user=testUser --memory=2200 --wait=true --driver=qemu2 : exit status 52 (12m5.258950041s)

-- stdout --

	{"specversion":"1.0","id":"7a1a5c85-f4a4-4423-9097-1c37632b98f9","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-945000] minikube v1.34.0 on Darwin 15.0.1 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}

	{"specversion":"1.0","id":"b8954e43-f999-4433-af35-307f13510c48","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=19780"}}

	{"specversion":"1.0","id":"95eade90-ac62-48a2-9b44-0addcf9b04b1","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/Users/jenkins/minikube-integration/19780-1164/kubeconfig"}}

	{"specversion":"1.0","id":"66d4fa3b-2f64-4c9a-bcbb-db31b0cad623","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-darwin-arm64"}}

	{"specversion":"1.0","id":"3f507665-79d8-4bd0-9e94-7bbb95cc0f03","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}

	{"specversion":"1.0","id":"5b06aedc-3535-4a91-8914-c518303e30fc","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/Users/jenkins/minikube-integration/19780-1164/.minikube"}}

	{"specversion":"1.0","id":"305bf25a-9751-438e-821a-a49fca940593","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}

	{"specversion":"1.0","id":"ca00e8c0-c7b9-425f-9345-aeb0de3d7ea8","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the qemu2 driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}

	{"specversion":"1.0","id":"9f9c8bfd-f48e-46e9-804e-bef64e3ccfa9","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Automatically selected the socket_vmnet network"}}

	{"specversion":"1.0","id":"126ea01f-ecac-4635-bcb9-0464c8075e4d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting \"json-output-945000\" primary control-plane node in \"json-output-945000\" cluster","name":"Starting Node","totalsteps":"19"}}

	{"specversion":"1.0","id":"91a68ea9-6db2-4cee-a4a0-b20011433a5c","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"9","message":"Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...","name":"Creating VM","totalsteps":"19"}}

	{"specversion":"1.0","id":"31543dd5-c5c7-4586-9e0c-cf53b253747e","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"9","message":"Deleting \"json-output-945000\" in qemu2 ...","name":"Creating VM","totalsteps":"19"}}

	{"specversion":"1.0","id":"dcf91dd9-6e8e-48a7-9d7b-25c4d7454799","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"StartHost failed, but will try again: creating host: create host timed out in 360.000000 seconds"}}

	{"specversion":"1.0","id":"d944d264-eaf8-4a36-9a6e-c632020aa821","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"9","message":"Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...","name":"Creating VM","totalsteps":"19"}}

	{"specversion":"1.0","id":"e07ec548-7ed4-4e2d-b363-5fa2ce6ffc7f","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"Failed to start qemu2 VM. Running \"minikube delete -p json-output-945000\" may fix it: creating host: create host timed out in 360.000000 seconds"}}

	{"specversion":"1.0","id":"b3141b21-d6b4-4183-8071-4fa2fcaeacb5","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"Try 'minikube delete', and disable any conflicting VPN or firewall software","exitcode":"52","issues":"https://github.com/kubernetes/minikube/issues/7072","message":"Failed to start host: creating host: create host timed out in 360.000000 seconds","name":"DRV_CREATE_TIMEOUT","url":""}}

-- /stdout --

json_output_test.go:65: failed to clean up: args "out/minikube-darwin-arm64 start -p json-output-945000 --output=json --user=testUser --memory=2200 --wait=true --driver=qemu2 ": exit status 52

--- FAIL: TestJSONOutput/start/Command (725.26s)

=== RUN   TestJSONOutput/start/parallel/DistinctCurrentSteps

=== PAUSE TestJSONOutput/start/parallel/DistinctCurrentSteps

=== CONT  TestJSONOutput/start/parallel/DistinctCurrentSteps

json_output_test.go:114: step 9 has already been assigned to another step:

Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

Cannot use for:

Deleting "json-output-945000" in qemu2 ...

[Context Attributes,

specversion: 1.0

type: io.k8s.sigs.minikube.step

source: https://minikube.sigs.k8s.io/

id: 7a1a5c85-f4a4-4423-9097-1c37632b98f9

datacontenttype: application/json

Data,

{

"currentstep": "0",

"message": "[json-output-945000] minikube v1.34.0 on Darwin 15.0.1 (arm64)",

"name": "Initial Minikube Setup",

"totalsteps": "19"

}

Context Attributes,

specversion: 1.0

type: io.k8s.sigs.minikube.info

source: https://minikube.sigs.k8s.io/

id: b8954e43-f999-4433-af35-307f13510c48

datacontenttype: application/json

Data,

{

"message": "MINIKUBE_LOCATION=19780"

}

Context Attributes,

specversion: 1.0

type: io.k8s.sigs.minikube.info

source: https://minikube.sigs.k8s.io/

id: 95eade90-ac62-48a2-9b44-0addcf9b04b1

datacontenttype: application/json

Data,

{

"message": "KUBECONFIG=/Users/jenkins/minikube-integration/19780-1164/kubeconfig"

}

Context Attributes,

specversion: 1.0

type: io.k8s.sigs.minikube.info

source: https://minikube.sigs.k8s.io/

id: 66d4fa3b-2f64-4c9a-bcbb-db31b0cad623

datacontenttype: application/json

Data,

{

"message": "MINIKUBE_BIN=out/minikube-darwin-arm64"

}

Context Attributes,

specversion: 1.0

type: io.k8s.sigs.minikube.info

source: https://minikube.sigs.k8s.io/

id: 3f507665-79d8-4bd0-9e94-7bbb95cc0f03

datacontenttype: application/json

Data,

{

"message": "MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"

}

Context Attributes,

specversion: 1.0

type: io.k8s.sigs.minikube.info

source: https://minikube.sigs.k8s.io/

id: 5b06aedc-3535-4a91-8914-c518303e30fc

datacontenttype: application/json

Data,

{

"message": "MINIKUBE_HOME=/Users/jenkins/minikube-integration/19780-1164/.minikube"

}

Context Attributes,

specversion: 1.0

type: io.k8s.sigs.minikube.info

source: https://minikube.sigs.k8s.io/

id: 305bf25a-9751-438e-821a-a49fca940593

datacontenttype: application/json

Data,

{

"message": "MINIKUBE_FORCE_SYSTEMD="

}

Context Attributes,

specversion: 1.0

type: io.k8s.sigs.minikube.step

source: https://minikube.sigs.k8s.io/

id: ca00e8c0-c7b9-425f-9345-aeb0de3d7ea8

datacontenttype: application/json

Data,

{

"currentstep": "1",

"message": "Using the qemu2 driver based on user configuration",

"name": "Selecting Driver",

"totalsteps": "19"

}

Context Attributes,

specversion: 1.0

type: io.k8s.sigs.minikube.info

source: https://minikube.sigs.k8s.io/

id: 9f9c8bfd-f48e-46e9-804e-bef64e3ccfa9

datacontenttype: application/json

Data,

{

"message": "Automatically selected the socket_vmnet network"

}

Context Attributes,

specversion: 1.0

type: io.k8s.sigs.minikube.step

source: https://minikube.sigs.k8s.io/

id: 126ea01f-ecac-4635-bcb9-0464c8075e4d

datacontenttype: application/json

Data,

{

"currentstep": "3",

"message": "Starting \"json-output-945000\" primary control-plane node in \"json-output-945000\" cluster",

"name": "Starting Node",

"totalsteps": "19"

}

Context Attributes,

specversion: 1.0

type: io.k8s.sigs.minikube.step

source: https://minikube.sigs.k8s.io/

id: 91a68ea9-6db2-4cee-a4a0-b20011433a5c

datacontenttype: application/json

Data,

{

"currentstep": "9",

"message": "Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...",

"name": "Creating VM",

"totalsteps": "19"

}

Context Attributes,

specversion: 1.0

type: io.k8s.sigs.minikube.step

source: https://minikube.sigs.k8s.io/

id: 31543dd5-c5c7-4586-9e0c-cf53b253747e

datacontenttype: application/json

Data,

{

"currentstep": "9",

"message": "Deleting \"json-output-945000\" in qemu2 ...",

"name": "Creating VM",

"totalsteps": "19"

}

Context Attributes,

specversion: 1.0

type: io.k8s.sigs.minikube.error

source: https://minikube.sigs.k8s.io/

id: dcf91dd9-6e8e-48a7-9d7b-25c4d7454799

datacontenttype: application/json

Data,

{

"message": "StartHost failed, but will try again: creating host: create host timed out in 360.000000 seconds"

}

Context Attributes,

specversion: 1.0

type: io.k8s.sigs.minikube.step

source: https://minikube.sigs.k8s.io/

id: d944d264-eaf8-4a36-9a6e-c632020aa821

datacontenttype: application/json

Data,

{

"currentstep": "9",

"message": "Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...",

"name": "Creating VM",

"totalsteps": "19"

}

Context Attributes,

specversion: 1.0

type: io.k8s.sigs.minikube.error

source: https://minikube.sigs.k8s.io/

id: e07ec548-7ed4-4e2d-b363-5fa2ce6ffc7f

datacontenttype: application/json

Data,

{

"message": "Failed to start qemu2 VM. Running \"minikube delete -p json-output-945000\" may fix it: creating host: create host timed out in 360.000000 seconds"

}

Context Attributes,

specversion: 1.0

type: io.k8s.sigs.minikube.error

source: https://minikube.sigs.k8s.io/

id: b3141b21-d6b4-4183-8071-4fa2fcaeacb5

datacontenttype: application/json

Data,

{

"advice": "Try 'minikube delete', and disable any conflicting VPN or firewall software",

"exitcode": "52",

"issues": "https://github.com/kubernetes/minikube/issues/7072",

"message": "Failed to start host: creating host: create host timed out in 360.000000 seconds",

"name": "DRV_CREATE_TIMEOUT",

"url": ""

}

]

--- FAIL: TestJSONOutput/start/parallel/DistinctCurrentSteps (0.00s)

=== RUN   TestJSONOutput/start/parallel/IncreasingCurrentSteps

=== PAUSE TestJSONOutput/start/parallel/IncreasingCurrentSteps

=== CONT  TestJSONOutput/start/parallel/IncreasingCurrentSteps

json_output_test.go:144: current step is not in increasing order: [Context Attributes,

specversion: 1.0

type: io.k8s.sigs.minikube.step

source: https://minikube.sigs.k8s.io/

id: 7a1a5c85-f4a4-4423-9097-1c37632b98f9

datacontenttype: application/json

Data,

{

"currentstep": "0",

"message": "[json-output-945000] minikube v1.34.0 on Darwin 15.0.1 (arm64)",

"name": "Initial Minikube Setup",

"totalsteps": "19"

}

Context Attributes,

specversion: 1.0

type: io.k8s.sigs.minikube.info

source: https://minikube.sigs.k8s.io/

id: b8954e43-f999-4433-af35-307f13510c48

datacontenttype: application/json

Data,

{

"message": "MINIKUBE_LOCATION=19780"

}

Context Attributes,

specversion: 1.0

type: io.k8s.sigs.minikube.info

source: https://minikube.sigs.k8s.io/

id: 95eade90-ac62-48a2-9b44-0addcf9b04b1

datacontenttype: application/json

Data,

{

"message": "KUBECONFIG=/Users/jenkins/minikube-integration/19780-1164/kubeconfig"

}

Context Attributes,

specversion: 1.0

type: io.k8s.sigs.minikube.info

source: https://minikube.sigs.k8s.io/

id: 66d4fa3b-2f64-4c9a-bcbb-db31b0cad623

datacontenttype: application/json

Data,

{

"message": "MINIKUBE_BIN=out/minikube-darwin-arm64"

}

Context Attributes,

specversion: 1.0

type: io.k8s.sigs.minikube.info

source: https://minikube.sigs.k8s.io/

id: 3f507665-79d8-4bd0-9e94-7bbb95cc0f03

datacontenttype: application/json

Data,

{

"message": "MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"

}

Context Attributes,

specversion: 1.0

type: io.k8s.sigs.minikube.info

source: https://minikube.sigs.k8s.io/

id: 5b06aedc-3535-4a91-8914-c518303e30fc

datacontenttype: application/json

Data,

{

"message": "MINIKUBE_HOME=/Users/jenkins/minikube-integration/19780-1164/.minikube"

}

Context Attributes,

specversion: 1.0

type: io.k8s.sigs.minikube.info

source: https://minikube.sigs.k8s.io/

id: 305bf25a-9751-438e-821a-a49fca940593

datacontenttype: application/json

Data,

{

"message": "MINIKUBE_FORCE_SYSTEMD="

}

Context Attributes,

specversion: 1.0

type: io.k8s.sigs.minikube.step

source: https://minikube.sigs.k8s.io/

id: ca00e8c0-c7b9-425f-9345-aeb0de3d7ea8

datacontenttype: application/json

Data,

{

"currentstep": "1",

"message": "Using the qemu2 driver based on user configuration",

"name": "Selecting Driver",

"totalsteps": "19"

}

Context Attributes,

specversion: 1.0

type: io.k8s.sigs.minikube.info

source: https://minikube.sigs.k8s.io/

id: 9f9c8bfd-f48e-46e9-804e-bef64e3ccfa9

datacontenttype: application/json

Data,

{

"message": "Automatically selected the socket_vmnet network"

}

Context Attributes,

specversion: 1.0

type: io.k8s.sigs.minikube.step

source: https://minikube.sigs.k8s.io/

id: 126ea01f-ecac-4635-bcb9-0464c8075e4d

datacontenttype: application/json

Data,

{

"currentstep": "3",

"message": "Starting \"json-output-945000\" primary control-plane node in \"json-output-945000\" cluster",

"name": "Starting Node",

"totalsteps": "19"

}

Context Attributes,

specversion: 1.0

type: io.k8s.sigs.minikube.step

source: https://minikube.sigs.k8s.io/

id: 91a68ea9-6db2-4cee-a4a0-b20011433a5c

datacontenttype: application/json

Data,

{

"currentstep": "9",

"message": "Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...",

"name": "Creating VM",

"totalsteps": "19"

}

Context Attributes,

specversion: 1.0

type: io.k8s.sigs.minikube.step

source: https://minikube.sigs.k8s.io/

id: 31543dd5-c5c7-4586-9e0c-cf53b253747e

datacontenttype: application/json

Data,

{

"currentstep": "9",

"message": "Deleting \"json-output-945000\" in qemu2 ...",

"name": "Creating VM",

"totalsteps": "19"

}

Context Attributes,

specversion: 1.0

type: io.k8s.sigs.minikube.error

source: https://minikube.sigs.k8s.io/

id: dcf91dd9-6e8e-48a7-9d7b-25c4d7454799

datacontenttype: application/json

Data,

{

"message": "StartHost failed, but will try again: creating host: create host timed out in 360.000000 seconds"

}

Context Attributes,

specversion: 1.0

type: io.k8s.sigs.minikube.step

source: https://minikube.sigs.k8s.io/

id: d944d264-eaf8-4a36-9a6e-c632020aa821

datacontenttype: application/json

Data,

{

"currentstep": "9",

"message": "Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...",

"name": "Creating VM",

"totalsteps": "19"

}

Context Attributes,

specversion: 1.0

type: io.k8s.sigs.minikube.error

source: https://minikube.sigs.k8s.io/

id: e07ec548-7ed4-4e2d-b363-5fa2ce6ffc7f

datacontenttype: application/json

Data,

{

"message": "Failed to start qemu2 VM. Running \"minikube delete -p json-output-945000\" may fix it: creating host: create host timed out in 360.000000 seconds"

}

Context Attributes,

specversion: 1.0

type: io.k8s.sigs.minikube.error

source: https://minikube.sigs.k8s.io/

id: b3141b21-d6b4-4183-8071-4fa2fcaeacb5

datacontenttype: application/json

Data,

{

"advice": "Try 'minikube delete', and disable any conflicting VPN or firewall software",

"exitcode": "52",

"issues": "https://github.com/kubernetes/minikube/issues/7072",

"message": "Failed to start host: creating host: create host timed out in 360.000000 seconds",

"name": "DRV_CREATE_TIMEOUT",

"url": ""

}

]

--- FAIL: TestJSONOutput/start/parallel/IncreasingCurrentSteps (0.00s)

=== RUN   TestJSONOutput/pause/Command

json_output_test.go:63: (dbg) Run:  out/minikube-darwin-arm64 pause -p json-output-945000 --output=json --user=testUser

json_output_test.go:63: (dbg) Non-zero exit: out/minikube-darwin-arm64 pause -p json-output-945000 --output=json --user=testUser: exit status 50 (89.049417ms)

-- stdout --

	{"specversion":"1.0","id":"c4bae5e5-2b00-467d-886f-5abad8ede982","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"Recreate the cluster by running:\n\t\tminikube delete {{.profileArg}}\n\t\tminikube start {{.profileArg}}","exitcode":"50","issues":"","message":"Unable to get control-plane node json-output-945000 endpoint: failed to lookup ip for \"\"","name":"DRV_CP_ENDPOINT","url":""}}

-- /stdout --

json_output_test.go:65: failed to clean up: args "out/minikube-darwin-arm64 pause -p json-output-945000 --output=json --user=testUser": exit status 50

--- FAIL: TestJSONOutput/pause/Command (0.09s)

=== RUN   TestJSONOutput/unpause/Command

json_output_test.go:63: (dbg) Run:  out/minikube-darwin-arm64 unpause -p json-output-945000 --output=json --user=testUser

json_output_test.go:63: (dbg) Non-zero exit: out/minikube-darwin-arm64 unpause -p json-output-945000 --output=json --user=testUser: exit status 50 (59.538709ms)

-- stdout --

-- /stdout --

** stderr ** 

	X Exiting due to DRV_CP_ENDPOINT: Unable to get control-plane node json-output-945000 endpoint: failed to lookup ip for ""

	* Suggestion: 

	    Recreate the cluster by running:

	    minikube delete <no value>

	    minikube start <no value>

** /stderr **

json_output_test.go:65: failed to clean up: args "out/minikube-darwin-arm64 unpause -p json-output-945000 --output=json --user=testUser": exit status 50

--- FAIL: TestJSONOutput/unpause/Command (0.06s)

=== RUN   TestMountStart/serial/StartWithMountFirst

mount_start_test.go:98: (dbg) Run:  out/minikube-darwin-arm64 start -p mount-start-1-567000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=qemu2 

E1009 12:36:56.071136    1686 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/functional-517000/client.crt: no such file or directory" logger="UnhandledError"

mount_start_test.go:98: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p mount-start-1-567000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=qemu2 : exit status 80 (10.100800375s)

-- stdout --

	* [mount-start-1-567000] minikube v1.34.0 on Darwin 15.0.1 (arm64)

	  - MINIKUBE_LOCATION=19780

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19780-1164/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19780-1164/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting minikube without Kubernetes in cluster mount-start-1-567000

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "mount-start-1-567000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p mount-start-1-567000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

mount_start_test.go:100: failed to start minikube with args: "out/minikube-darwin-arm64 start -p mount-start-1-567000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=qemu2 " : exit status 80

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p mount-start-1-567000 -n mount-start-1-567000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p mount-start-1-567000 -n mount-start-1-567000: exit status 7 (75.516542ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "mount-start-1-567000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMountStart/serial/StartWithMountFirst (10.18s)

=== RUN   TestMultiNode/serial/FreshStart2Nodes

multinode_test.go:96: (dbg) Run:  out/minikube-darwin-arm64 start -p multinode-341000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=qemu2 

multinode_test.go:96: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p multinode-341000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=qemu2 : exit status 80 (9.900814958s)

-- stdout --

	* [multinode-341000] minikube v1.34.0 on Darwin 15.0.1 (arm64)

	  - MINIKUBE_LOCATION=19780

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19780-1164/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19780-1164/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "multinode-341000" primary control-plane node in "multinode-341000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "multinode-341000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I1009 12:37:02.665665    3508 out.go:345] Setting OutFile to fd 1 ...

	I1009 12:37:02.665828    3508 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:37:02.665831    3508 out.go:358] Setting ErrFile to fd 2...

	I1009 12:37:02.665834    3508 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:37:02.665979    3508 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19780-1164/.minikube/bin

	I1009 12:37:02.667119    3508 out.go:352] Setting JSON to false

	I1009 12:37:02.684876    3508 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":3992,"bootTime":1728498630,"procs":518,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}

	W1009 12:37:02.684952    3508 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I1009 12:37:02.690065    3508 out.go:177] * [multinode-341000] minikube v1.34.0 on Darwin 15.0.1 (arm64)

	I1009 12:37:02.696886    3508 out.go:177]   - MINIKUBE_LOCATION=19780

	I1009 12:37:02.696955    3508 notify.go:220] Checking for updates...

	I1009 12:37:02.704059    3508 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19780-1164/kubeconfig

	I1009 12:37:02.705539    3508 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I1009 12:37:02.709022    3508 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1009 12:37:02.712029    3508 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19780-1164/.minikube

	I1009 12:37:02.715045    3508 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I1009 12:37:02.718189    3508 driver.go:394] Setting default libvirt URI to qemu:///system

	I1009 12:37:02.721974    3508 out.go:177] * Using the qemu2 driver based on user configuration

	I1009 12:37:02.728973    3508 start.go:297] selected driver: qemu2

	I1009 12:37:02.728980    3508 start.go:901] validating driver "qemu2" against <nil>

	I1009 12:37:02.728987    3508 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I1009 12:37:02.731497    3508 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I1009 12:37:02.735092    3508 out.go:177] * Automatically selected the socket_vmnet network

	I1009 12:37:02.738128    3508 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I1009 12:37:02.738142    3508 cni.go:84] Creating CNI manager for ""

	I1009 12:37:02.738168    3508 cni.go:136] multinode detected (0 nodes found), recommending kindnet

	I1009 12:37:02.738172    3508 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni

	I1009 12:37:02.738213    3508 start.go:340] cluster config:

	{Name:multinode-341000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:multinode-341000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRu

ntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vm

net_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1009 12:37:02.742781    3508 iso.go:125] acquiring lock: {Name:mka6a0d59ae6cc32794e4fbfa8e5c6ce6a65e504 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1009 12:37:02.750983    3508 out.go:177] * Starting "multinode-341000" primary control-plane node in "multinode-341000" cluster

	I1009 12:37:02.755020    3508 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime docker

	I1009 12:37:02.755042    3508 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19780-1164/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4

	I1009 12:37:02.755049    3508 cache.go:56] Caching tarball of preloaded images

	I1009 12:37:02.755138    3508 preload.go:172] Found /Users/jenkins/minikube-integration/19780-1164/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I1009 12:37:02.755145    3508 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on docker

	I1009 12:37:02.755396    3508 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/multinode-341000/config.json ...

	I1009 12:37:02.755408    3508 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/multinode-341000/config.json: {Name:mk2a820be60e773136dfa3b093c8f36cecbbedc6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1009 12:37:02.755782    3508 start.go:360] acquireMachinesLock for multinode-341000: {Name:mk6dc29eb74286120c58954bae0cd65a85a89b02 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1009 12:37:02.755834    3508 start.go:364] duration metric: took 44.791µs to acquireMachinesLock for "multinode-341000"

	I1009 12:37:02.755845    3508 start.go:93] Provisioning new machine with config: &{Name:multinode-341000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19774/minikube-v1.34.0-1728382514-19774-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{K

ubernetesVersion:v1.31.1 ClusterName:multinode-341000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[

] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1009 12:37:02.755915    3508 start.go:125] createHost starting for "" (driver="qemu2")

	I1009 12:37:02.763953    3508 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I1009 12:37:02.782458    3508 start.go:159] libmachine.API.Create for "multinode-341000" (driver="qemu2")

	I1009 12:37:02.782491    3508 client.go:168] LocalClient.Create starting

	I1009 12:37:02.782559    3508 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19780-1164/.minikube/certs/ca.pem

	I1009 12:37:02.782598    3508 main.go:141] libmachine: Decoding PEM data...

	I1009 12:37:02.782616    3508 main.go:141] libmachine: Parsing certificate...

	I1009 12:37:02.782663    3508 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19780-1164/.minikube/certs/cert.pem

	I1009 12:37:02.782693    3508 main.go:141] libmachine: Decoding PEM data...

	I1009 12:37:02.782704    3508 main.go:141] libmachine: Parsing certificate...

	I1009 12:37:02.783155    3508 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19780-1164/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19780-1164/.minikube/cache/iso/arm64/minikube-v1.34.0-1728382514-19774-arm64.iso...

	I1009 12:37:02.926762    3508 main.go:141] libmachine: Creating SSH key...

	I1009 12:37:03.081974    3508 main.go:141] libmachine: Creating Disk image...

	I1009 12:37:03.081983    3508 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I1009 12:37:03.082159    3508 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/multinode-341000/disk.qcow2.raw /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/multinode-341000/disk.qcow2

	I1009 12:37:03.091884    3508 main.go:141] libmachine: STDOUT: 

	I1009 12:37:03.091901    3508 main.go:141] libmachine: STDERR: 

	I1009 12:37:03.091963    3508 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/multinode-341000/disk.qcow2 +20000M

	I1009 12:37:03.100474    3508 main.go:141] libmachine: STDOUT: Image resized.

	I1009 12:37:03.100499    3508 main.go:141] libmachine: STDERR: 

	I1009 12:37:03.100517    3508 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/multinode-341000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/multinode-341000/disk.qcow2

	I1009 12:37:03.100523    3508 main.go:141] libmachine: Starting QEMU VM...

	I1009 12:37:03.100533    3508 qemu.go:418] Using hvf for hardware acceleration

	I1009 12:37:03.100564    3508 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/multinode-341000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19780-1164/.minikube/machines/multinode-341000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/multinode-341000/qemu.pid -device virtio-net-pci,netdev=net0,mac=6a:d9:e0:7d:4e:53 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/multinode-341000/disk.qcow2

	I1009 12:37:03.102438    3508 main.go:141] libmachine: STDOUT: 

	I1009 12:37:03.102451    3508 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I1009 12:37:03.102469    3508 client.go:171] duration metric: took 319.98175ms to LocalClient.Create

	I1009 12:37:05.104600    3508 start.go:128] duration metric: took 2.348724417s to createHost

	I1009 12:37:05.104660    3508 start.go:83] releasing machines lock for "multinode-341000", held for 2.34888425s

	W1009 12:37:05.104728    3508 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I1009 12:37:05.115588    3508 out.go:177] * Deleting "multinode-341000" in qemu2 ...

	W1009 12:37:05.141843    3508 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I1009 12:37:05.141869    3508 start.go:729] Will try again in 5 seconds ...

	I1009 12:37:10.143985    3508 start.go:360] acquireMachinesLock for multinode-341000: {Name:mk6dc29eb74286120c58954bae0cd65a85a89b02 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1009 12:37:10.144654    3508 start.go:364] duration metric: took 534.416µs to acquireMachinesLock for "multinode-341000"

	I1009 12:37:10.144784    3508 start.go:93] Provisioning new machine with config: &{Name:multinode-341000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19774/minikube-v1.34.0-1728382514-19774-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{K

ubernetesVersion:v1.31.1 ClusterName:multinode-341000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[

] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}

	I1009 12:37:10.145103    3508 start.go:125] createHost starting for "" (driver="qemu2")

	I1009 12:37:10.157658    3508 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I1009 12:37:10.205709    3508 start.go:159] libmachine.API.Create for "multinode-341000" (driver="qemu2")

	I1009 12:37:10.205769    3508 client.go:168] LocalClient.Create starting

	I1009 12:37:10.205902    3508 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19780-1164/.minikube/certs/ca.pem

	I1009 12:37:10.205980    3508 main.go:141] libmachine: Decoding PEM data...

	I1009 12:37:10.205996    3508 main.go:141] libmachine: Parsing certificate...

	I1009 12:37:10.206078    3508 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19780-1164/.minikube/certs/cert.pem

	I1009 12:37:10.206135    3508 main.go:141] libmachine: Decoding PEM data...

	I1009 12:37:10.206150    3508 main.go:141] libmachine: Parsing certificate...

	I1009 12:37:10.206733    3508 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19780-1164/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19780-1164/.minikube/cache/iso/arm64/minikube-v1.34.0-1728382514-19774-arm64.iso...

	I1009 12:37:10.362779    3508 main.go:141] libmachine: Creating SSH key...

	I1009 12:37:10.468929    3508 main.go:141] libmachine: Creating Disk image...

	I1009 12:37:10.468934    3508 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I1009 12:37:10.469114    3508 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/multinode-341000/disk.qcow2.raw /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/multinode-341000/disk.qcow2

	I1009 12:37:10.479042    3508 main.go:141] libmachine: STDOUT: 

	I1009 12:37:10.479070    3508 main.go:141] libmachine: STDERR: 

	I1009 12:37:10.479129    3508 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/multinode-341000/disk.qcow2 +20000M

	I1009 12:37:10.487617    3508 main.go:141] libmachine: STDOUT: Image resized.

	I1009 12:37:10.487633    3508 main.go:141] libmachine: STDERR: 

	I1009 12:37:10.487643    3508 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/multinode-341000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/multinode-341000/disk.qcow2

	I1009 12:37:10.487647    3508 main.go:141] libmachine: Starting QEMU VM...

	I1009 12:37:10.487656    3508 qemu.go:418] Using hvf for hardware acceleration

	I1009 12:37:10.487690    3508 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/multinode-341000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19780-1164/.minikube/machines/multinode-341000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/multinode-341000/qemu.pid -device virtio-net-pci,netdev=net0,mac=36:b2:c1:94:e1:6a -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/multinode-341000/disk.qcow2

	I1009 12:37:10.489497    3508 main.go:141] libmachine: STDOUT: 

	I1009 12:37:10.489510    3508 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I1009 12:37:10.489520    3508 client.go:171] duration metric: took 283.754125ms to LocalClient.Create

	I1009 12:37:12.491640    3508 start.go:128] duration metric: took 2.346579583s to createHost

	I1009 12:37:12.491688    3508 start.go:83] releasing machines lock for "multinode-341000", held for 2.347076291s

	W1009 12:37:12.492089    3508 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p multinode-341000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p multinode-341000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I1009 12:37:12.504780    3508 out.go:201] 

	W1009 12:37:12.507690    3508 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W1009 12:37:12.507713    3508 out.go:270] * 

	* 

	W1009 12:37:12.510223    3508 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I1009 12:37:12.519657    3508 out.go:201] 

** /stderr **

multinode_test.go:98: failed to start cluster. args "out/minikube-darwin-arm64 start -p multinode-341000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=qemu2 " : exit status 80

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-341000 -n multinode-341000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-341000 -n multinode-341000: exit status 7 (71.595417ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-341000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/FreshStart2Nodes (9.97s)

=== RUN   TestMultiNode/serial/DeployApp2Nodes

multinode_test.go:493: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-341000 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml

multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-341000 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml: exit status 1 (137.049333ms)

** stderr ** 

	error: cluster "multinode-341000" does not exist

** /stderr **

multinode_test.go:495: failed to create busybox deployment to multinode cluster

multinode_test.go:498: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-341000 -- rollout status deployment/busybox

multinode_test.go:498: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-341000 -- rollout status deployment/busybox: exit status 1 (63.132375ms)

** stderr ** 

	error: no server found for cluster "multinode-341000"

** /stderr **

multinode_test.go:500: failed to deploy busybox to multinode cluster

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-341000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-341000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (62.685875ms)

** stderr ** 

	error: no server found for cluster "multinode-341000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

I1009 12:37:12.871099    1686 retry.go:31] will retry after 655.435765ms: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-341000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-341000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (107.848583ms)

** stderr ** 

	error: no server found for cluster "multinode-341000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

I1009 12:37:13.636687    1686 retry.go:31] will retry after 1.915729382s: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-341000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-341000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (107.630625ms)

** stderr ** 

	error: no server found for cluster "multinode-341000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

I1009 12:37:15.662377    1686 retry.go:31] will retry after 1.783700297s: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-341000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-341000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (107.173709ms)

** stderr ** 

	error: no server found for cluster "multinode-341000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

I1009 12:37:17.555580    1686 retry.go:31] will retry after 3.149972001s: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-341000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-341000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (108.063667ms)

** stderr ** 

	error: no server found for cluster "multinode-341000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

I1009 12:37:20.815835    1686 retry.go:31] will retry after 3.329112998s: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-341000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-341000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (108.04975ms)

** stderr ** 

	error: no server found for cluster "multinode-341000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

I1009 12:37:24.255283    1686 retry.go:31] will retry after 5.799374841s: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-341000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-341000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (106.270083ms)

** stderr ** 

	error: no server found for cluster "multinode-341000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

I1009 12:37:30.163225    1686 retry.go:31] will retry after 12.580838262s: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-341000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-341000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (108.255792ms)

** stderr ** 

	error: no server found for cluster "multinode-341000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

I1009 12:37:42.854286    1686 retry.go:31] will retry after 14.826903182s: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-341000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-341000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (108.853084ms)

** stderr ** 

	error: no server found for cluster "multinode-341000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

I1009 12:37:57.792075    1686 retry.go:31] will retry after 34.670906149s: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-341000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-341000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (108.149708ms)

** stderr ** 

	error: no server found for cluster "multinode-341000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:524: failed to resolve pod IPs: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:528: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-341000 -- get pods -o jsonpath='{.items[*].metadata.name}'

multinode_test.go:528: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-341000 -- get pods -o jsonpath='{.items[*].metadata.name}': exit status 1 (62.929083ms)

** stderr ** 

	error: no server found for cluster "multinode-341000"

** /stderr **

multinode_test.go:530: failed get Pod names

multinode_test.go:536: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-341000 -- exec  -- nslookup kubernetes.io

multinode_test.go:536: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-341000 -- exec  -- nslookup kubernetes.io: exit status 1 (62.008625ms)

** stderr ** 

	error: no server found for cluster "multinode-341000"

** /stderr **

multinode_test.go:538: Pod  could not resolve 'kubernetes.io': exit status 1

multinode_test.go:546: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-341000 -- exec  -- nslookup kubernetes.default

multinode_test.go:546: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-341000 -- exec  -- nslookup kubernetes.default: exit status 1 (61.873167ms)

** stderr ** 

	error: no server found for cluster "multinode-341000"

** /stderr **

multinode_test.go:548: Pod  could not resolve 'kubernetes.default': exit status 1

multinode_test.go:554: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-341000 -- exec  -- nslookup kubernetes.default.svc.cluster.local

multinode_test.go:554: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-341000 -- exec  -- nslookup kubernetes.default.svc.cluster.local: exit status 1 (61.636125ms)

** stderr ** 

	error: no server found for cluster "multinode-341000"

** /stderr **

multinode_test.go:556: Pod  could not resolve local service (kubernetes.default.svc.cluster.local): exit status 1

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-341000 -n multinode-341000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-341000 -n multinode-341000: exit status 7 (34.455125ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-341000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/DeployApp2Nodes (80.25s)

=== RUN   TestMultiNode/serial/PingHostFrom2Pods

multinode_test.go:564: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-341000 -- get pods -o jsonpath='{.items[*].metadata.name}'

multinode_test.go:564: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-341000 -- get pods -o jsonpath='{.items[*].metadata.name}': exit status 1 (61.423875ms)

** stderr ** 

	error: no server found for cluster "multinode-341000"

** /stderr **

multinode_test.go:566: failed to get Pod names: exit status 1

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-341000 -n multinode-341000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-341000 -n multinode-341000: exit status 7 (34.368625ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-341000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/PingHostFrom2Pods (0.10s)

=== RUN   TestMultiNode/serial/AddNode

multinode_test.go:121: (dbg) Run:  out/minikube-darwin-arm64 node add -p multinode-341000 -v 3 --alsologtostderr

multinode_test.go:121: (dbg) Non-zero exit: out/minikube-darwin-arm64 node add -p multinode-341000 -v 3 --alsologtostderr: exit status 83 (45.971291ms)

-- stdout --

	* The control-plane node multinode-341000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p multinode-341000"

-- /stdout --

** stderr ** 

	I1009 12:38:32.983939    3588 out.go:345] Setting OutFile to fd 1 ...

	I1009 12:38:32.984354    3588 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:38:32.984358    3588 out.go:358] Setting ErrFile to fd 2...

	I1009 12:38:32.984362    3588 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:38:32.984493    3588 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19780-1164/.minikube/bin

	I1009 12:38:32.984736    3588 mustload.go:65] Loading cluster: multinode-341000

	I1009 12:38:32.984949    3588 config.go:182] Loaded profile config "multinode-341000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I1009 12:38:32.989665    3588 out.go:177] * The control-plane node multinode-341000 host is not running: state=Stopped

	I1009 12:38:32.993612    3588 out.go:177]   To start a cluster, run: "minikube start -p multinode-341000"

** /stderr **

multinode_test.go:123: failed to add node to current cluster. args "out/minikube-darwin-arm64 node add -p multinode-341000 -v 3 --alsologtostderr" : exit status 83

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-341000 -n multinode-341000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-341000 -n multinode-341000: exit status 7 (33.741167ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-341000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/AddNode (0.08s)

=== RUN   TestMultiNode/serial/MultiNodeLabels

multinode_test.go:221: (dbg) Run:  kubectl --context multinode-341000 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]"

multinode_test.go:221: (dbg) Non-zero exit: kubectl --context multinode-341000 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]": exit status 1 (33.327125ms)

** stderr ** 

	Error in configuration: context was not found for specified context: multinode-341000

** /stderr **

multinode_test.go:223: failed to 'kubectl get nodes' with args "kubectl --context multinode-341000 get nodes -o \"jsonpath=[{range .items[*]}{.metadata.labels},{end}]\"": exit status 1

multinode_test.go:230: failed to decode json from label list: args "kubectl --context multinode-341000 get nodes -o \"jsonpath=[{range .items[*]}{.metadata.labels},{end}]\"": unexpected end of JSON input

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-341000 -n multinode-341000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-341000 -n multinode-341000: exit status 7 (34.54875ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-341000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/MultiNodeLabels (0.07s)

=== RUN   TestMultiNode/serial/ProfileList

multinode_test.go:143: (dbg) Run:  out/minikube-darwin-arm64 profile list --output json

multinode_test.go:166: expected profile "multinode-341000" in json of 'profile list' include 3 nodes but have 1 nodes. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"multinode-341000\",\"Status\":\"Starting\",\"Config\":{\"Name\":\"multinode-341000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/19774/minikube-v1.34.0-1728382514-19774-arm64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"qemu2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMN

UMACount\":1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.31.1\",\"ClusterName\":\"multinode-341000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVe

rsion\":\"v1.31.1\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"socket_vmnet\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"/opt/socket_vmnet/bin/socket_vmnet_client\",\"SocketVMnetPath\":\"/var/run/socket_vmnet\",\"StaticIP\"

:\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":false}]}"*. args: "out/minikube-darwin-arm64 profile list --output json"

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-341000 -n multinode-341000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-341000 -n multinode-341000: exit status 7 (33.600542ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-341000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/ProfileList (0.08s)

=== RUN   TestMultiNode/serial/CopyFile

multinode_test.go:184: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-341000 status --output json --alsologtostderr

multinode_test.go:184: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-341000 status --output json --alsologtostderr: exit status 7 (34.204ms)

-- stdout --

	{"Name":"multinode-341000","Host":"Stopped","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Stopped","Worker":false}

-- /stdout --

** stderr ** 

	I1009 12:38:33.217945    3600 out.go:345] Setting OutFile to fd 1 ...

	I1009 12:38:33.218112    3600 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:38:33.218115    3600 out.go:358] Setting ErrFile to fd 2...

	I1009 12:38:33.218118    3600 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:38:33.218246    3600 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19780-1164/.minikube/bin

	I1009 12:38:33.218376    3600 out.go:352] Setting JSON to true

	I1009 12:38:33.218387    3600 mustload.go:65] Loading cluster: multinode-341000

	I1009 12:38:33.218445    3600 notify.go:220] Checking for updates...

	I1009 12:38:33.218597    3600 config.go:182] Loaded profile config "multinode-341000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I1009 12:38:33.218603    3600 status.go:174] checking status of multinode-341000 ...

	I1009 12:38:33.218862    3600 status.go:371] multinode-341000 host status = "Stopped" (err=<nil>)

	I1009 12:38:33.218866    3600 status.go:384] host is not running, skipping remaining checks

	I1009 12:38:33.218868    3600 status.go:176] multinode-341000 status: &{Name:multinode-341000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

multinode_test.go:191: failed to decode json from status: args "out/minikube-darwin-arm64 -p multinode-341000 status --output json --alsologtostderr": json: cannot unmarshal object into Go value of type []cluster.Status

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-341000 -n multinode-341000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-341000 -n multinode-341000: exit status 7 (33.693667ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-341000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/CopyFile (0.07s)

=== RUN   TestMultiNode/serial/StopNode

multinode_test.go:248: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-341000 node stop m03

multinode_test.go:248: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-341000 node stop m03: exit status 85 (50.222083ms)

-- stdout --

-- /stdout --

** stderr ** 

	X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                         │

	│    * If the above advice does not help, please let us know:                                                             │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

	│                                                                                                                         │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

	│    * Please also attach the following file to the GitHub issue:                                                         │

	│    * - /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube_node_295f67d8757edd996fe5c1e7ccde72c355ccf4dc_0.log    │

	│                                                                                                                         │

	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

multinode_test.go:250: node stop returned an error. args "out/minikube-darwin-arm64 -p multinode-341000 node stop m03": exit status 85

multinode_test.go:254: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-341000 status

multinode_test.go:254: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-341000 status: exit status 7 (33.82ms)

-- stdout --

	multinode-341000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

multinode_test.go:261: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-341000 status --alsologtostderr

multinode_test.go:261: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-341000 status --alsologtostderr: exit status 7 (34.309083ms)

-- stdout --

	multinode-341000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I1009 12:38:33.370807    3608 out.go:345] Setting OutFile to fd 1 ...

	I1009 12:38:33.370996    3608 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:38:33.370999    3608 out.go:358] Setting ErrFile to fd 2...

	I1009 12:38:33.371001    3608 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:38:33.371150    3608 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19780-1164/.minikube/bin

	I1009 12:38:33.371274    3608 out.go:352] Setting JSON to false

	I1009 12:38:33.371284    3608 mustload.go:65] Loading cluster: multinode-341000

	I1009 12:38:33.371355    3608 notify.go:220] Checking for updates...

	I1009 12:38:33.371512    3608 config.go:182] Loaded profile config "multinode-341000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I1009 12:38:33.371524    3608 status.go:174] checking status of multinode-341000 ...

	I1009 12:38:33.371777    3608 status.go:371] multinode-341000 host status = "Stopped" (err=<nil>)

	I1009 12:38:33.371781    3608 status.go:384] host is not running, skipping remaining checks

	I1009 12:38:33.371783    3608 status.go:176] multinode-341000 status: &{Name:multinode-341000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

multinode_test.go:267: incorrect number of running kubelets: args "out/minikube-darwin-arm64 -p multinode-341000 status --alsologtostderr": multinode-341000

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-341000 -n multinode-341000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-341000 -n multinode-341000: exit status 7 (33.930333ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-341000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/StopNode (0.15s)

=== RUN   TestMultiNode/serial/StartAfterStop

multinode_test.go:282: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-341000 node start m03 -v=7 --alsologtostderr

multinode_test.go:282: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-341000 node start m03 -v=7 --alsologtostderr: exit status 85 (48.6325ms)

-- stdout --

-- /stdout --

** stderr ** 

	I1009 12:38:33.439305    3612 out.go:345] Setting OutFile to fd 1 ...

	I1009 12:38:33.439610    3612 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:38:33.439613    3612 out.go:358] Setting ErrFile to fd 2...

	I1009 12:38:33.439616    3612 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:38:33.439747    3612 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19780-1164/.minikube/bin

	I1009 12:38:33.439988    3612 mustload.go:65] Loading cluster: multinode-341000

	I1009 12:38:33.440184    3612 config.go:182] Loaded profile config "multinode-341000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I1009 12:38:33.444636    3612 out.go:201] 

	W1009 12:38:33.447600    3612 out.go:270] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03

	X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03

	W1009 12:38:33.447605    3612 out.go:270] * 

	* 

	W1009 12:38:33.448984    3612 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                         │

	│    * If the above advice does not help, please let us know:                                                             │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

	│                                                                                                                         │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

	│    * Please also attach the following file to the GitHub issue:                                                         │

	│    * - /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │

	│                                                                                                                         │

	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                         │

	│    * If the above advice does not help, please let us know:                                                             │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

	│                                                                                                                         │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

	│    * Please also attach the following file to the GitHub issue:                                                         │

	│    * - /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │

	│                                                                                                                         │

	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	I1009 12:38:33.451594    3612 out.go:201] 

** /stderr **

multinode_test.go:284: I1009 12:38:33.439305    3612 out.go:345] Setting OutFile to fd 1 ...

I1009 12:38:33.439610    3612 out.go:392] TERM=,COLORTERM=, which probably does not support color

I1009 12:38:33.439613    3612 out.go:358] Setting ErrFile to fd 2...

I1009 12:38:33.439616    3612 out.go:392] TERM=,COLORTERM=, which probably does not support color

I1009 12:38:33.439747    3612 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19780-1164/.minikube/bin

I1009 12:38:33.439988    3612 mustload.go:65] Loading cluster: multinode-341000

I1009 12:38:33.440184    3612 config.go:182] Loaded profile config "multinode-341000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

I1009 12:38:33.444636    3612 out.go:201] 

W1009 12:38:33.447600    3612 out.go:270] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03

X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03

W1009 12:38:33.447605    3612 out.go:270] * 

* 

W1009 12:38:33.448984    3612 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

│                                                                                                                         │

│    * If the above advice does not help, please let us know:                                                             │

│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

│                                                                                                                         │

│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

│    * Please also attach the following file to the GitHub issue:                                                         │

│    * - /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │

│                                                                                                                         │

╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

│                                                                                                                         │

│    * If the above advice does not help, please let us know:                                                             │

│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

│                                                                                                                         │

│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

│    * Please also attach the following file to the GitHub issue:                                                         │

│    * - /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │

│                                                                                                                         │

╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

I1009 12:38:33.451594    3612 out.go:201] 

multinode_test.go:285: node start returned an error. args "out/minikube-darwin-arm64 -p multinode-341000 node start m03 -v=7 --alsologtostderr": exit status 85

multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-341000 status -v=7 --alsologtostderr

multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-341000 status -v=7 --alsologtostderr: exit status 7 (34.042958ms)

-- stdout --

	multinode-341000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I1009 12:38:33.487917    3614 out.go:345] Setting OutFile to fd 1 ...

	I1009 12:38:33.488096    3614 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:38:33.488099    3614 out.go:358] Setting ErrFile to fd 2...

	I1009 12:38:33.488101    3614 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:38:33.488239    3614 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19780-1164/.minikube/bin

	I1009 12:38:33.488361    3614 out.go:352] Setting JSON to false

	I1009 12:38:33.488370    3614 mustload.go:65] Loading cluster: multinode-341000

	I1009 12:38:33.488435    3614 notify.go:220] Checking for updates...

	I1009 12:38:33.488584    3614 config.go:182] Loaded profile config "multinode-341000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I1009 12:38:33.488590    3614 status.go:174] checking status of multinode-341000 ...

	I1009 12:38:33.488837    3614 status.go:371] multinode-341000 host status = "Stopped" (err=<nil>)

	I1009 12:38:33.488841    3614 status.go:384] host is not running, skipping remaining checks

	I1009 12:38:33.488843    3614 status.go:176] multinode-341000 status: &{Name:multinode-341000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

I1009 12:38:33.489666    1686 retry.go:31] will retry after 1.310803141s: exit status 7

multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-341000 status -v=7 --alsologtostderr

multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-341000 status -v=7 --alsologtostderr: exit status 7 (80.942417ms)

-- stdout --

	multinode-341000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I1009 12:38:34.881538    3616 out.go:345] Setting OutFile to fd 1 ...

	I1009 12:38:34.881762    3616 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:38:34.881766    3616 out.go:358] Setting ErrFile to fd 2...

	I1009 12:38:34.881769    3616 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:38:34.881928    3616 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19780-1164/.minikube/bin

	I1009 12:38:34.882112    3616 out.go:352] Setting JSON to false

	I1009 12:38:34.882125    3616 mustload.go:65] Loading cluster: multinode-341000

	I1009 12:38:34.882169    3616 notify.go:220] Checking for updates...

	I1009 12:38:34.882387    3616 config.go:182] Loaded profile config "multinode-341000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I1009 12:38:34.882403    3616 status.go:174] checking status of multinode-341000 ...

	I1009 12:38:34.882709    3616 status.go:371] multinode-341000 host status = "Stopped" (err=<nil>)

	I1009 12:38:34.882713    3616 status.go:384] host is not running, skipping remaining checks

	I1009 12:38:34.882716    3616 status.go:176] multinode-341000 status: &{Name:multinode-341000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

I1009 12:38:34.883728    1686 retry.go:31] will retry after 1.392228091s: exit status 7

multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-341000 status -v=7 --alsologtostderr

multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-341000 status -v=7 --alsologtostderr: exit status 7 (79.334166ms)

-- stdout --

	multinode-341000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I1009 12:38:36.355493    3618 out.go:345] Setting OutFile to fd 1 ...

	I1009 12:38:36.355716    3618 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:38:36.355720    3618 out.go:358] Setting ErrFile to fd 2...

	I1009 12:38:36.355724    3618 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:38:36.355877    3618 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19780-1164/.minikube/bin

	I1009 12:38:36.356037    3618 out.go:352] Setting JSON to false

	I1009 12:38:36.356049    3618 mustload.go:65] Loading cluster: multinode-341000

	I1009 12:38:36.356076    3618 notify.go:220] Checking for updates...

	I1009 12:38:36.356306    3618 config.go:182] Loaded profile config "multinode-341000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I1009 12:38:36.356314    3618 status.go:174] checking status of multinode-341000 ...

	I1009 12:38:36.356628    3618 status.go:371] multinode-341000 host status = "Stopped" (err=<nil>)

	I1009 12:38:36.356633    3618 status.go:384] host is not running, skipping remaining checks

	I1009 12:38:36.356636    3618 status.go:176] multinode-341000 status: &{Name:multinode-341000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

I1009 12:38:36.357618    1686 retry.go:31] will retry after 2.299790259s: exit status 7

multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-341000 status -v=7 --alsologtostderr

multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-341000 status -v=7 --alsologtostderr: exit status 7 (77.6075ms)

-- stdout --

	multinode-341000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I1009 12:38:38.735026    3620 out.go:345] Setting OutFile to fd 1 ...

	I1009 12:38:38.735260    3620 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:38:38.735264    3620 out.go:358] Setting ErrFile to fd 2...

	I1009 12:38:38.735267    3620 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:38:38.735445    3620 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19780-1164/.minikube/bin

	I1009 12:38:38.735606    3620 out.go:352] Setting JSON to false

	I1009 12:38:38.735618    3620 mustload.go:65] Loading cluster: multinode-341000

	I1009 12:38:38.735654    3620 notify.go:220] Checking for updates...

	I1009 12:38:38.735928    3620 config.go:182] Loaded profile config "multinode-341000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I1009 12:38:38.735937    3620 status.go:174] checking status of multinode-341000 ...

	I1009 12:38:38.736253    3620 status.go:371] multinode-341000 host status = "Stopped" (err=<nil>)

	I1009 12:38:38.736258    3620 status.go:384] host is not running, skipping remaining checks

	I1009 12:38:38.736260    3620 status.go:176] multinode-341000 status: &{Name:multinode-341000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

I1009 12:38:38.737301    1686 retry.go:31] will retry after 2.702006435s: exit status 7

multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-341000 status -v=7 --alsologtostderr

multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-341000 status -v=7 --alsologtostderr: exit status 7 (78.596708ms)

-- stdout --

	multinode-341000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I1009 12:38:41.518057    3622 out.go:345] Setting OutFile to fd 1 ...

	I1009 12:38:41.518289    3622 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:38:41.518293    3622 out.go:358] Setting ErrFile to fd 2...

	I1009 12:38:41.518295    3622 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:38:41.518464    3622 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19780-1164/.minikube/bin

	I1009 12:38:41.518618    3622 out.go:352] Setting JSON to false

	I1009 12:38:41.518630    3622 mustload.go:65] Loading cluster: multinode-341000

	I1009 12:38:41.518665    3622 notify.go:220] Checking for updates...

	I1009 12:38:41.518871    3622 config.go:182] Loaded profile config "multinode-341000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I1009 12:38:41.518879    3622 status.go:174] checking status of multinode-341000 ...

	I1009 12:38:41.519173    3622 status.go:371] multinode-341000 host status = "Stopped" (err=<nil>)

	I1009 12:38:41.519178    3622 status.go:384] host is not running, skipping remaining checks

	I1009 12:38:41.519180    3622 status.go:176] multinode-341000 status: &{Name:multinode-341000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

I1009 12:38:41.520151    1686 retry.go:31] will retry after 6.988830856s: exit status 7

multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-341000 status -v=7 --alsologtostderr

multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-341000 status -v=7 --alsologtostderr: exit status 7 (77.134334ms)

-- stdout --

	multinode-341000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I1009 12:38:48.586112    3624 out.go:345] Setting OutFile to fd 1 ...

	I1009 12:38:48.586352    3624 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:38:48.586356    3624 out.go:358] Setting ErrFile to fd 2...

	I1009 12:38:48.586360    3624 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:38:48.586524    3624 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19780-1164/.minikube/bin

	I1009 12:38:48.586712    3624 out.go:352] Setting JSON to false

	I1009 12:38:48.586724    3624 mustload.go:65] Loading cluster: multinode-341000

	I1009 12:38:48.586761    3624 notify.go:220] Checking for updates...

	I1009 12:38:48.587014    3624 config.go:182] Loaded profile config "multinode-341000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I1009 12:38:48.587022    3624 status.go:174] checking status of multinode-341000 ...

	I1009 12:38:48.587337    3624 status.go:371] multinode-341000 host status = "Stopped" (err=<nil>)

	I1009 12:38:48.587342    3624 status.go:384] host is not running, skipping remaining checks

	I1009 12:38:48.587345    3624 status.go:176] multinode-341000 status: &{Name:multinode-341000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

I1009 12:38:48.588378    1686 retry.go:31] will retry after 7.18546202s: exit status 7

multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-341000 status -v=7 --alsologtostderr

multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-341000 status -v=7 --alsologtostderr: exit status 7 (78.550875ms)

-- stdout --

	multinode-341000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I1009 12:38:55.852523    3626 out.go:345] Setting OutFile to fd 1 ...

	I1009 12:38:55.852745    3626 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:38:55.852749    3626 out.go:358] Setting ErrFile to fd 2...

	I1009 12:38:55.852752    3626 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:38:55.852910    3626 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19780-1164/.minikube/bin

	I1009 12:38:55.853069    3626 out.go:352] Setting JSON to false

	I1009 12:38:55.853081    3626 mustload.go:65] Loading cluster: multinode-341000

	I1009 12:38:55.853139    3626 notify.go:220] Checking for updates...

	I1009 12:38:55.853353    3626 config.go:182] Loaded profile config "multinode-341000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I1009 12:38:55.853361    3626 status.go:174] checking status of multinode-341000 ...

	I1009 12:38:55.853667    3626 status.go:371] multinode-341000 host status = "Stopped" (err=<nil>)

	I1009 12:38:55.853671    3626 status.go:384] host is not running, skipping remaining checks

	I1009 12:38:55.853673    3626 status.go:176] multinode-341000 status: &{Name:multinode-341000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

I1009 12:38:55.854661    1686 retry.go:31] will retry after 9.069782719s: exit status 7

multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-341000 status -v=7 --alsologtostderr

multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-341000 status -v=7 --alsologtostderr: exit status 7 (78.737292ms)

-- stdout --

	multinode-341000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I1009 12:39:05.003227    3628 out.go:345] Setting OutFile to fd 1 ...

	I1009 12:39:05.003450    3628 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:39:05.003454    3628 out.go:358] Setting ErrFile to fd 2...

	I1009 12:39:05.003457    3628 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:39:05.003627    3628 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19780-1164/.minikube/bin

	I1009 12:39:05.003782    3628 out.go:352] Setting JSON to false

	I1009 12:39:05.003798    3628 mustload.go:65] Loading cluster: multinode-341000

	I1009 12:39:05.003836    3628 notify.go:220] Checking for updates...

	I1009 12:39:05.004058    3628 config.go:182] Loaded profile config "multinode-341000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I1009 12:39:05.004067    3628 status.go:174] checking status of multinode-341000 ...

	I1009 12:39:05.004368    3628 status.go:371] multinode-341000 host status = "Stopped" (err=<nil>)

	I1009 12:39:05.004373    3628 status.go:384] host is not running, skipping remaining checks

	I1009 12:39:05.004375    3628 status.go:176] multinode-341000 status: &{Name:multinode-341000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

I1009 12:39:05.005345    1686 retry.go:31] will retry after 19.313674791s: exit status 7

multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-341000 status -v=7 --alsologtostderr

multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-341000 status -v=7 --alsologtostderr: exit status 7 (77.132375ms)

-- stdout --

	multinode-341000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I1009 12:39:24.395910    3630 out.go:345] Setting OutFile to fd 1 ...

	I1009 12:39:24.396112    3630 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:39:24.396116    3630 out.go:358] Setting ErrFile to fd 2...

	I1009 12:39:24.396119    3630 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:39:24.396292    3630 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19780-1164/.minikube/bin

	I1009 12:39:24.396438    3630 out.go:352] Setting JSON to false

	I1009 12:39:24.396450    3630 mustload.go:65] Loading cluster: multinode-341000

	I1009 12:39:24.396495    3630 notify.go:220] Checking for updates...

	I1009 12:39:24.396695    3630 config.go:182] Loaded profile config "multinode-341000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I1009 12:39:24.396703    3630 status.go:174] checking status of multinode-341000 ...

	I1009 12:39:24.397012    3630 status.go:371] multinode-341000 host status = "Stopped" (err=<nil>)

	I1009 12:39:24.397017    3630 status.go:384] host is not running, skipping remaining checks

	I1009 12:39:24.397019    3630 status.go:176] multinode-341000 status: &{Name:multinode-341000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

multinode_test.go:294: failed to run minikube status. args "out/minikube-darwin-arm64 -p multinode-341000 status -v=7 --alsologtostderr" : exit status 7

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-341000 -n multinode-341000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-341000 -n multinode-341000: exit status 7 (35.71125ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-341000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/StartAfterStop (51.03s)

=== RUN   TestMultiNode/serial/RestartKeepsNodes

multinode_test.go:314: (dbg) Run:  out/minikube-darwin-arm64 node list -p multinode-341000

multinode_test.go:321: (dbg) Run:  out/minikube-darwin-arm64 stop -p multinode-341000

multinode_test.go:321: (dbg) Done: out/minikube-darwin-arm64 stop -p multinode-341000: (3.3846125s)

multinode_test.go:326: (dbg) Run:  out/minikube-darwin-arm64 start -p multinode-341000 --wait=true -v=8 --alsologtostderr

multinode_test.go:326: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p multinode-341000 --wait=true -v=8 --alsologtostderr: exit status 80 (5.229768708s)

-- stdout --

	* [multinode-341000] minikube v1.34.0 on Darwin 15.0.1 (arm64)

	  - MINIKUBE_LOCATION=19780

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19780-1164/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19780-1164/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on existing profile

	* Starting "multinode-341000" primary control-plane node in "multinode-341000" cluster

	* Restarting existing qemu2 VM for "multinode-341000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Restarting existing qemu2 VM for "multinode-341000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I1009 12:39:27.922443    3654 out.go:345] Setting OutFile to fd 1 ...

	I1009 12:39:27.922653    3654 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:39:27.922657    3654 out.go:358] Setting ErrFile to fd 2...

	I1009 12:39:27.922660    3654 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:39:27.922840    3654 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19780-1164/.minikube/bin

	I1009 12:39:27.924071    3654 out.go:352] Setting JSON to false

	I1009 12:39:27.944201    3654 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":4137,"bootTime":1728498630,"procs":514,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}

	W1009 12:39:27.944283    3654 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I1009 12:39:27.949086    3654 out.go:177] * [multinode-341000] minikube v1.34.0 on Darwin 15.0.1 (arm64)

	I1009 12:39:27.956060    3654 out.go:177]   - MINIKUBE_LOCATION=19780

	I1009 12:39:27.956118    3654 notify.go:220] Checking for updates...

	I1009 12:39:27.963016    3654 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19780-1164/kubeconfig

	I1009 12:39:27.966038    3654 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I1009 12:39:27.969093    3654 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1009 12:39:27.972001    3654 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19780-1164/.minikube

	I1009 12:39:27.975078    3654 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I1009 12:39:27.978405    3654 config.go:182] Loaded profile config "multinode-341000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I1009 12:39:27.978467    3654 driver.go:394] Setting default libvirt URI to qemu:///system

	I1009 12:39:27.982995    3654 out.go:177] * Using the qemu2 driver based on existing profile

	I1009 12:39:27.993640    3654 start.go:297] selected driver: qemu2

	I1009 12:39:27.993647    3654 start.go:901] validating driver "qemu2" against &{Name:multinode-341000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19774/minikube-v1.34.0-1728382514-19774-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kube

rnetesVersion:v1.31.1 ClusterName:multinode-341000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M

ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1009 12:39:27.993703    3654 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I1009 12:39:27.996355    3654 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I1009 12:39:27.996388    3654 cni.go:84] Creating CNI manager for ""

	I1009 12:39:27.996410    3654 cni.go:136] multinode detected (1 nodes found), recommending kindnet

	I1009 12:39:27.996479    3654 start.go:340] cluster config:

	{Name:multinode-341000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19774/minikube-v1.34.0-1728382514-19774-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:multinode-341000 Namespace:default APIServerH

AVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:fals

e DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1009 12:39:28.001023    3654 iso.go:125] acquiring lock: {Name:mka6a0d59ae6cc32794e4fbfa8e5c6ce6a65e504 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1009 12:39:28.009054    3654 out.go:177] * Starting "multinode-341000" primary control-plane node in "multinode-341000" cluster

	I1009 12:39:28.012036    3654 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime docker

	I1009 12:39:28.012053    3654 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19780-1164/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4

	I1009 12:39:28.012061    3654 cache.go:56] Caching tarball of preloaded images

	I1009 12:39:28.012138    3654 preload.go:172] Found /Users/jenkins/minikube-integration/19780-1164/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I1009 12:39:28.012144    3654 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on docker

	I1009 12:39:28.012207    3654 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/multinode-341000/config.json ...

	I1009 12:39:28.012637    3654 start.go:360] acquireMachinesLock for multinode-341000: {Name:mk6dc29eb74286120c58954bae0cd65a85a89b02 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1009 12:39:28.012688    3654 start.go:364] duration metric: took 44.333µs to acquireMachinesLock for "multinode-341000"

	I1009 12:39:28.012697    3654 start.go:96] Skipping create...Using existing machine configuration

	I1009 12:39:28.012701    3654 fix.go:54] fixHost starting: 

	I1009 12:39:28.012821    3654 fix.go:112] recreateIfNeeded on multinode-341000: state=Stopped err=<nil>

	W1009 12:39:28.012830    3654 fix.go:138] unexpected machine state, will restart: <nil>

	I1009 12:39:28.017025    3654 out.go:177] * Restarting existing qemu2 VM for "multinode-341000" ...

	I1009 12:39:28.024033    3654 qemu.go:418] Using hvf for hardware acceleration

	I1009 12:39:28.024075    3654 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/multinode-341000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19780-1164/.minikube/machines/multinode-341000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/multinode-341000/qemu.pid -device virtio-net-pci,netdev=net0,mac=36:b2:c1:94:e1:6a -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/multinode-341000/disk.qcow2

	I1009 12:39:28.026450    3654 main.go:141] libmachine: STDOUT: 

	I1009 12:39:28.026470    3654 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I1009 12:39:28.026502    3654 fix.go:56] duration metric: took 13.799ms for fixHost

	I1009 12:39:28.026506    3654 start.go:83] releasing machines lock for "multinode-341000", held for 13.813709ms

	W1009 12:39:28.026513    3654 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W1009 12:39:28.026561    3654 out.go:270] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I1009 12:39:28.026566    3654 start.go:729] Will try again in 5 seconds ...

	I1009 12:39:33.028623    3654 start.go:360] acquireMachinesLock for multinode-341000: {Name:mk6dc29eb74286120c58954bae0cd65a85a89b02 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1009 12:39:33.029009    3654 start.go:364] duration metric: took 296.25µs to acquireMachinesLock for "multinode-341000"

	I1009 12:39:33.029124    3654 start.go:96] Skipping create...Using existing machine configuration

	I1009 12:39:33.029141    3654 fix.go:54] fixHost starting: 

	I1009 12:39:33.029821    3654 fix.go:112] recreateIfNeeded on multinode-341000: state=Stopped err=<nil>

	W1009 12:39:33.029847    3654 fix.go:138] unexpected machine state, will restart: <nil>

	I1009 12:39:33.034240    3654 out.go:177] * Restarting existing qemu2 VM for "multinode-341000" ...

	I1009 12:39:33.038231    3654 qemu.go:418] Using hvf for hardware acceleration

	I1009 12:39:33.038440    3654 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/multinode-341000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19780-1164/.minikube/machines/multinode-341000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/multinode-341000/qemu.pid -device virtio-net-pci,netdev=net0,mac=36:b2:c1:94:e1:6a -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/multinode-341000/disk.qcow2

	I1009 12:39:33.048067    3654 main.go:141] libmachine: STDOUT: 

	I1009 12:39:33.048126    3654 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I1009 12:39:33.048197    3654 fix.go:56] duration metric: took 19.057458ms for fixHost

	I1009 12:39:33.048211    3654 start.go:83] releasing machines lock for "multinode-341000", held for 19.183875ms

	W1009 12:39:33.048398    3654 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p multinode-341000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p multinode-341000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I1009 12:39:33.056158    3654 out.go:201] 

	W1009 12:39:33.060292    3654 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W1009 12:39:33.060318    3654 out.go:270] * 

	* 

	W1009 12:39:33.063024    3654 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I1009 12:39:33.070207    3654 out.go:201] 

** /stderr **

multinode_test.go:328: failed to run minikube start. args "out/minikube-darwin-arm64 node list -p multinode-341000" : exit status 80

multinode_test.go:331: (dbg) Run:  out/minikube-darwin-arm64 node list -p multinode-341000

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-341000 -n multinode-341000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-341000 -n multinode-341000: exit status 7 (36.2185ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-341000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/RestartKeepsNodes (8.76s)

=== RUN   TestMultiNode/serial/DeleteNode

multinode_test.go:416: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-341000 node delete m03

multinode_test.go:416: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-341000 node delete m03: exit status 83 (43.233959ms)

-- stdout --

	* The control-plane node multinode-341000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p multinode-341000"

-- /stdout --

multinode_test.go:418: node delete returned an error. args "out/minikube-darwin-arm64 -p multinode-341000 node delete m03": exit status 83

multinode_test.go:422: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-341000 status --alsologtostderr

multinode_test.go:422: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-341000 status --alsologtostderr: exit status 7 (34.309417ms)

-- stdout --

	multinode-341000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I1009 12:39:33.272729    3668 out.go:345] Setting OutFile to fd 1 ...

	I1009 12:39:33.272918    3668 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:39:33.272926    3668 out.go:358] Setting ErrFile to fd 2...

	I1009 12:39:33.272928    3668 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:39:33.273054    3668 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19780-1164/.minikube/bin

	I1009 12:39:33.273172    3668 out.go:352] Setting JSON to false

	I1009 12:39:33.273182    3668 mustload.go:65] Loading cluster: multinode-341000

	I1009 12:39:33.273256    3668 notify.go:220] Checking for updates...

	I1009 12:39:33.273408    3668 config.go:182] Loaded profile config "multinode-341000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I1009 12:39:33.273417    3668 status.go:174] checking status of multinode-341000 ...

	I1009 12:39:33.273665    3668 status.go:371] multinode-341000 host status = "Stopped" (err=<nil>)

	I1009 12:39:33.273669    3668 status.go:384] host is not running, skipping remaining checks

	I1009 12:39:33.273670    3668 status.go:176] multinode-341000 status: &{Name:multinode-341000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

multinode_test.go:424: failed to run minikube status. args "out/minikube-darwin-arm64 -p multinode-341000 status --alsologtostderr" : exit status 7

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-341000 -n multinode-341000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-341000 -n multinode-341000: exit status 7 (33.425667ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-341000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/DeleteNode (0.11s)

=== RUN   TestMultiNode/serial/StopMultiNode

multinode_test.go:345: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-341000 stop

multinode_test.go:345: (dbg) Done: out/minikube-darwin-arm64 -p multinode-341000 stop: (1.986878416s)

multinode_test.go:351: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-341000 status

multinode_test.go:351: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-341000 status: exit status 7 (71.005791ms)

-- stdout --

	multinode-341000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

multinode_test.go:358: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-341000 status --alsologtostderr

multinode_test.go:358: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-341000 status --alsologtostderr: exit status 7 (35.22725ms)

-- stdout --

	multinode-341000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I1009 12:39:35.399831    3686 out.go:345] Setting OutFile to fd 1 ...

	I1009 12:39:35.400027    3686 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:39:35.400031    3686 out.go:358] Setting ErrFile to fd 2...

	I1009 12:39:35.400033    3686 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:39:35.400155    3686 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19780-1164/.minikube/bin

	I1009 12:39:35.400272    3686 out.go:352] Setting JSON to false

	I1009 12:39:35.400282    3686 mustload.go:65] Loading cluster: multinode-341000

	I1009 12:39:35.400345    3686 notify.go:220] Checking for updates...

	I1009 12:39:35.400483    3686 config.go:182] Loaded profile config "multinode-341000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I1009 12:39:35.400494    3686 status.go:174] checking status of multinode-341000 ...

	I1009 12:39:35.400731    3686 status.go:371] multinode-341000 host status = "Stopped" (err=<nil>)

	I1009 12:39:35.400734    3686 status.go:384] host is not running, skipping remaining checks

	I1009 12:39:35.400736    3686 status.go:176] multinode-341000 status: &{Name:multinode-341000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

multinode_test.go:364: incorrect number of stopped hosts: args "out/minikube-darwin-arm64 -p multinode-341000 status --alsologtostderr": multinode-341000

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

multinode_test.go:368: incorrect number of stopped kubelets: args "out/minikube-darwin-arm64 -p multinode-341000 status --alsologtostderr": multinode-341000

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-341000 -n multinode-341000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-341000 -n multinode-341000: exit status 7 (34.225583ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-341000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/StopMultiNode (2.13s)

=== RUN   TestMultiNode/serial/RestartMultiNode

multinode_test.go:376: (dbg) Run:  out/minikube-darwin-arm64 start -p multinode-341000 --wait=true -v=8 --alsologtostderr --driver=qemu2 

multinode_test.go:376: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p multinode-341000 --wait=true -v=8 --alsologtostderr --driver=qemu2 : exit status 80 (5.194990792s)

-- stdout --

	* [multinode-341000] minikube v1.34.0 on Darwin 15.0.1 (arm64)

	  - MINIKUBE_LOCATION=19780

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19780-1164/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19780-1164/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on existing profile

	* Starting "multinode-341000" primary control-plane node in "multinode-341000" cluster

	* Restarting existing qemu2 VM for "multinode-341000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Restarting existing qemu2 VM for "multinode-341000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I1009 12:39:35.467504    3690 out.go:345] Setting OutFile to fd 1 ...

	I1009 12:39:35.467653    3690 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:39:35.467657    3690 out.go:358] Setting ErrFile to fd 2...

	I1009 12:39:35.467659    3690 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1009 12:39:35.467793    3690 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19780-1164/.minikube/bin

	I1009 12:39:35.468844    3690 out.go:352] Setting JSON to false

	I1009 12:39:35.486531    3690 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":4145,"bootTime":1728498630,"procs":514,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}

	W1009 12:39:35.486599    3690 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I1009 12:39:35.491242    3690 out.go:177] * [multinode-341000] minikube v1.34.0 on Darwin 15.0.1 (arm64)

	I1009 12:39:35.506234    3690 out.go:177]   - MINIKUBE_LOCATION=19780

	I1009 12:39:35.506245    3690 notify.go:220] Checking for updates...

	I1009 12:39:35.511318    3690 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19780-1164/kubeconfig

	I1009 12:39:35.514171    3690 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I1009 12:39:35.517210    3690 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1009 12:39:35.520193    3690 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19780-1164/.minikube

	I1009 12:39:35.523130    3690 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I1009 12:39:35.526559    3690 config.go:182] Loaded profile config "multinode-341000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I1009 12:39:35.526833    3690 driver.go:394] Setting default libvirt URI to qemu:///system

	I1009 12:39:35.531162    3690 out.go:177] * Using the qemu2 driver based on existing profile

	I1009 12:39:35.538134    3690 start.go:297] selected driver: qemu2

	I1009 12:39:35.538142    3690 start.go:901] validating driver "qemu2" against &{Name:multinode-341000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19774/minikube-v1.34.0-1728382514-19774-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kube

rnetesVersion:v1.31.1 ClusterName:multinode-341000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M

ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1009 12:39:35.538207    3690 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I1009 12:39:35.540753    3690 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I1009 12:39:35.540780    3690 cni.go:84] Creating CNI manager for ""

	I1009 12:39:35.540799    3690 cni.go:136] multinode detected (1 nodes found), recommending kindnet

	I1009 12:39:35.540845    3690 start.go:340] cluster config:

	{Name:multinode-341000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19774/minikube-v1.34.0-1728382514-19774-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1728382586-19774@sha256:5d8c4f6d838467365e214e2194dd0153a763e3f78723b5f2a8e06ef7b47409ec Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:multinode-341000 Namespace:default APIServerH

AVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:fals

e DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1009 12:39:35.545255    3690 iso.go:125] acquiring lock: {Name:mka6a0d59ae6cc32794e4fbfa8e5c6ce6a65e504 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1009 12:39:35.553165    3690 out.go:177] * Starting "multinode-341000" primary control-plane node in "multinode-341000" cluster

	I1009 12:39:35.557200    3690 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime docker

	I1009 12:39:35.557217    3690 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19780-1164/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4

	I1009 12:39:35.557230    3690 cache.go:56] Caching tarball of preloaded images

	I1009 12:39:35.557292    3690 preload.go:172] Found /Users/jenkins/minikube-integration/19780-1164/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I1009 12:39:35.557299    3690 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on docker

	I1009 12:39:35.557351    3690 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19780-1164/.minikube/profiles/multinode-341000/config.json ...

	I1009 12:39:35.557696    3690 start.go:360] acquireMachinesLock for multinode-341000: {Name:mk6dc29eb74286120c58954bae0cd65a85a89b02 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1009 12:39:35.557727    3690 start.go:364] duration metric: took 25.167µs to acquireMachinesLock for "multinode-341000"

	I1009 12:39:35.557736    3690 start.go:96] Skipping create...Using existing machine configuration

	I1009 12:39:35.557741    3690 fix.go:54] fixHost starting: 

	I1009 12:39:35.557861    3690 fix.go:112] recreateIfNeeded on multinode-341000: state=Stopped err=<nil>

	W1009 12:39:35.557869    3690 fix.go:138] unexpected machine state, will restart: <nil>

	I1009 12:39:35.562120    3690 out.go:177] * Restarting existing qemu2 VM for "multinode-341000" ...

	I1009 12:39:35.570102    3690 qemu.go:418] Using hvf for hardware acceleration

	I1009 12:39:35.570146    3690 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/multinode-341000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19780-1164/.minikube/machines/multinode-341000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/multinode-341000/qemu.pid -device virtio-net-pci,netdev=net0,mac=36:b2:c1:94:e1:6a -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/multinode-341000/disk.qcow2

	I1009 12:39:35.572423    3690 main.go:141] libmachine: STDOUT: 

	I1009 12:39:35.572442    3690 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I1009 12:39:35.572472    3690 fix.go:56] duration metric: took 14.729375ms for fixHost

	I1009 12:39:35.572477    3690 start.go:83] releasing machines lock for "multinode-341000", held for 14.745917ms

	W1009 12:39:35.572484    3690 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W1009 12:39:35.572519    3690 out.go:270] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I1009 12:39:35.572524    3690 start.go:729] Will try again in 5 seconds ...

	I1009 12:39:40.574553    3690 start.go:360] acquireMachinesLock for multinode-341000: {Name:mk6dc29eb74286120c58954bae0cd65a85a89b02 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1009 12:39:40.574871    3690 start.go:364] duration metric: took 248.709µs to acquireMachinesLock for "multinode-341000"

	I1009 12:39:40.574974    3690 start.go:96] Skipping create...Using existing machine configuration

	I1009 12:39:40.574993    3690 fix.go:54] fixHost starting: 

	I1009 12:39:40.575631    3690 fix.go:112] recreateIfNeeded on multinode-341000: state=Stopped err=<nil>

	W1009 12:39:40.575658    3690 fix.go:138] unexpected machine state, will restart: <nil>

	I1009 12:39:40.580957    3690 out.go:177] * Restarting existing qemu2 VM for "multinode-341000" ...

	I1009 12:39:40.588818    3690 qemu.go:418] Using hvf for hardware acceleration

	I1009 12:39:40.588982    3690 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/multinode-341000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19780-1164/.minikube/machines/multinode-341000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/multinode-341000/qemu.pid -device virtio-net-pci,netdev=net0,mac=36:b2:c1:94:e1:6a -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19780-1164/.minikube/machines/multinode-341000/disk.qcow2

	I1009 12:39:40.598608    3690 main.go:141] libmachine: STDOUT: 

	I1009 12:39:40.598661    3690 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I1009 12:39:40.598724    3690 fix.go:56] duration metric: took 23.732875ms for fixHost

	I1009 12:39:40.598744    3690 start.go:83] releasing machines lock for "multinode-341000", held for 23.848541ms

	W1009 12:39:40.598956    3690 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p multinode-341000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p multinode-341000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I1009 12:39:40.604079    3690 out.go:201] 

	W1009 12:39:40.607897    3690 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W1009 12:39:40.607920    3690 out.go:270] * 

	* 

	W1009 12:39:40.610801    3690 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I1009 12:39:40.617933    3690 out.go:201] 

** /stderr **

multinode_test.go:378: failed to start cluster. args "out/minikube-darwin-arm64 start -p multinode-341000 --wait=true -v=8 --alsologtostderr --driver=qemu2 " : exit status 80

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-341000 -n multinode-341000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-341000 -n multinode-341000: exit status 7 (70.90075ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-341000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/RestartMultiNode (5.27s)