=== RUN   TestDownloadOnly/v1.20.0/json-events

aaa_download_only_test.go:81: (dbg) Run:  out/minikube-darwin-arm64 start -o=json --download-only -p download-only-210000 --force --alsologtostderr --kubernetes-version=v1.20.0 --container-runtime=docker --driver=qemu2 

aaa_download_only_test.go:81: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -o=json --download-only -p download-only-210000 --force --alsologtostderr --kubernetes-version=v1.20.0 --container-runtime=docker --driver=qemu2 : exit status 40 (14.6898445s)

-- stdout --

	{"specversion":"1.0","id":"a24affd2-349b-4751-91d0-44b93851acb6","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[download-only-210000] minikube v1.34.0 on Darwin 14.5 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}

	{"specversion":"1.0","id":"b5e64fe7-3e82-41dd-90d5-40953dffcc89","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=19575"}}

	{"specversion":"1.0","id":"04cd328e-a617-4268-9982-f8327b712433","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/Users/jenkins/minikube-integration/19575-1140/kubeconfig"}}

	{"specversion":"1.0","id":"a4224007-ee61-4c87-922c-898f4833fb9d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-darwin-arm64"}}

	{"specversion":"1.0","id":"64fba5a3-ffb6-45a8-9f51-15e6a2fd1b9d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}

	{"specversion":"1.0","id":"adca0654-7fcb-48d1-8c0e-7b26120a0428","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/Users/jenkins/minikube-integration/19575-1140/.minikube"}}

	{"specversion":"1.0","id":"a45486c8-4d19-4815-86d0-d8bf7e7fa14c","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.warning","datacontenttype":"application/json","data":{"message":"minikube skips various validations when --force is supplied; this may lead to unexpected behavior"}}

	{"specversion":"1.0","id":"9099c2af-9f3a-4ad3-8705-84ff1c79d3d4","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the qemu2 driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}

	{"specversion":"1.0","id":"48189ff2-a75d-4d5c-bc56-cc86611e8365","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Automatically selected the socket_vmnet network"}}

	{"specversion":"1.0","id":"5a93e79e-c13b-4673-b434-0a44e351d409","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Downloading VM boot image ...","name":"Selecting Driver","totalsteps":"19"}}

	{"specversion":"1.0","id":"29e7623c-0978-4683-8e03-b4a1dbc0a041","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting \"download-only-210000\" primary control-plane node in \"download-only-210000\" cluster","name":"Starting Node","totalsteps":"19"}}

	{"specversion":"1.0","id":"4ee2f20b-e8d0-4f2a-9248-1e05483994b5","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Downloading Kubernetes v1.20.0 preload ...","name":"Starting Node","totalsteps":"19"}}

	{"specversion":"1.0","id":"5cb98d51-d308-4904-99ae-040a76cbc2ed","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"40","issues":"","message":"Failed to cache kubectl: download failed: https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256: getter: \u0026{Ctx:context.Background Src:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256 Dst:/Users/jenkins/minikube-integration/19575-1140/.minikube/cache/darwin/arm64/v1.20.0/kubectl.download Pwd: Mode:2 Umask:---------- Detectors:[0x108cc7960 0x108cc7960 0x108cc7960 0x108cc7960 0x108cc7960 0x108cc7960 0x108cc7960] Decompressors:map[bz2:0x14000637d00 gz:0x14000637d08 tar:0x14000637c90 tar.bz2:0x14000637ca0 tar.gz:0x14000637cb0 tar.xz:0x14000637cc0 tar.zst:0x14000637cd0 tbz2:0x14000637ca0 tgz:0x14

000637cb0 txz:0x14000637cc0 tzst:0x14000637cd0 xz:0x14000637d10 zip:0x14000637d20 zst:0x14000637d18] Getters:map[file:0x1400142e550 http:0x140004e62d0 https:0x140004e6320] Dir:false ProgressListener:\u003cnil\u003e Insecure:false DisableSymlinks:false Options:[]}: invalid checksum: Error downloading checksum file: bad response code: 404","name":"INET_CACHE_KUBECTL","url":""}}

	{"specversion":"1.0","id":"656f904d-a912-42a1-9a3f-68939f1f5d29","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"╭───────────────────────────────────────────────────────────────────────────────────────────╮\n│                                                                                           │\n│    If the above advice does not help, please let us know:                                 │\n│    https://github.com/kubernetes/minikube/issues/new/choose                               │\n│                                                                                           │\n│    Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │\n│

│\n╰───────────────────────────────────────────────────────────────────────────────────────────╯"}}

-- /stdout --

** stderr ** 

	I0904 12:24:43.049256    1663 out.go:345] Setting OutFile to fd 1 ...

	I0904 12:24:43.049408    1663 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 12:24:43.049411    1663 out.go:358] Setting ErrFile to fd 2...

	I0904 12:24:43.049414    1663 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 12:24:43.049537    1663 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19575-1140/.minikube/bin

	W0904 12:24:43.049620    1663 root.go:314] Error reading config file at /Users/jenkins/minikube-integration/19575-1140/.minikube/config/config.json: open /Users/jenkins/minikube-integration/19575-1140/.minikube/config/config.json: no such file or directory

	I0904 12:24:43.050925    1663 out.go:352] Setting JSON to true

	I0904 12:24:43.068724    1663 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":1447,"bootTime":1725476436,"procs":473,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0904 12:24:43.068801    1663 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0904 12:24:43.077918    1663 out.go:97] [download-only-210000] minikube v1.34.0 on Darwin 14.5 (arm64)

	I0904 12:24:43.078071    1663 notify.go:220] Checking for updates...

	W0904 12:24:43.078110    1663 preload.go:293] Failed to list preload files: open /Users/jenkins/minikube-integration/19575-1140/.minikube/cache/preloaded-tarball: no such file or directory

	I0904 12:24:43.079153    1663 out.go:169] MINIKUBE_LOCATION=19575

	I0904 12:24:43.081788    1663 out.go:169] KUBECONFIG=/Users/jenkins/minikube-integration/19575-1140/kubeconfig

	I0904 12:24:43.087890    1663 out.go:169] MINIKUBE_BIN=out/minikube-darwin-arm64

	I0904 12:24:43.090872    1663 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0904 12:24:43.093842    1663 out.go:169] MINIKUBE_HOME=/Users/jenkins/minikube-integration/19575-1140/.minikube

	W0904 12:24:43.099815    1663 out.go:321] minikube skips various validations when --force is supplied; this may lead to unexpected behavior

	I0904 12:24:43.100062    1663 driver.go:394] Setting default libvirt URI to qemu:///system

	I0904 12:24:43.104897    1663 out.go:97] Using the qemu2 driver based on user configuration

	I0904 12:24:43.104918    1663 start.go:297] selected driver: qemu2

	I0904 12:24:43.104934    1663 start.go:901] validating driver "qemu2" against <nil>

	I0904 12:24:43.105000    1663 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0904 12:24:43.107789    1663 out.go:169] Automatically selected the socket_vmnet network

	I0904 12:24:43.113495    1663 start_flags.go:393] Using suggested 4000MB memory alloc based on sys=16384MB, container=0MB

	I0904 12:24:43.113589    1663 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]

	I0904 12:24:43.113668    1663 cni.go:84] Creating CNI manager for ""

	I0904 12:24:43.113685    1663 cni.go:162] CNI unnecessary in this configuration, recommending no CNI

	I0904 12:24:43.113739    1663 start.go:340] cluster config:

	{Name:download-only-210000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:download-only-210000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRI

Socket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs:

AutoPauseInterval:1m0s}

	I0904 12:24:43.118959    1663 iso.go:125] acquiring lock: {Name:mkebc4172c19bd1bff0f54edbc3322d94476263f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0904 12:24:43.123821    1663 out.go:97] Downloading VM boot image ...

	I0904 12:24:43.123836    1663 download.go:107] Downloading: https://storage.googleapis.com/minikube/iso/minikube-v1.34.0-arm64.iso?checksum=file:https://storage.googleapis.com/minikube/iso/minikube-v1.34.0-arm64.iso.sha256 -> /Users/jenkins/minikube-integration/19575-1140/.minikube/cache/iso/arm64/minikube-v1.34.0-arm64.iso

	I0904 12:24:49.582977    1663 out.go:97] Starting "download-only-210000" primary control-plane node in "download-only-210000" cluster

	I0904 12:24:49.583007    1663 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker

	I0904 12:24:49.644887    1663 preload.go:118] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4

	I0904 12:24:49.644896    1663 cache.go:56] Caching tarball of preloaded images

	I0904 12:24:49.645056    1663 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker

	I0904 12:24:49.650171    1663 out.go:97] Downloading Kubernetes v1.20.0 preload ...

	I0904 12:24:49.650178    1663 preload.go:236] getting checksum for preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4 ...

	I0904 12:24:49.738576    1663 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4?checksum=md5:1a3e8f9b29e6affec63d76d0d3000942 -> /Users/jenkins/minikube-integration/19575-1140/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4

	I0904 12:24:56.446254    1663 preload.go:247] saving checksum for preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4 ...

	I0904 12:24:56.446421    1663 preload.go:254] verifying checksum of /Users/jenkins/minikube-integration/19575-1140/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4 ...

	I0904 12:24:57.142867    1663 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on docker

	I0904 12:24:57.143062    1663 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/download-only-210000/config.json ...

	I0904 12:24:57.143092    1663 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/download-only-210000/config.json: {Name:mk4ad6959e28f3b32d62b1914cf69975ab372a33 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0904 12:24:57.143319    1663 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker

	I0904 12:24:57.143499    1663 download.go:107] Downloading: https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256 -> /Users/jenkins/minikube-integration/19575-1140/.minikube/cache/darwin/arm64/v1.20.0/kubectl

	I0904 12:24:57.658995    1663 out.go:193] 

	W0904 12:24:57.665940    1663 out_reason.go:110] Failed to cache kubectl: download failed: https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256: getter: &{Ctx:context.Background Src:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256 Dst:/Users/jenkins/minikube-integration/19575-1140/.minikube/cache/darwin/arm64/v1.20.0/kubectl.download Pwd: Mode:2 Umask:---------- Detectors:[0x108cc7960 0x108cc7960 0x108cc7960 0x108cc7960 0x108cc7960 0x108cc7960 0x108cc7960] Decompressors:map[bz2:0x14000637d00 gz:0x14000637d08 tar:0x14000637c90 tar.bz2:0x14000637ca0 tar.gz:0x14000637cb0 tar.xz:0x14000637cc0 tar.zst:0x14000637cd0 tbz2:0x14000637ca0 tgz:0x14000637cb0 txz:0x14000637cc0 tzst:0x14000637cd0 xz:0x14000637d10 zip:0x14000637d20 zst:0x14000637d18] Getters:map[file:0x1400142e550 http:0x140004e62d0 https:0x140004e6320] Dir:false ProgressList

ener:<nil> Insecure:false DisableSymlinks:false Options:[]}: invalid checksum: Error downloading checksum file: bad response code: 404

	W0904 12:24:57.665968    1663 out_reason.go:110] 

	W0904 12:24:57.676901    1663 out.go:283] ╭───────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                           │

	│    If the above advice does not help, please let us know:                                 │

	│    https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                           │

	│    Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                           │

	╰───────────────────────────────────────────────────────────────────────────────────────────╯

	I0904 12:24:57.680826    1663 out.go:193] 

** /stderr **

aaa_download_only_test.go:83: failed to download only. args: ["start" "-o=json" "--download-only" "-p" "download-only-210000" "--force" "--alsologtostderr" "--kubernetes-version=v1.20.0" "--container-runtime=docker" "--driver=qemu2" ""] exit status 40

--- FAIL: TestDownloadOnly/v1.20.0/json-events (14.69s)

=== RUN   TestDownloadOnly/v1.20.0/kubectl

aaa_download_only_test.go:175: expected the file for binary exist at "/Users/jenkins/minikube-integration/19575-1140/.minikube/cache/darwin/arm64/v1.20.0/kubectl" but got error stat /Users/jenkins/minikube-integration/19575-1140/.minikube/cache/darwin/arm64/v1.20.0/kubectl: no such file or directory

--- FAIL: TestDownloadOnly/v1.20.0/kubectl (0.00s)

=== RUN   TestOffline

=== PAUSE TestOffline

=== CONT  TestOffline

aab_offline_test.go:55: (dbg) Run:  out/minikube-darwin-arm64 start -p offline-docker-414000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=qemu2 

aab_offline_test.go:55: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p offline-docker-414000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=qemu2 : exit status 80 (9.84401825s)

-- stdout --

	* [offline-docker-414000] minikube v1.34.0 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19575

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19575-1140/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19575-1140/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "offline-docker-414000" primary control-plane node in "offline-docker-414000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "offline-docker-414000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0904 13:10:28.830116    4190 out.go:345] Setting OutFile to fd 1 ...

	I0904 13:10:28.830283    4190 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:10:28.830287    4190 out.go:358] Setting ErrFile to fd 2...

	I0904 13:10:28.830289    4190 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:10:28.830427    4190 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19575-1140/.minikube/bin

	I0904 13:10:28.831767    4190 out.go:352] Setting JSON to false

	I0904 13:10:28.849504    4190 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":4192,"bootTime":1725476436,"procs":470,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0904 13:10:28.849577    4190 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0904 13:10:28.854457    4190 out.go:177] * [offline-docker-414000] minikube v1.34.0 on Darwin 14.5 (arm64)

	I0904 13:10:28.862329    4190 out.go:177]   - MINIKUBE_LOCATION=19575

	I0904 13:10:28.862330    4190 notify.go:220] Checking for updates...

	I0904 13:10:28.868293    4190 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19575-1140/kubeconfig

	I0904 13:10:28.871400    4190 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0904 13:10:28.874322    4190 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0904 13:10:28.877323    4190 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19575-1140/.minikube

	I0904 13:10:28.880239    4190 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0904 13:10:28.883697    4190 config.go:182] Loaded profile config "multinode-452000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0904 13:10:28.883755    4190 driver.go:394] Setting default libvirt URI to qemu:///system

	I0904 13:10:28.887283    4190 out.go:177] * Using the qemu2 driver based on user configuration

	I0904 13:10:28.894298    4190 start.go:297] selected driver: qemu2

	I0904 13:10:28.894309    4190 start.go:901] validating driver "qemu2" against <nil>

	I0904 13:10:28.894316    4190 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0904 13:10:28.896365    4190 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0904 13:10:28.899288    4190 out.go:177] * Automatically selected the socket_vmnet network

	I0904 13:10:28.902322    4190 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0904 13:10:28.902363    4190 cni.go:84] Creating CNI manager for ""

	I0904 13:10:28.902375    4190 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0904 13:10:28.902381    4190 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0904 13:10:28.902424    4190 start.go:340] cluster config:

	{Name:offline-docker-414000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:offline-docker-414000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker C

RISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client So

cketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0904 13:10:28.906093    4190 iso.go:125] acquiring lock: {Name:mkebc4172c19bd1bff0f54edbc3322d94476263f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0904 13:10:28.914155    4190 out.go:177] * Starting "offline-docker-414000" primary control-plane node in "offline-docker-414000" cluster

	I0904 13:10:28.918285    4190 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0904 13:10:28.918317    4190 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19575-1140/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4

	I0904 13:10:28.918325    4190 cache.go:56] Caching tarball of preloaded images

	I0904 13:10:28.918389    4190 preload.go:172] Found /Users/jenkins/minikube-integration/19575-1140/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0904 13:10:28.918395    4190 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker

	I0904 13:10:28.918463    4190 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/offline-docker-414000/config.json ...

	I0904 13:10:28.918475    4190 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/offline-docker-414000/config.json: {Name:mkd850453fe080a4eed1d230b86082dbc07ceec7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0904 13:10:28.918779    4190 start.go:360] acquireMachinesLock for offline-docker-414000: {Name:mkffea5767ac0f54c70242857234a501d8b5b2f4 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0904 13:10:28.918815    4190 start.go:364] duration metric: took 25.958µs to acquireMachinesLock for "offline-docker-414000"

	I0904 13:10:28.918827    4190 start.go:93] Provisioning new machine with config: &{Name:offline-docker-414000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.34.0-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:offline-dock

er-414000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker

BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0904 13:10:28.918870    4190 start.go:125] createHost starting for "" (driver="qemu2")

	I0904 13:10:28.920325    4190 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0904 13:10:28.936155    4190 start.go:159] libmachine.API.Create for "offline-docker-414000" (driver="qemu2")

	I0904 13:10:28.936180    4190 client.go:168] LocalClient.Create starting

	I0904 13:10:28.936255    4190 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19575-1140/.minikube/certs/ca.pem

	I0904 13:10:28.936286    4190 main.go:141] libmachine: Decoding PEM data...

	I0904 13:10:28.936296    4190 main.go:141] libmachine: Parsing certificate...

	I0904 13:10:28.936336    4190 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19575-1140/.minikube/certs/cert.pem

	I0904 13:10:28.936365    4190 main.go:141] libmachine: Decoding PEM data...

	I0904 13:10:28.936372    4190 main.go:141] libmachine: Parsing certificate...

	I0904 13:10:28.936732    4190 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19575-1140/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19575-1140/.minikube/cache/iso/arm64/minikube-v1.34.0-arm64.iso...

	I0904 13:10:29.086831    4190 main.go:141] libmachine: Creating SSH key...

	I0904 13:10:29.203932    4190 main.go:141] libmachine: Creating Disk image...

	I0904 13:10:29.203950    4190 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0904 13:10:29.204410    4190 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/offline-docker-414000/disk.qcow2.raw /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/offline-docker-414000/disk.qcow2

	I0904 13:10:29.214256    4190 main.go:141] libmachine: STDOUT: 

	I0904 13:10:29.214276    4190 main.go:141] libmachine: STDERR: 

	I0904 13:10:29.214332    4190 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/offline-docker-414000/disk.qcow2 +20000M

	I0904 13:10:29.223706    4190 main.go:141] libmachine: STDOUT: Image resized.

	I0904 13:10:29.223733    4190 main.go:141] libmachine: STDERR: 

	I0904 13:10:29.223751    4190 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/offline-docker-414000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/offline-docker-414000/disk.qcow2

	I0904 13:10:29.223759    4190 main.go:141] libmachine: Starting QEMU VM...

	I0904 13:10:29.223772    4190 qemu.go:418] Using hvf for hardware acceleration

	I0904 13:10:29.223803    4190 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/offline-docker-414000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/offline-docker-414000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/offline-docker-414000/qemu.pid -device virtio-net-pci,netdev=net0,mac=a6:61:c6:71:6b:35 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/offline-docker-414000/disk.qcow2

	I0904 13:10:29.225595    4190 main.go:141] libmachine: STDOUT: 

	I0904 13:10:29.225612    4190 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0904 13:10:29.225629    4190 client.go:171] duration metric: took 289.449916ms to LocalClient.Create

	I0904 13:10:31.227767    4190 start.go:128] duration metric: took 2.308916334s to createHost

	I0904 13:10:31.227837    4190 start.go:83] releasing machines lock for "offline-docker-414000", held for 2.309056084s

	W0904 13:10:31.227855    4190 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0904 13:10:31.238861    4190 out.go:177] * Deleting "offline-docker-414000" in qemu2 ...

	W0904 13:10:31.253081    4190 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0904 13:10:31.253099    4190 start.go:729] Will try again in 5 seconds ...

	I0904 13:10:36.255348    4190 start.go:360] acquireMachinesLock for offline-docker-414000: {Name:mkffea5767ac0f54c70242857234a501d8b5b2f4 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0904 13:10:36.255882    4190 start.go:364] duration metric: took 414.667µs to acquireMachinesLock for "offline-docker-414000"

	I0904 13:10:36.256023    4190 start.go:93] Provisioning new machine with config: &{Name:offline-docker-414000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.34.0-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:offline-dock

er-414000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker

BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0904 13:10:36.256290    4190 start.go:125] createHost starting for "" (driver="qemu2")

	I0904 13:10:36.264880    4190 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0904 13:10:36.314691    4190 start.go:159] libmachine.API.Create for "offline-docker-414000" (driver="qemu2")

	I0904 13:10:36.314750    4190 client.go:168] LocalClient.Create starting

	I0904 13:10:36.314858    4190 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19575-1140/.minikube/certs/ca.pem

	I0904 13:10:36.314917    4190 main.go:141] libmachine: Decoding PEM data...

	I0904 13:10:36.314934    4190 main.go:141] libmachine: Parsing certificate...

	I0904 13:10:36.314998    4190 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19575-1140/.minikube/certs/cert.pem

	I0904 13:10:36.315042    4190 main.go:141] libmachine: Decoding PEM data...

	I0904 13:10:36.315059    4190 main.go:141] libmachine: Parsing certificate...

	I0904 13:10:36.315595    4190 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19575-1140/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19575-1140/.minikube/cache/iso/arm64/minikube-v1.34.0-arm64.iso...

	I0904 13:10:36.476382    4190 main.go:141] libmachine: Creating SSH key...

	I0904 13:10:36.580443    4190 main.go:141] libmachine: Creating Disk image...

	I0904 13:10:36.580449    4190 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0904 13:10:36.580663    4190 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/offline-docker-414000/disk.qcow2.raw /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/offline-docker-414000/disk.qcow2

	I0904 13:10:36.589890    4190 main.go:141] libmachine: STDOUT: 

	I0904 13:10:36.589907    4190 main.go:141] libmachine: STDERR: 

	I0904 13:10:36.589957    4190 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/offline-docker-414000/disk.qcow2 +20000M

	I0904 13:10:36.597795    4190 main.go:141] libmachine: STDOUT: Image resized.

	I0904 13:10:36.597813    4190 main.go:141] libmachine: STDERR: 

	I0904 13:10:36.597820    4190 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/offline-docker-414000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/offline-docker-414000/disk.qcow2

	I0904 13:10:36.597826    4190 main.go:141] libmachine: Starting QEMU VM...

	I0904 13:10:36.597832    4190 qemu.go:418] Using hvf for hardware acceleration

	I0904 13:10:36.597863    4190 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/offline-docker-414000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/offline-docker-414000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/offline-docker-414000/qemu.pid -device virtio-net-pci,netdev=net0,mac=62:9b:1c:8a:fc:a5 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/offline-docker-414000/disk.qcow2

	I0904 13:10:36.599497    4190 main.go:141] libmachine: STDOUT: 

	I0904 13:10:36.599513    4190 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0904 13:10:36.599524    4190 client.go:171] duration metric: took 284.773167ms to LocalClient.Create

	I0904 13:10:38.601694    4190 start.go:128] duration metric: took 2.345394375s to createHost

	I0904 13:10:38.601798    4190 start.go:83] releasing machines lock for "offline-docker-414000", held for 2.345922333s

	W0904 13:10:38.602187    4190 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p offline-docker-414000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p offline-docker-414000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0904 13:10:38.615781    4190 out.go:201] 

	W0904 13:10:38.618856    4190 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0904 13:10:38.618899    4190 out.go:270] * 

	* 

	W0904 13:10:38.621885    4190 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0904 13:10:38.630730    4190 out.go:201] 

** /stderr **

aab_offline_test.go:58: out/minikube-darwin-arm64 start -p offline-docker-414000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=qemu2  failed: exit status 80

panic.go:626: *** TestOffline FAILED at 2024-09-04 13:10:38.645708 -0700 PDT m=+2755.703776376

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p offline-docker-414000 -n offline-docker-414000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p offline-docker-414000 -n offline-docker-414000: exit status 7 (68.439708ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "offline-docker-414000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "offline-docker-414000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p offline-docker-414000

--- FAIL: TestOffline (9.99s)

=== RUN   TestAddons/parallel/Registry

=== PAUSE TestAddons/parallel/Registry

=== CONT  TestAddons/parallel/Registry

addons_test.go:332: registry stabilized in 1.329375ms

addons_test.go:334: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...

helpers_test.go:344: "registry-6fb4cdfc84-cwbqg" [f7b9bfe5-0693-429f-b374-e1fdc2260b34] Running

addons_test.go:334: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 5.010975084s

addons_test.go:337: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...

helpers_test.go:344: "registry-proxy-2qzcv" [0bbedfdb-5af5-493c-82d3-98bada5a51cc] Running

addons_test.go:337: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 5.009667458s

addons_test.go:342: (dbg) Run:  kubectl --context addons-970000 delete po -l run=registry-test --now

addons_test.go:347: (dbg) Run:  kubectl --context addons-970000 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"

addons_test.go:347: (dbg) Non-zero exit: kubectl --context addons-970000 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": exit status 1 (1m0.063057875s)

-- stdout --

	pod "registry-test" deleted

-- /stdout --

** stderr ** 

	error: timed out waiting for the condition

** /stderr **

addons_test.go:349: failed to hit registry.kube-system.svc.cluster.local. args "kubectl --context addons-970000 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c \"wget --spider -S http://registry.kube-system.svc.cluster.local\"" failed: exit status 1

addons_test.go:353: expected curl response be "HTTP/1.1 200", but got *pod "registry-test" deleted

*

addons_test.go:361: (dbg) Run:  out/minikube-darwin-arm64 -p addons-970000 ip

2024/09/04 12:38:17 [DEBUG] GET http://192.168.105.2:5000

addons_test.go:390: (dbg) Run:  out/minikube-darwin-arm64 -p addons-970000 addons disable registry --alsologtostderr -v=1

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p addons-970000 -n addons-970000

helpers_test.go:244: <<< TestAddons/parallel/Registry FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestAddons/parallel/Registry]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-darwin-arm64 -p addons-970000 logs -n 25

helpers_test.go:252: TestAddons/parallel/Registry logs: 

-- stdout --

	==> Audit <==

	|---------|--------------------------------------|----------------------|---------|---------|---------------------|---------------------|

	| Command |                 Args                 |       Profile        |  User   | Version |     Start Time      |      End Time       |

	|---------|--------------------------------------|----------------------|---------|---------|---------------------|---------------------|

	| start   | -o=json --download-only              | download-only-210000 | jenkins | v1.34.0 | 04 Sep 24 12:24 PDT |                     |

	|         | -p download-only-210000              |                      |         |         |                     |                     |

	|         | --force --alsologtostderr            |                      |         |         |                     |                     |

	|         | --kubernetes-version=v1.20.0         |                      |         |         |                     |                     |

	|         | --container-runtime=docker           |                      |         |         |                     |                     |

	|         | --driver=qemu2                       |                      |         |         |                     |                     |

	| delete  | --all                                | minikube             | jenkins | v1.34.0 | 04 Sep 24 12:24 PDT | 04 Sep 24 12:24 PDT |

	| delete  | -p download-only-210000              | download-only-210000 | jenkins | v1.34.0 | 04 Sep 24 12:24 PDT | 04 Sep 24 12:24 PDT |

	| start   | -o=json --download-only              | download-only-744000 | jenkins | v1.34.0 | 04 Sep 24 12:24 PDT |                     |

	|         | -p download-only-744000              |                      |         |         |                     |                     |

	|         | --force --alsologtostderr            |                      |         |         |                     |                     |

	|         | --kubernetes-version=v1.31.0         |                      |         |         |                     |                     |

	|         | --container-runtime=docker           |                      |         |         |                     |                     |

	|         | --driver=qemu2                       |                      |         |         |                     |                     |

	| delete  | --all                                | minikube             | jenkins | v1.34.0 | 04 Sep 24 12:25 PDT | 04 Sep 24 12:25 PDT |

	| delete  | -p download-only-744000              | download-only-744000 | jenkins | v1.34.0 | 04 Sep 24 12:25 PDT | 04 Sep 24 12:25 PDT |

	| delete  | -p download-only-210000              | download-only-210000 | jenkins | v1.34.0 | 04 Sep 24 12:25 PDT | 04 Sep 24 12:25 PDT |

	| delete  | -p download-only-744000              | download-only-744000 | jenkins | v1.34.0 | 04 Sep 24 12:25 PDT | 04 Sep 24 12:25 PDT |

	| start   | --download-only -p                   | binary-mirror-359000 | jenkins | v1.34.0 | 04 Sep 24 12:25 PDT |                     |

	|         | binary-mirror-359000                 |                      |         |         |                     |                     |

	|         | --alsologtostderr                    |                      |         |         |                     |                     |

	|         | --binary-mirror                      |                      |         |         |                     |                     |

	|         | http://127.0.0.1:49312               |                      |         |         |                     |                     |

	|         | --driver=qemu2                       |                      |         |         |                     |                     |

	| delete  | -p binary-mirror-359000              | binary-mirror-359000 | jenkins | v1.34.0 | 04 Sep 24 12:25 PDT | 04 Sep 24 12:25 PDT |

	| addons  | enable dashboard -p                  | addons-970000        | jenkins | v1.34.0 | 04 Sep 24 12:25 PDT |                     |

	|         | addons-970000                        |                      |         |         |                     |                     |

	| addons  | disable dashboard -p                 | addons-970000        | jenkins | v1.34.0 | 04 Sep 24 12:25 PDT |                     |

	|         | addons-970000                        |                      |         |         |                     |                     |

	| start   | -p addons-970000 --wait=true         | addons-970000        | jenkins | v1.34.0 | 04 Sep 24 12:25 PDT | 04 Sep 24 12:28 PDT |

	|         | --memory=4000 --alsologtostderr      |                      |         |         |                     |                     |

	|         | --addons=registry                    |                      |         |         |                     |                     |

	|         | --addons=metrics-server              |                      |         |         |                     |                     |

	|         | --addons=volumesnapshots             |                      |         |         |                     |                     |

	|         | --addons=csi-hostpath-driver         |                      |         |         |                     |                     |

	|         | --addons=gcp-auth                    |                      |         |         |                     |                     |

	|         | --addons=cloud-spanner               |                      |         |         |                     |                     |

	|         | --addons=inspektor-gadget            |                      |         |         |                     |                     |

	|         | --addons=storage-provisioner-rancher |                      |         |         |                     |                     |

	|         | --addons=nvidia-device-plugin        |                      |         |         |                     |                     |

	|         | --addons=yakd --addons=volcano       |                      |         |         |                     |                     |

	|         | --driver=qemu2  --addons=ingress     |                      |         |         |                     |                     |

	|         | --addons=ingress-dns                 |                      |         |         |                     |                     |

	| addons  | addons-970000 addons disable         | addons-970000        | jenkins | v1.34.0 | 04 Sep 24 12:28 PDT | 04 Sep 24 12:29 PDT |

	|         | volcano --alsologtostderr -v=1       |                      |         |         |                     |                     |

	| addons  | addons-970000 addons                 | addons-970000        | jenkins | v1.34.0 | 04 Sep 24 12:37 PDT | 04 Sep 24 12:38 PDT |

	|         | disable csi-hostpath-driver          |                      |         |         |                     |                     |

	|         | --alsologtostderr -v=1               |                      |         |         |                     |                     |

	| addons  | addons-970000 addons                 | addons-970000        | jenkins | v1.34.0 | 04 Sep 24 12:38 PDT | 04 Sep 24 12:38 PDT |

	|         | disable volumesnapshots              |                      |         |         |                     |                     |

	|         | --alsologtostderr -v=1               |                      |         |         |                     |                     |

	| addons  | addons-970000 addons                 | addons-970000        | jenkins | v1.34.0 | 04 Sep 24 12:38 PDT | 04 Sep 24 12:38 PDT |

	|         | disable metrics-server               |                      |         |         |                     |                     |

	|         | --alsologtostderr -v=1               |                      |         |         |                     |                     |

	| addons  | disable inspektor-gadget -p          | addons-970000        | jenkins | v1.34.0 | 04 Sep 24 12:38 PDT |                     |

	|         | addons-970000                        |                      |         |         |                     |                     |

	| ip      | addons-970000 ip                     | addons-970000        | jenkins | v1.34.0 | 04 Sep 24 12:38 PDT | 04 Sep 24 12:38 PDT |

	| addons  | addons-970000 addons disable         | addons-970000        | jenkins | v1.34.0 | 04 Sep 24 12:38 PDT | 04 Sep 24 12:38 PDT |

	|         | registry --alsologtostderr           |                      |         |         |                     |                     |

	|         | -v=1                                 |                      |         |         |                     |                     |

	|---------|--------------------------------------|----------------------|---------|---------|---------------------|---------------------|

	==> Last Start <==

	Log file created at: 2024/09/04 12:25:07

	Running on machine: MacOS-M1-Agent-2

	Binary: Built with gc go1.22.5 for darwin/arm64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0904 12:25:07.088561    1740 out.go:345] Setting OutFile to fd 1 ...

	I0904 12:25:07.088694    1740 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 12:25:07.088697    1740 out.go:358] Setting ErrFile to fd 2...

	I0904 12:25:07.088700    1740 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 12:25:07.088835    1740 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19575-1140/.minikube/bin

	I0904 12:25:07.089983    1740 out.go:352] Setting JSON to false

	I0904 12:25:07.105996    1740 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":1471,"bootTime":1725476436,"procs":469,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0904 12:25:07.106072    1740 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0904 12:25:07.109618    1740 out.go:177] * [addons-970000] minikube v1.34.0 on Darwin 14.5 (arm64)

	I0904 12:25:07.116621    1740 out.go:177]   - MINIKUBE_LOCATION=19575

	I0904 12:25:07.116687    1740 notify.go:220] Checking for updates...

	I0904 12:25:07.123517    1740 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19575-1140/kubeconfig

	I0904 12:25:07.126596    1740 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0904 12:25:07.129552    1740 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0904 12:25:07.132620    1740 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19575-1140/.minikube

	I0904 12:25:07.135570    1740 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0904 12:25:07.137020    1740 driver.go:394] Setting default libvirt URI to qemu:///system

	I0904 12:25:07.141558    1740 out.go:177] * Using the qemu2 driver based on user configuration

	I0904 12:25:07.148428    1740 start.go:297] selected driver: qemu2

	I0904 12:25:07.148434    1740 start.go:901] validating driver "qemu2" against <nil>

	I0904 12:25:07.148439    1740 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0904 12:25:07.150560    1740 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0904 12:25:07.153537    1740 out.go:177] * Automatically selected the socket_vmnet network

	I0904 12:25:07.156710    1740 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0904 12:25:07.156734    1740 cni.go:84] Creating CNI manager for ""

	I0904 12:25:07.156742    1740 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0904 12:25:07.156745    1740 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0904 12:25:07.156785    1740 start.go:340] cluster config:

	{Name:addons-970000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-970000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: Networ

kPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/v

ar/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0904 12:25:07.160387    1740 iso.go:125] acquiring lock: {Name:mkebc4172c19bd1bff0f54edbc3322d94476263f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0904 12:25:07.167540    1740 out.go:177] * Starting "addons-970000" primary control-plane node in "addons-970000" cluster

	I0904 12:25:07.171553    1740 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0904 12:25:07.171573    1740 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19575-1140/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4

	I0904 12:25:07.171581    1740 cache.go:56] Caching tarball of preloaded images

	I0904 12:25:07.171655    1740 preload.go:172] Found /Users/jenkins/minikube-integration/19575-1140/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0904 12:25:07.171661    1740 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker

	I0904 12:25:07.171861    1740 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/addons-970000/config.json ...

	I0904 12:25:07.171873    1740 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/addons-970000/config.json: {Name:mk9711edb1ea9beb0bb5ede3888400fd268bee07 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0904 12:25:07.172263    1740 start.go:360] acquireMachinesLock for addons-970000: {Name:mkffea5767ac0f54c70242857234a501d8b5b2f4 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0904 12:25:07.172326    1740 start.go:364] duration metric: took 57.166µs to acquireMachinesLock for "addons-970000"

	I0904 12:25:07.172338    1740 start.go:93] Provisioning new machine with config: &{Name:addons-970000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.34.0-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-970000 Namesp

ace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Di

sableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0904 12:25:07.172371    1740 start.go:125] createHost starting for "" (driver="qemu2")

	I0904 12:25:07.181644    1740 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	I0904 12:25:07.420030    1740 start.go:159] libmachine.API.Create for "addons-970000" (driver="qemu2")

	I0904 12:25:07.420070    1740 client.go:168] LocalClient.Create starting

	I0904 12:25:07.420288    1740 main.go:141] libmachine: Creating CA: /Users/jenkins/minikube-integration/19575-1140/.minikube/certs/ca.pem

	I0904 12:25:07.501742    1740 main.go:141] libmachine: Creating client certificate: /Users/jenkins/minikube-integration/19575-1140/.minikube/certs/cert.pem

	I0904 12:25:07.566673    1740 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19575-1140/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19575-1140/.minikube/cache/iso/arm64/minikube-v1.34.0-arm64.iso...

	I0904 12:25:08.274797    1740 main.go:141] libmachine: Creating SSH key...

	I0904 12:25:08.436641    1740 main.go:141] libmachine: Creating Disk image...

	I0904 12:25:08.436647    1740 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0904 12:25:08.436968    1740 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/addons-970000/disk.qcow2.raw /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/addons-970000/disk.qcow2

	I0904 12:25:08.453741    1740 main.go:141] libmachine: STDOUT: 

	I0904 12:25:08.453766    1740 main.go:141] libmachine: STDERR: 

	I0904 12:25:08.453826    1740 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/addons-970000/disk.qcow2 +20000M

	I0904 12:25:08.462064    1740 main.go:141] libmachine: STDOUT: Image resized.

	I0904 12:25:08.462082    1740 main.go:141] libmachine: STDERR: 

	I0904 12:25:08.462096    1740 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/addons-970000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/addons-970000/disk.qcow2

	I0904 12:25:08.462101    1740 main.go:141] libmachine: Starting QEMU VM...

	I0904 12:25:08.462144    1740 qemu.go:418] Using hvf for hardware acceleration

	I0904 12:25:08.462176    1740 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 4000 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/addons-970000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/addons-970000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/addons-970000/qemu.pid -device virtio-net-pci,netdev=net0,mac=ea:a5:69:d1:b6:d6 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/addons-970000/disk.qcow2

	I0904 12:25:08.520679    1740 main.go:141] libmachine: STDOUT: 

	I0904 12:25:08.520705    1740 main.go:141] libmachine: STDERR: 

	I0904 12:25:08.520709    1740 main.go:141] libmachine: Attempt 0

	I0904 12:25:08.520722    1740 main.go:141] libmachine: Searching for ea:a5:69:d1:b6:d6 in /var/db/dhcpd_leases ...

	I0904 12:25:08.520767    1740 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I0904 12:25:08.520789    1740 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:aa:65:72:3a:1b:9b ID:1,aa:65:72:3a:1b:9b Lease:0x66da056d}

	I0904 12:25:10.522907    1740 main.go:141] libmachine: Attempt 1

	I0904 12:25:10.522994    1740 main.go:141] libmachine: Searching for ea:a5:69:d1:b6:d6 in /var/db/dhcpd_leases ...

	I0904 12:25:10.523433    1740 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I0904 12:25:10.523482    1740 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:aa:65:72:3a:1b:9b ID:1,aa:65:72:3a:1b:9b Lease:0x66da056d}

	I0904 12:25:12.525646    1740 main.go:141] libmachine: Attempt 2

	I0904 12:25:12.525724    1740 main.go:141] libmachine: Searching for ea:a5:69:d1:b6:d6 in /var/db/dhcpd_leases ...

	I0904 12:25:12.526137    1740 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I0904 12:25:12.526187    1740 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:aa:65:72:3a:1b:9b ID:1,aa:65:72:3a:1b:9b Lease:0x66da056d}

	I0904 12:25:14.528318    1740 main.go:141] libmachine: Attempt 3

	I0904 12:25:14.528346    1740 main.go:141] libmachine: Searching for ea:a5:69:d1:b6:d6 in /var/db/dhcpd_leases ...

	I0904 12:25:14.528489    1740 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I0904 12:25:14.528506    1740 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:aa:65:72:3a:1b:9b ID:1,aa:65:72:3a:1b:9b Lease:0x66da056d}

	I0904 12:25:16.530510    1740 main.go:141] libmachine: Attempt 4

	I0904 12:25:16.530518    1740 main.go:141] libmachine: Searching for ea:a5:69:d1:b6:d6 in /var/db/dhcpd_leases ...

	I0904 12:25:16.530551    1740 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I0904 12:25:16.530558    1740 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:aa:65:72:3a:1b:9b ID:1,aa:65:72:3a:1b:9b Lease:0x66da056d}

	I0904 12:25:18.532548    1740 main.go:141] libmachine: Attempt 5

	I0904 12:25:18.532560    1740 main.go:141] libmachine: Searching for ea:a5:69:d1:b6:d6 in /var/db/dhcpd_leases ...

	I0904 12:25:18.532588    1740 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I0904 12:25:18.532593    1740 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:aa:65:72:3a:1b:9b ID:1,aa:65:72:3a:1b:9b Lease:0x66da056d}

	I0904 12:25:20.534169    1740 main.go:141] libmachine: Attempt 6

	I0904 12:25:20.534189    1740 main.go:141] libmachine: Searching for ea:a5:69:d1:b6:d6 in /var/db/dhcpd_leases ...

	I0904 12:25:20.534274    1740 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I0904 12:25:20.534284    1740 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:aa:65:72:3a:1b:9b ID:1,aa:65:72:3a:1b:9b Lease:0x66da056d}

	I0904 12:25:22.536311    1740 main.go:141] libmachine: Attempt 7

	I0904 12:25:22.536397    1740 main.go:141] libmachine: Searching for ea:a5:69:d1:b6:d6 in /var/db/dhcpd_leases ...

	I0904 12:25:22.536533    1740 main.go:141] libmachine: Found 2 entries in /var/db/dhcpd_leases!

	I0904 12:25:22.536548    1740 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:ea:a5:69:d1:b6:d6 ID:1,ea:a5:69:d1:b6:d6 Lease:0x66da05a0}

	I0904 12:25:22.536552    1740 main.go:141] libmachine: Found match: ea:a5:69:d1:b6:d6

	I0904 12:25:22.536573    1740 main.go:141] libmachine: IP: 192.168.105.2

	I0904 12:25:22.536579    1740 main.go:141] libmachine: Waiting for VM to start (ssh -p 22 docker@192.168.105.2)...

	I0904 12:25:24.556852    1740 machine.go:93] provisionDockerMachine start ...

	I0904 12:25:24.558351    1740 main.go:141] libmachine: Using SSH client type: native

	I0904 12:25:24.558799    1740 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1049c45a0] 0x1049c6e00 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0904 12:25:24.558813    1740 main.go:141] libmachine: About to run SSH command:

	hostname

	I0904 12:25:24.632982    1740 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube

	I0904 12:25:24.633029    1740 buildroot.go:166] provisioning hostname "addons-970000"

	I0904 12:25:24.633144    1740 main.go:141] libmachine: Using SSH client type: native

	I0904 12:25:24.633399    1740 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1049c45a0] 0x1049c6e00 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0904 12:25:24.633409    1740 main.go:141] libmachine: About to run SSH command:

	sudo hostname addons-970000 && echo "addons-970000" | sudo tee /etc/hostname

	I0904 12:25:24.703051    1740 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-970000

	I0904 12:25:24.703139    1740 main.go:141] libmachine: Using SSH client type: native

	I0904 12:25:24.703308    1740 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1049c45a0] 0x1049c6e00 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0904 12:25:24.703319    1740 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\saddons-970000' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-970000/g' /etc/hosts;

				else 

					echo '127.0.1.1 addons-970000' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0904 12:25:24.758604    1740 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0904 12:25:24.758616    1740 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/19575-1140/.minikube CaCertPath:/Users/jenkins/minikube-integration/19575-1140/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/19575-1140/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/19575-1140/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/19575-1140/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/19575-1140/.minikube}

	I0904 12:25:24.758623    1740 buildroot.go:174] setting up certificates

	I0904 12:25:24.758628    1740 provision.go:84] configureAuth start

	I0904 12:25:24.758632    1740 provision.go:143] copyHostCerts

	I0904 12:25:24.758713    1740 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19575-1140/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/19575-1140/.minikube/cert.pem (1123 bytes)

	I0904 12:25:24.758961    1740 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19575-1140/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/19575-1140/.minikube/key.pem (1675 bytes)

	I0904 12:25:24.759086    1740 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19575-1140/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/19575-1140/.minikube/ca.pem (1078 bytes)

	I0904 12:25:24.759178    1740 provision.go:117] generating server cert: /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/19575-1140/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/19575-1140/.minikube/certs/ca-key.pem org=jenkins.addons-970000 san=[127.0.0.1 192.168.105.2 addons-970000 localhost minikube]

	I0904 12:25:24.838375    1740 provision.go:177] copyRemoteCerts

	I0904 12:25:24.838436    1740 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0904 12:25:24.838453    1740 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/addons-970000/id_rsa Username:docker}

	I0904 12:25:24.866575    1740 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I0904 12:25:24.875498    1740 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19575-1140/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0904 12:25:24.883622    1740 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0904 12:25:24.891562    1740 provision.go:87] duration metric: took 132.924125ms to configureAuth

	I0904 12:25:24.891575    1740 buildroot.go:189] setting minikube options for container-runtime

	I0904 12:25:24.891710    1740 config.go:182] Loaded profile config "addons-970000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0904 12:25:24.891765    1740 main.go:141] libmachine: Using SSH client type: native

	I0904 12:25:24.891858    1740 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1049c45a0] 0x1049c6e00 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0904 12:25:24.891862    1740 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0904 12:25:24.942772    1740 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I0904 12:25:24.942779    1740 buildroot.go:70] root file system type: tmpfs

	I0904 12:25:24.942830    1740 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...

	I0904 12:25:24.942870    1740 main.go:141] libmachine: Using SSH client type: native

	I0904 12:25:24.942975    1740 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1049c45a0] 0x1049c6e00 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0904 12:25:24.943010    1740 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %s "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0904 12:25:24.997218    1740 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0904 12:25:24.997265    1740 main.go:141] libmachine: Using SSH client type: native

	I0904 12:25:24.997385    1740 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1049c45a0] 0x1049c6e00 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0904 12:25:24.997393    1740 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0904 12:25:26.367952    1740 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory

	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.

	I0904 12:25:26.367964    1740 machine.go:96] duration metric: took 1.811128459s to provisionDockerMachine

	I0904 12:25:26.367971    1740 client.go:171] duration metric: took 18.948370042s to LocalClient.Create

	I0904 12:25:26.367984    1740 start.go:167] duration metric: took 18.948435041s to libmachine.API.Create "addons-970000"

	I0904 12:25:26.367990    1740 start.go:293] postStartSetup for "addons-970000" (driver="qemu2")

	I0904 12:25:26.367996    1740 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0904 12:25:26.368068    1740 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0904 12:25:26.368079    1740 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/addons-970000/id_rsa Username:docker}

	I0904 12:25:26.398251    1740 ssh_runner.go:195] Run: cat /etc/os-release

	I0904 12:25:26.400752    1740 info.go:137] Remote host: Buildroot 2023.02.9

	I0904 12:25:26.400763    1740 filesync.go:126] Scanning /Users/jenkins/minikube-integration/19575-1140/.minikube/addons for local assets ...

	I0904 12:25:26.400861    1740 filesync.go:126] Scanning /Users/jenkins/minikube-integration/19575-1140/.minikube/files for local assets ...

	I0904 12:25:26.400893    1740 start.go:296] duration metric: took 32.90075ms for postStartSetup

	I0904 12:25:26.401286    1740 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/addons-970000/config.json ...

	I0904 12:25:26.401487    1740 start.go:128] duration metric: took 19.229589375s to createHost

	I0904 12:25:26.401509    1740 main.go:141] libmachine: Using SSH client type: native

	I0904 12:25:26.401600    1740 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1049c45a0] 0x1049c6e00 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0904 12:25:26.401604    1740 main.go:141] libmachine: About to run SSH command:

	date +%s.%N

	I0904 12:25:26.450511    1740 main.go:141] libmachine: SSH cmd err, output: <nil>: 1725477926.000556669

	I0904 12:25:26.450520    1740 fix.go:216] guest clock: 1725477926.000556669

	I0904 12:25:26.450524    1740 fix.go:229] Guest: 2024-09-04 12:25:26.000556669 -0700 PDT Remote: 2024-09-04 12:25:26.40149 -0700 PDT m=+19.331602793 (delta=-400.933331ms)

	I0904 12:25:26.450536    1740 fix.go:200] guest clock delta is within tolerance: -400.933331ms

	I0904 12:25:26.450538    1740 start.go:83] releasing machines lock for "addons-970000", held for 19.278690125s

	I0904 12:25:26.450842    1740 ssh_runner.go:195] Run: cat /version.json

	I0904 12:25:26.450845    1740 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0904 12:25:26.450849    1740 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/addons-970000/id_rsa Username:docker}

	I0904 12:25:26.450870    1740 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/addons-970000/id_rsa Username:docker}

	I0904 12:25:26.479105    1740 ssh_runner.go:195] Run: systemctl --version

	I0904 12:25:26.528649    1740 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0904 12:25:26.530707    1740 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0904 12:25:26.530739    1740 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0904 12:25:26.536985    1740 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0904 12:25:26.536994    1740 start.go:495] detecting cgroup driver to use...

	I0904 12:25:26.537116    1740 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0904 12:25:26.543852    1740 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"

	I0904 12:25:26.547223    1740 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I0904 12:25:26.550598    1740 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...

	I0904 12:25:26.550627    1740 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I0904 12:25:26.554256    1740 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0904 12:25:26.558054    1740 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I0904 12:25:26.561842    1740 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0904 12:25:26.565695    1740 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0904 12:25:26.569615    1740 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I0904 12:25:26.573580    1740 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"

	I0904 12:25:26.577412    1740 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1  enable_unprivileged_ports = true|' /etc/containerd/config.toml"

	I0904 12:25:26.581184    1740 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0904 12:25:26.584539    1740 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0904 12:25:26.587718    1740 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0904 12:25:26.671501    1740 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I0904 12:25:26.678216    1740 start.go:495] detecting cgroup driver to use...

	I0904 12:25:26.678289    1740 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0904 12:25:26.686004    1740 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0904 12:25:26.691756    1740 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0904 12:25:26.701197    1740 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0904 12:25:26.706827    1740 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0904 12:25:26.712025    1740 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I0904 12:25:26.757534    1740 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0904 12:25:26.763971    1740 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0904 12:25:26.770447    1740 ssh_runner.go:195] Run: which cri-dockerd

	I0904 12:25:26.771833    1740 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I0904 12:25:26.774756    1740 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (190 bytes)

	I0904 12:25:26.780758    1740 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I0904 12:25:26.851317    1740 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I0904 12:25:26.919213    1740 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...

	I0904 12:25:26.919275    1740 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)

	I0904 12:25:26.925343    1740 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0904 12:25:26.995163    1740 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0904 12:25:29.186210    1740 ssh_runner.go:235] Completed: sudo systemctl restart docker: (2.191085s)

	I0904 12:25:29.186285    1740 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket

	I0904 12:25:29.191897    1740 ssh_runner.go:195] Run: sudo systemctl stop cri-docker.socket

	I0904 12:25:29.198543    1740 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service

	I0904 12:25:29.204129    1740 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I0904 12:25:29.270304    1740 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I0904 12:25:29.334654    1740 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0904 12:25:29.420008    1740 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I0904 12:25:29.426953    1740 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service

	I0904 12:25:29.432228    1740 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0904 12:25:29.499556    1740 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service

	I0904 12:25:29.526439    1740 start.go:542] Will wait 60s for socket path /var/run/cri-dockerd.sock

	I0904 12:25:29.526538    1740 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0904 12:25:29.529458    1740 start.go:563] Will wait 60s for crictl version

	I0904 12:25:29.529503    1740 ssh_runner.go:195] Run: which crictl

	I0904 12:25:29.531073    1740 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0904 12:25:29.571469    1740 start.go:579] Version:  0.1.0

	RuntimeName:  docker

	RuntimeVersion:  27.2.0

	RuntimeApiVersion:  v1

	I0904 12:25:29.571539    1740 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0904 12:25:29.588307    1740 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0904 12:25:29.604989    1740 out.go:235] * Preparing Kubernetes v1.31.0 on Docker 27.2.0 ...

	I0904 12:25:29.605071    1740 ssh_runner.go:195] Run: grep 192.168.105.1	host.minikube.internal$ /etc/hosts

	I0904 12:25:29.606724    1740 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.105.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0904 12:25:29.610863    1740 kubeadm.go:883] updating cluster {Name:addons-970000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.34.0-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-970000 Namespace:default APIServ

erHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableO

ptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I0904 12:25:29.610908    1740 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0904 12:25:29.610949    1740 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0904 12:25:29.616480    1740 docker.go:685] Got preloaded images: 

	I0904 12:25:29.616491    1740 docker.go:691] registry.k8s.io/kube-apiserver:v1.31.0 wasn't preloaded

	I0904 12:25:29.616538    1740 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I0904 12:25:29.620427    1740 ssh_runner.go:195] Run: which lz4

	I0904 12:25:29.621861    1740 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4

	I0904 12:25:29.623402    1740 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I0904 12:25:29.623411    1740 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19575-1140/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 --> /preloaded.tar.lz4 (322549298 bytes)

	I0904 12:25:30.865612    1740 docker.go:649] duration metric: took 1.243809917s to copy over tarball

	I0904 12:25:30.865675    1740 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4

	I0904 12:25:31.839828    1740 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I0904 12:25:31.854301    1740 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I0904 12:25:31.858083    1740 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2631 bytes)

	I0904 12:25:31.863944    1740 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0904 12:25:31.942118    1740 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0904 12:25:34.563599    1740 ssh_runner.go:235] Completed: sudo systemctl restart docker: (2.621529666s)

	I0904 12:25:34.563702    1740 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0904 12:25:34.569847    1740 docker.go:685] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.31.0

	registry.k8s.io/kube-scheduler:v1.31.0

	registry.k8s.io/kube-controller-manager:v1.31.0

	registry.k8s.io/kube-proxy:v1.31.0

	registry.k8s.io/etcd:3.5.15-0

	registry.k8s.io/pause:3.10

	registry.k8s.io/coredns/coredns:v1.11.1

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I0904 12:25:34.569857    1740 cache_images.go:84] Images are preloaded, skipping loading

	I0904 12:25:34.569862    1740 kubeadm.go:934] updating node { 192.168.105.2 8443 v1.31.0 docker true true} ...

	I0904 12:25:34.569976    1740 kubeadm.go:946] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.31.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=addons-970000 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.105.2

	[Install]

	 config:

	{KubernetesVersion:v1.31.0 ClusterName:addons-970000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0904 12:25:34.570035    1740 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I0904 12:25:34.591129    1740 cni.go:84] Creating CNI manager for ""

	I0904 12:25:34.591142    1740 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0904 12:25:34.591158    1740 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16

	I0904 12:25:34.591169    1740 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.105.2 APIServerPort:8443 KubernetesVersion:v1.31.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-970000 NodeName:addons-970000 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.105.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.105.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/ku

bernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/cri-dockerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I0904 12:25:34.591234    1740 kubeadm.go:187] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.105.2

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/cri-dockerd.sock

	  name: "addons-970000"

	  kubeletExtraArgs:

	    node-ip: 192.168.105.2

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.105.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.31.0

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/cri-dockerd.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%"

	  nodefs.inodesFree: "0%"

	  imagefs.available: "0%"

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0904 12:25:34.591300    1740 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.0

	I0904 12:25:34.594805    1740 binaries.go:44] Found k8s binaries, skipping transfer

	I0904 12:25:34.594845    1740 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0904 12:25:34.598211    1740 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (313 bytes)

	I0904 12:25:34.604334    1740 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0904 12:25:34.610013    1740 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2158 bytes)

	I0904 12:25:34.615776    1740 ssh_runner.go:195] Run: grep 192.168.105.2	control-plane.minikube.internal$ /etc/hosts

	I0904 12:25:34.617037    1740 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.105.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0904 12:25:34.621406    1740 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0904 12:25:34.712569    1740 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0904 12:25:34.721939    1740 certs.go:68] Setting up /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/addons-970000 for IP: 192.168.105.2

	I0904 12:25:34.721951    1740 certs.go:194] generating shared ca certs ...

	I0904 12:25:34.721960    1740 certs.go:226] acquiring lock for ca certs: {Name:mkd62cc1bdffb2500ac7e662aba46cadabbc6839 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0904 12:25:34.722156    1740 certs.go:240] generating "minikubeCA" ca cert: /Users/jenkins/minikube-integration/19575-1140/.minikube/ca.key

	I0904 12:25:34.808034    1740 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/19575-1140/.minikube/ca.crt ...

	I0904 12:25:34.808043    1740 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19575-1140/.minikube/ca.crt: {Name:mk53d45244ece136adffef8842a275ab0c42d833 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0904 12:25:34.808317    1740 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/19575-1140/.minikube/ca.key ...

	I0904 12:25:34.808321    1740 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19575-1140/.minikube/ca.key: {Name:mke7edac2d3202a64d0181979e912cee22824272 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0904 12:25:34.808449    1740 certs.go:240] generating "proxyClientCA" ca cert: /Users/jenkins/minikube-integration/19575-1140/.minikube/proxy-client-ca.key

	I0904 12:25:34.867073    1740 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/19575-1140/.minikube/proxy-client-ca.crt ...

	I0904 12:25:34.867076    1740 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19575-1140/.minikube/proxy-client-ca.crt: {Name:mka7751235d9c094d2aa594fda90ea48d2140ed7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0904 12:25:34.867227    1740 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/19575-1140/.minikube/proxy-client-ca.key ...

	I0904 12:25:34.867230    1740 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19575-1140/.minikube/proxy-client-ca.key: {Name:mk5fb8d2088bac06c07782d7e5fd3bcaa81a6083 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0904 12:25:34.867348    1740 certs.go:256] generating profile certs ...

	I0904 12:25:34.867386    1740 certs.go:363] generating signed profile cert for "minikube-user": /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/addons-970000/client.key

	I0904 12:25:34.867394    1740 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/addons-970000/client.crt with IP's: []

	I0904 12:25:34.987839    1740 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/addons-970000/client.crt ...

	I0904 12:25:34.987842    1740 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/addons-970000/client.crt: {Name:mkfb6f07008de0843ad96a059a8e97bab8ec6e86 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0904 12:25:34.987980    1740 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/addons-970000/client.key ...

	I0904 12:25:34.987983    1740 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/addons-970000/client.key: {Name:mkc096b6c48a4d999341d0d08387a1163a81d7d9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0904 12:25:34.988097    1740 certs.go:363] generating signed profile cert for "minikube": /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/addons-970000/apiserver.key.26dbc3fd

	I0904 12:25:34.988106    1740 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/addons-970000/apiserver.crt.26dbc3fd with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.105.2]

	I0904 12:25:35.271665    1740 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/addons-970000/apiserver.crt.26dbc3fd ...

	I0904 12:25:35.271678    1740 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/addons-970000/apiserver.crt.26dbc3fd: {Name:mk0bec9045eb77d397cd64c74e66bea6323301bc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0904 12:25:35.271985    1740 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/addons-970000/apiserver.key.26dbc3fd ...

	I0904 12:25:35.271990    1740 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/addons-970000/apiserver.key.26dbc3fd: {Name:mk9ac468829943efea67b28f07c4f59b086e5ce1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0904 12:25:35.272109    1740 certs.go:381] copying /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/addons-970000/apiserver.crt.26dbc3fd -> /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/addons-970000/apiserver.crt

	I0904 12:25:35.272305    1740 certs.go:385] copying /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/addons-970000/apiserver.key.26dbc3fd -> /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/addons-970000/apiserver.key

	I0904 12:25:35.272405    1740 certs.go:363] generating signed profile cert for "aggregator": /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/addons-970000/proxy-client.key

	I0904 12:25:35.272420    1740 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/addons-970000/proxy-client.crt with IP's: []

	I0904 12:25:35.325133    1740 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/addons-970000/proxy-client.crt ...

	I0904 12:25:35.325137    1740 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/addons-970000/proxy-client.crt: {Name:mkc539600b206c43e12b9d5131ffa71f98cc082b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0904 12:25:35.325282    1740 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/addons-970000/proxy-client.key ...

	I0904 12:25:35.325285    1740 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/addons-970000/proxy-client.key: {Name:mkfd54a02eee234ae61a41e66eacad44d6ae9877 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0904 12:25:35.325569    1740 certs.go:484] found cert: /Users/jenkins/minikube-integration/19575-1140/.minikube/certs/ca-key.pem (1675 bytes)

	I0904 12:25:35.325591    1740 certs.go:484] found cert: /Users/jenkins/minikube-integration/19575-1140/.minikube/certs/ca.pem (1078 bytes)

	I0904 12:25:35.325610    1740 certs.go:484] found cert: /Users/jenkins/minikube-integration/19575-1140/.minikube/certs/cert.pem (1123 bytes)

	I0904 12:25:35.325634    1740 certs.go:484] found cert: /Users/jenkins/minikube-integration/19575-1140/.minikube/certs/key.pem (1675 bytes)

	I0904 12:25:35.326084    1740 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19575-1140/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0904 12:25:35.334948    1740 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19575-1140/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0904 12:25:35.342866    1740 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19575-1140/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0904 12:25:35.350943    1740 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19575-1140/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I0904 12:25:35.364908    1740 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/addons-970000/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)

	I0904 12:25:35.373907    1740 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/addons-970000/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0904 12:25:35.385902    1740 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/addons-970000/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0904 12:25:35.394076    1740 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/addons-970000/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0904 12:25:35.402325    1740 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19575-1140/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0904 12:25:35.410407    1740 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0904 12:25:35.417399    1740 ssh_runner.go:195] Run: openssl version

	I0904 12:25:35.419968    1740 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0904 12:25:35.423531    1740 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0904 12:25:35.425006    1740 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep  4 19:25 /usr/share/ca-certificates/minikubeCA.pem

	I0904 12:25:35.425029    1740 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0904 12:25:35.426934    1740 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0904 12:25:35.430564    1740 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0904 12:25:35.431939    1740 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0904 12:25:35.431982    1740 kubeadm.go:392] StartCluster: {Name:addons-970000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.34.0-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-970000 Namespace:default APIServerH

AVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOpti

mizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0904 12:25:35.432044    1740 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0904 12:25:35.439534    1740 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0904 12:25:35.443051    1740 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0904 12:25:35.446325    1740 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0904 12:25:35.449819    1740 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0904 12:25:35.449826    1740 kubeadm.go:157] found existing configuration files:

	I0904 12:25:35.449847    1740 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf

	I0904 12:25:35.453182    1740 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/admin.conf: No such file or directory

	I0904 12:25:35.453205    1740 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf

	I0904 12:25:35.456634    1740 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf

	I0904 12:25:35.459978    1740 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/kubelet.conf: No such file or directory

	I0904 12:25:35.460005    1740 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf

	I0904 12:25:35.463121    1740 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf

	I0904 12:25:35.466296    1740 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/controller-manager.conf: No such file or directory

	I0904 12:25:35.466319    1740 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I0904 12:25:35.469729    1740 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf

	I0904 12:25:35.473266    1740 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/scheduler.conf: No such file or directory

	I0904 12:25:35.473285    1740 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I0904 12:25:35.476672    1740 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"

	I0904 12:25:35.497732    1740 kubeadm.go:310] [init] Using Kubernetes version: v1.31.0

	I0904 12:25:35.497775    1740 kubeadm.go:310] [preflight] Running pre-flight checks

	I0904 12:25:35.534699    1740 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster

	I0904 12:25:35.534788    1740 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I0904 12:25:35.534834    1740 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'

	I0904 12:25:35.538718    1740 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I0904 12:25:35.551897    1740 out.go:235]   - Generating certificates and keys ...

	I0904 12:25:35.551931    1740 kubeadm.go:310] [certs] Using existing ca certificate authority

	I0904 12:25:35.551968    1740 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk

	I0904 12:25:35.587721    1740 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key

	I0904 12:25:35.636446    1740 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key

	I0904 12:25:35.772979    1740 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key

	I0904 12:25:35.843151    1740 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key

	I0904 12:25:35.952425    1740 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key

	I0904 12:25:35.952489    1740 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-970000 localhost] and IPs [192.168.105.2 127.0.0.1 ::1]

	I0904 12:25:36.017585    1740 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key

	I0904 12:25:36.017650    1740 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-970000 localhost] and IPs [192.168.105.2 127.0.0.1 ::1]

	I0904 12:25:36.112139    1740 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key

	I0904 12:25:36.286312    1740 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key

	I0904 12:25:36.431185    1740 kubeadm.go:310] [certs] Generating "sa" key and public key

	I0904 12:25:36.431221    1740 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I0904 12:25:36.619526    1740 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file

	I0904 12:25:36.717835    1740 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file

	I0904 12:25:36.827424    1740 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I0904 12:25:36.882719    1740 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I0904 12:25:36.925999    1740 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I0904 12:25:36.926313    1740 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I0904 12:25:36.928662    1740 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I0904 12:25:36.933008    1740 out.go:235]   - Booting up control plane ...

	I0904 12:25:36.933077    1740 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I0904 12:25:36.933143    1740 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I0904 12:25:36.933187    1740 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I0904 12:25:36.938640    1740 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I0904 12:25:36.941236    1740 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I0904 12:25:36.941272    1740 kubeadm.go:310] [kubelet-start] Starting the kubelet

	I0904 12:25:37.018171    1740 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"

	I0904 12:25:37.018274    1740 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s

	I0904 12:25:37.524784    1740 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 505.995042ms

	I0904 12:25:37.525056    1740 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s

	I0904 12:25:40.525497    1740 kubeadm.go:310] [api-check] The API server is healthy after 3.001479876s

	I0904 12:25:40.531547    1740 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I0904 12:25:40.536400    1740 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I0904 12:25:40.544720    1740 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs

	I0904 12:25:40.544818    1740 kubeadm.go:310] [mark-control-plane] Marking the node addons-970000 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I0904 12:25:40.547597    1740 kubeadm.go:310] [bootstrap-token] Using token: ci1a9i.urqh8y20hj92jxnq

	I0904 12:25:40.561372    1740 out.go:235]   - Configuring RBAC rules ...

	I0904 12:25:40.561425    1740 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I0904 12:25:40.561468    1740 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I0904 12:25:40.562890    1740 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I0904 12:25:40.563868    1740 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I0904 12:25:40.564992    1740 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I0904 12:25:40.565886    1740 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I0904 12:25:40.931759    1740 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I0904 12:25:41.353751    1740 kubeadm.go:310] [addons] Applied essential addon: CoreDNS

	I0904 12:25:41.928879    1740 kubeadm.go:310] [addons] Applied essential addon: kube-proxy

	I0904 12:25:41.929619    1740 kubeadm.go:310] 

	I0904 12:25:41.929663    1740 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!

	I0904 12:25:41.929669    1740 kubeadm.go:310] 

	I0904 12:25:41.929733    1740 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:

	I0904 12:25:41.929742    1740 kubeadm.go:310] 

	I0904 12:25:41.929762    1740 kubeadm.go:310]   mkdir -p $HOME/.kube

	I0904 12:25:41.929830    1740 kubeadm.go:310]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I0904 12:25:41.929866    1740 kubeadm.go:310]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I0904 12:25:41.929870    1740 kubeadm.go:310] 

	I0904 12:25:41.929905    1740 kubeadm.go:310] Alternatively, if you are the root user, you can run:

	I0904 12:25:41.929910    1740 kubeadm.go:310] 

	I0904 12:25:41.929941    1740 kubeadm.go:310]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I0904 12:25:41.929944    1740 kubeadm.go:310] 

	I0904 12:25:41.929979    1740 kubeadm.go:310] You should now deploy a pod network to the cluster.

	I0904 12:25:41.930042    1740 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I0904 12:25:41.930103    1740 kubeadm.go:310]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I0904 12:25:41.930109    1740 kubeadm.go:310] 

	I0904 12:25:41.930169    1740 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities

	I0904 12:25:41.930226    1740 kubeadm.go:310] and service account keys on each node and then running the following as root:

	I0904 12:25:41.930232    1740 kubeadm.go:310] 

	I0904 12:25:41.930352    1740 kubeadm.go:310]   kubeadm join control-plane.minikube.internal:8443 --token ci1a9i.urqh8y20hj92jxnq \

	I0904 12:25:41.930441    1740 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:3feb851b3bc39caa9868530b83b064422b69401534f2eff748003ac6b1086498 \

	I0904 12:25:41.930528    1740 kubeadm.go:310] 	--control-plane 

	I0904 12:25:41.930538    1740 kubeadm.go:310] 

	I0904 12:25:41.930597    1740 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:

	I0904 12:25:41.930606    1740 kubeadm.go:310] 

	I0904 12:25:41.930707    1740 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token ci1a9i.urqh8y20hj92jxnq \

	I0904 12:25:41.930776    1740 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:3feb851b3bc39caa9868530b83b064422b69401534f2eff748003ac6b1086498 

	I0904 12:25:41.931019    1740 kubeadm.go:310] W0904 19:25:35.046485    1596 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "ClusterConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.

	I0904 12:25:41.931241    1740 kubeadm.go:310] W0904 19:25:35.046959    1596 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "InitConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.

	I0904 12:25:41.931343    1740 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I0904 12:25:41.931355    1740 cni.go:84] Creating CNI manager for ""

	I0904 12:25:41.931367    1740 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0904 12:25:41.936095    1740 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...

	I0904 12:25:41.939827    1740 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d

	I0904 12:25:41.944247    1740 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (496 bytes)

	I0904 12:25:41.950435    1740 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0904 12:25:41.950502    1740 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0904 12:25:41.950513    1740 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-970000 minikube.k8s.io/updated_at=2024_09_04T12_25_41_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=8bb47038f7304b869a8e06758662cf35b40689af minikube.k8s.io/name=addons-970000 minikube.k8s.io/primary=true

	I0904 12:25:41.954246    1740 ops.go:34] apiserver oom_adj: -16

	I0904 12:25:42.017212    1740 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0904 12:25:42.519356    1740 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0904 12:25:43.019375    1740 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0904 12:25:43.517411    1740 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0904 12:25:44.019372    1740 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0904 12:25:44.519308    1740 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0904 12:25:45.019296    1740 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0904 12:25:45.519302    1740 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0904 12:25:46.019246    1740 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0904 12:25:46.519383    1740 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0904 12:25:46.582157    1740 kubeadm.go:1113] duration metric: took 4.6318055s to wait for elevateKubeSystemPrivileges

	I0904 12:25:46.582173    1740 kubeadm.go:394] duration metric: took 11.150471792s to StartCluster

	I0904 12:25:46.582186    1740 settings.go:142] acquiring lock: {Name:mk9e5d70c30d2e6b96e7a9eeb7ab14f5f9a1127e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0904 12:25:46.582367    1740 settings.go:150] Updating kubeconfig:  /Users/jenkins/minikube-integration/19575-1140/kubeconfig

	I0904 12:25:46.582602    1740 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19575-1140/kubeconfig: {Name:mk2a8055a803f1d023c814308503721b85f2130e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0904 12:25:46.582870    1740 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0904 12:25:46.582913    1740 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.105.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0904 12:25:46.582998    1740 config.go:182] Loaded profile config "addons-970000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0904 12:25:46.583023    1740 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]

	I0904 12:25:46.583076    1740 addons.go:69] Setting yakd=true in profile "addons-970000"

	I0904 12:25:46.583089    1740 addons.go:234] Setting addon yakd=true in "addons-970000"

	I0904 12:25:46.583090    1740 addons.go:69] Setting inspektor-gadget=true in profile "addons-970000"

	I0904 12:25:46.583094    1740 addons.go:69] Setting default-storageclass=true in profile "addons-970000"

	I0904 12:25:46.583100    1740 addons.go:234] Setting addon inspektor-gadget=true in "addons-970000"

	I0904 12:25:46.583102    1740 host.go:66] Checking if "addons-970000" exists ...

	I0904 12:25:46.583112    1740 host.go:66] Checking if "addons-970000" exists ...

	I0904 12:25:46.583136    1740 addons.go:69] Setting registry=true in profile "addons-970000"

	I0904 12:25:46.583146    1740 addons.go:234] Setting addon registry=true in "addons-970000"

	I0904 12:25:46.583110    1740 addons.go:69] Setting ingress=true in profile "addons-970000"

	I0904 12:25:46.583161    1740 host.go:66] Checking if "addons-970000" exists ...

	I0904 12:25:46.583169    1740 addons.go:234] Setting addon ingress=true in "addons-970000"

	I0904 12:25:46.583184    1740 host.go:66] Checking if "addons-970000" exists ...

	I0904 12:25:46.583136    1740 addons.go:69] Setting volumesnapshots=true in profile "addons-970000"

	I0904 12:25:46.583208    1740 addons.go:234] Setting addon volumesnapshots=true in "addons-970000"

	I0904 12:25:46.583217    1740 host.go:66] Checking if "addons-970000" exists ...

	I0904 12:25:46.583119    1740 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-970000"

	I0904 12:25:46.583446    1740 retry.go:31] will retry after 652.747696ms: connect: dial unix /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/addons-970000/monitor: connect: connection refused

	I0904 12:25:46.583122    1740 addons.go:69] Setting cloud-spanner=true in profile "addons-970000"

	I0904 12:25:46.583487    1740 retry.go:31] will retry after 1.133394846s: connect: dial unix /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/addons-970000/monitor: connect: connection refused

	I0904 12:25:46.583491    1740 addons.go:234] Setting addon cloud-spanner=true in "addons-970000"

	I0904 12:25:46.583503    1740 host.go:66] Checking if "addons-970000" exists ...

	I0904 12:25:46.583515    1740 retry.go:31] will retry after 1.24344709s: connect: dial unix /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/addons-970000/monitor: connect: connection refused

	I0904 12:25:46.583539    1740 retry.go:31] will retry after 504.603169ms: connect: dial unix /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/addons-970000/monitor: connect: connection refused

	I0904 12:25:46.583124    1740 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-970000"

	I0904 12:25:46.583566    1740 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-970000"

	I0904 12:25:46.583574    1740 host.go:66] Checking if "addons-970000" exists ...

	I0904 12:25:46.583126    1740 addons.go:69] Setting storage-provisioner=true in profile "addons-970000"

	I0904 12:25:46.583588    1740 addons.go:234] Setting addon storage-provisioner=true in "addons-970000"

	I0904 12:25:46.583597    1740 host.go:66] Checking if "addons-970000" exists ...

	I0904 12:25:46.583128    1740 addons.go:69] Setting volcano=true in profile "addons-970000"

	I0904 12:25:46.583730    1740 addons.go:234] Setting addon volcano=true in "addons-970000"

	I0904 12:25:46.583739    1740 host.go:66] Checking if "addons-970000" exists ...

	I0904 12:25:46.583130    1740 addons.go:69] Setting metrics-server=true in profile "addons-970000"

	I0904 12:25:46.583837    1740 addons.go:234] Setting addon metrics-server=true in "addons-970000"

	I0904 12:25:46.583844    1740 host.go:66] Checking if "addons-970000" exists ...

	I0904 12:25:46.583903    1740 retry.go:31] will retry after 646.420514ms: connect: dial unix /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/addons-970000/monitor: connect: connection refused

	I0904 12:25:46.583125    1740 addons.go:69] Setting ingress-dns=true in profile "addons-970000"

	I0904 12:25:46.583919    1740 addons.go:234] Setting addon ingress-dns=true in "addons-970000"

	I0904 12:25:46.583931    1740 host.go:66] Checking if "addons-970000" exists ...

	I0904 12:25:46.583133    1740 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-970000"

	I0904 12:25:46.583947    1740 retry.go:31] will retry after 1.1477427s: connect: dial unix /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/addons-970000/monitor: connect: connection refused

	I0904 12:25:46.583966    1740 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-970000"

	I0904 12:25:46.584010    1740 host.go:66] Checking if "addons-970000" exists ...

	I0904 12:25:46.584037    1740 retry.go:31] will retry after 577.424739ms: connect: dial unix /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/addons-970000/monitor: connect: connection refused

	I0904 12:25:46.583968    1740 retry.go:31] will retry after 588.243531ms: connect: dial unix /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/addons-970000/monitor: connect: connection refused

	I0904 12:25:46.583118    1740 addons.go:69] Setting gcp-auth=true in profile "addons-970000"

	I0904 12:25:46.584078    1740 mustload.go:65] Loading cluster: addons-970000

	I0904 12:25:46.583134    1740 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-970000"

	I0904 12:25:46.584117    1740 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-970000"

	I0904 12:25:46.584149    1740 config.go:182] Loaded profile config "addons-970000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0904 12:25:46.584153    1740 retry.go:31] will retry after 759.600794ms: connect: dial unix /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/addons-970000/monitor: connect: connection refused

	I0904 12:25:46.584241    1740 retry.go:31] will retry after 1.436639621s: connect: dial unix /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/addons-970000/monitor: connect: connection refused

	I0904 12:25:46.584275    1740 retry.go:31] will retry after 1.457284227s: connect: dial unix /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/addons-970000/monitor: connect: connection refused

	I0904 12:25:46.584309    1740 retry.go:31] will retry after 675.505235ms: connect: dial unix /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/addons-970000/monitor: connect: connection refused

	I0904 12:25:46.584489    1740 retry.go:31] will retry after 785.483409ms: connect: dial unix /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/addons-970000/monitor: connect: connection refused

	I0904 12:25:46.587420    1740 out.go:177] * Verifying Kubernetes components...

	I0904 12:25:46.595434    1740 out.go:177]   - Using image docker.io/marcnuri/yakd:0.0.5

	I0904 12:25:46.599387    1740 out.go:177]   - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0

	I0904 12:25:46.599418    1740 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0904 12:25:46.603435    1740 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml

	I0904 12:25:46.603449    1740 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)

	I0904 12:25:46.603459    1740 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/addons-970000/id_rsa Username:docker}

	I0904 12:25:46.606329    1740 addons.go:431] installing /etc/kubernetes/addons/ig-namespace.yaml

	I0904 12:25:46.606336    1740 ssh_runner.go:362] scp inspektor-gadget/ig-namespace.yaml --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)

	I0904 12:25:46.606342    1740 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/addons-970000/id_rsa Username:docker}

	I0904 12:25:46.623774    1740 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.105.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0904 12:25:46.701029    1740 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0904 12:25:46.775869    1740 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml

	I0904 12:25:46.775884    1740 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)

	I0904 12:25:46.788334    1740 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml

	I0904 12:25:46.788346    1740 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)

	I0904 12:25:46.794422    1740 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml

	I0904 12:25:46.794434    1740 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)

	I0904 12:25:46.797069    1740 addons.go:431] installing /etc/kubernetes/addons/ig-serviceaccount.yaml

	I0904 12:25:46.797076    1740 ssh_runner.go:362] scp inspektor-gadget/ig-serviceaccount.yaml --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)

	I0904 12:25:46.802309    1740 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml

	I0904 12:25:46.802316    1740 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)

	I0904 12:25:46.804168    1740 addons.go:431] installing /etc/kubernetes/addons/ig-role.yaml

	I0904 12:25:46.804173    1740 ssh_runner.go:362] scp inspektor-gadget/ig-role.yaml --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)

	I0904 12:25:46.810066    1740 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml

	I0904 12:25:46.852374    1740 start.go:971] {"host.minikube.internal": 192.168.105.1} host record injected into CoreDNS's ConfigMap

	I0904 12:25:46.853698    1740 node_ready.go:35] waiting up to 6m0s for node "addons-970000" to be "Ready" ...

	I0904 12:25:46.859871    1740 node_ready.go:49] node "addons-970000" has status "Ready":"True"

	I0904 12:25:46.859889    1740 node_ready.go:38] duration metric: took 6.169416ms for node "addons-970000" to be "Ready" ...

	I0904 12:25:46.859893    1740 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0904 12:25:46.867091    1740 pod_ready.go:79] waiting up to 6m0s for pod "etcd-addons-970000" in "kube-system" namespace to be "Ready" ...

	I0904 12:25:46.867338    1740 addons.go:431] installing /etc/kubernetes/addons/ig-rolebinding.yaml

	I0904 12:25:46.867347    1740 ssh_runner.go:362] scp inspektor-gadget/ig-rolebinding.yaml --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)

	I0904 12:25:46.891411    1740 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrole.yaml

	I0904 12:25:46.891422    1740 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrole.yaml --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)

	I0904 12:25:46.909554    1740 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml

	I0904 12:25:46.909566    1740 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrolebinding.yaml --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)

	I0904 12:25:46.916007    1740 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml

	I0904 12:25:46.916016    1740 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)

	I0904 12:25:46.922260    1740 addons.go:431] installing /etc/kubernetes/addons/ig-daemonset.yaml

	I0904 12:25:46.922268    1740 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)

	I0904 12:25:46.943639    1740 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml

	I0904 12:25:47.093464    1740 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3

	I0904 12:25:47.097428    1740 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:

		minikube -p addons-970000 service yakd-dashboard -n yakd-dashboard

	I0904 12:25:47.101386    1740 out.go:177]   - Using image registry.k8s.io/ingress-nginx/controller:v1.11.2

	I0904 12:25:47.111441    1740 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3

	I0904 12:25:47.115501    1740 addons.go:431] installing /etc/kubernetes/addons/ingress-deploy.yaml

	I0904 12:25:47.115510    1740 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)

	I0904 12:25:47.115521    1740 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/addons-970000/id_rsa Username:docker}

	I0904 12:25:47.167383    1740 out.go:177]   - Using image docker.io/volcanosh/vc-scheduler:v1.9.0

	I0904 12:25:47.171477    1740 out.go:177]   - Using image docker.io/volcanosh/vc-webhook-manager:v1.9.0

	I0904 12:25:47.174413    1740 out.go:177]   - Using image docker.io/volcanosh/vc-controller-manager:v1.9.0

	I0904 12:25:47.177840    1740 addons.go:431] installing /etc/kubernetes/addons/volcano-deployment.yaml

	I0904 12:25:47.177848    1740 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volcano-deployment.yaml (434001 bytes)

	I0904 12:25:47.177858    1740 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/addons-970000/id_rsa Username:docker}

	I0904 12:25:47.184365    1740 out.go:177]   - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.23

	I0904 12:25:47.190619    1740 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml

	I0904 12:25:47.190633    1740 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)

	I0904 12:25:47.190645    1740 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/addons-970000/id_rsa Username:docker}

	I0904 12:25:47.205589    1740 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml

	I0904 12:25:47.234393    1740 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0

	I0904 12:25:47.238480    1740 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0

	I0904 12:25:47.242386    1740 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0

	I0904 12:25:47.246421    1740 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0

	I0904 12:25:47.250276    1740 out.go:177]   - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6

	I0904 12:25:47.250276    1740 out.go:177]   - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0

	I0904 12:25:47.258386    1740 out.go:177]   - Using image docker.io/registry:2.8.3

	I0904 12:25:47.261350    1740 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml

	I0904 12:25:47.261358    1740 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)

	I0904 12:25:47.261369    1740 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/addons-970000/id_rsa Username:docker}

	I0904 12:25:47.262384    1740 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-970000"

	I0904 12:25:47.262401    1740 host.go:66] Checking if "addons-970000" exists ...

	I0904 12:25:47.265398    1740 out.go:177]   - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0

	I0904 12:25:47.265687    1740 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml

	I0904 12:25:47.269399    1740 out.go:177]   - Using image docker.io/rancher/local-path-provisioner:v0.0.22

	I0904 12:25:47.277398    1740 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0

	I0904 12:25:47.277405    1740 out.go:177]   - Using image docker.io/busybox:stable

	I0904 12:25:47.281456    1740 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0

	I0904 12:25:47.281496    1740 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml

	I0904 12:25:47.281504    1740 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)

	I0904 12:25:47.281517    1740 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/addons-970000/id_rsa Username:docker}

	I0904 12:25:47.287365    1740 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml

	I0904 12:25:47.287380    1740 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)

	I0904 12:25:47.287391    1740 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/addons-970000/id_rsa Username:docker}

	I0904 12:25:47.347378    1740 out.go:177]   - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3

	I0904 12:25:47.351427    1740 addons.go:431] installing /etc/kubernetes/addons/ingress-dns-pod.yaml

	I0904 12:25:47.351438    1740 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)

	I0904 12:25:47.351449    1740 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/addons-970000/id_rsa Username:docker}

	I0904 12:25:47.351816    1740 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/deployment.yaml

	I0904 12:25:47.355770    1740 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-970000" context rescaled to 1 replicas

	I0904 12:25:47.374392    1740 out.go:177]   - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.2

	I0904 12:25:47.378450    1740 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml

	I0904 12:25:47.378461    1740 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)

	I0904 12:25:47.378472    1740 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/addons-970000/id_rsa Username:docker}

	I0904 12:25:47.379357    1740 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml

	I0904 12:25:47.379364    1740 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)

	I0904 12:25:47.433290    1740 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml

	I0904 12:25:47.438855    1740 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml

	I0904 12:25:47.438865    1740 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)

	I0904 12:25:47.467876    1740 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml

	I0904 12:25:47.467888    1740 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)

	I0904 12:25:47.537455    1740 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	I0904 12:25:47.537455    1740 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml

	I0904 12:25:47.577695    1740 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml

	I0904 12:25:47.577709    1740 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)

	I0904 12:25:47.644266    1740 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml

	I0904 12:25:47.722899    1740 out.go:177]   - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0

	I0904 12:25:47.728864    1740 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml

	I0904 12:25:47.728880    1740 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)

	I0904 12:25:47.728896    1740 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/addons-970000/id_rsa Username:docker}

	I0904 12:25:47.736756    1740 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0904 12:25:47.742952    1740 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0904 12:25:47.742963    1740 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0904 12:25:47.742975    1740 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/addons-970000/id_rsa Username:docker}

	I0904 12:25:47.759137    1740 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml

	I0904 12:25:47.759149    1740 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)

	I0904 12:25:47.818707    1740 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml

	I0904 12:25:47.818719    1740 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)

	I0904 12:25:47.829926    1740 addons.go:234] Setting addon default-storageclass=true in "addons-970000"

	I0904 12:25:47.829948    1740 host.go:66] Checking if "addons-970000" exists ...

	I0904 12:25:47.831283    1740 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml

	I0904 12:25:47.831300    1740 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0904 12:25:47.831308    1740 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/addons-970000/id_rsa Username:docker}

	I0904 12:25:47.881592    1740 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml

	I0904 12:25:47.881607    1740 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)

	I0904 12:25:47.933032    1740 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml

	I0904 12:25:47.933044    1740 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)

	I0904 12:25:47.958975    1740 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml

	I0904 12:25:47.958988    1740 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)

	I0904 12:25:47.967480    1740 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0904 12:25:48.026514    1740 out.go:177]   - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.2

	I0904 12:25:48.030553    1740 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml

	I0904 12:25:48.030564    1740 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)

	I0904 12:25:48.030574    1740 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/addons-970000/id_rsa Username:docker}

	I0904 12:25:48.030962    1740 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml

	I0904 12:25:48.030969    1740 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)

	I0904 12:25:48.039563    1740 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml

	I0904 12:25:48.039576    1740 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)

	I0904 12:25:48.042220    1740 host.go:66] Checking if "addons-970000" exists ...

	I0904 12:25:48.069181    1740 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0904 12:25:48.085350    1740 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml

	I0904 12:25:48.085363    1740 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)

	I0904 12:25:48.105762    1740 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml

	I0904 12:25:48.105772    1740 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)

	I0904 12:25:48.131617    1740 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml

	I0904 12:25:48.131630    1740 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)

	I0904 12:25:48.176958    1740 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml

	I0904 12:25:48.176968    1740 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)

	I0904 12:25:48.197083    1740 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml

	I0904 12:25:48.197093    1740 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)

	I0904 12:25:48.201401    1740 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0904 12:25:48.201408    1740 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)

	I0904 12:25:48.273399    1740 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0904 12:25:48.317759    1740 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml

	I0904 12:25:48.317771    1740 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)

	I0904 12:25:48.358671    1740 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml

	I0904 12:25:48.358686    1740 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)

	I0904 12:25:48.425439    1740 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml

	I0904 12:25:48.495729    1740 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml

	I0904 12:25:48.495743    1740 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)

	I0904 12:25:48.560335    1740 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml

	I0904 12:25:48.882111    1740 pod_ready.go:103] pod "etcd-addons-970000" in "kube-system" namespace has status "Ready":"False"

	I0904 12:25:50.909910    1740 pod_ready.go:103] pod "etcd-addons-970000" in "kube-system" namespace has status "Ready":"False"

	I0904 12:25:51.094501    1740 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (3.88899325s)

	I0904 12:25:51.094523    1740 addons.go:475] Verifying addon ingress=true in "addons-970000"

	I0904 12:25:51.102292    1740 out.go:177] * Verifying ingress addon...

	I0904 12:25:51.110681    1740 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...

	I0904 12:25:51.113244    1740 kapi.go:86] Found 0 Pods for label selector app.kubernetes.io/name=ingress-nginx

	I0904 12:25:51.281437    1740 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml: (4.015836209s)

	I0904 12:25:51.281522    1740 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (3.929793458s)

	I0904 12:25:51.281583    1740 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (3.848379584s)

	I0904 12:25:51.281630    1740 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (3.744238375s)

	I0904 12:25:51.281639    1740 addons.go:475] Verifying addon registry=true in "addons-970000"

	I0904 12:25:51.281651    1740 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (3.74427475s)

	I0904 12:25:51.281762    1740 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (3.314354416s)

	I0904 12:25:51.281779    1740 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (3.212667459s)

	I0904 12:25:51.281753    1740 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (3.637517s)

	I0904 12:25:51.281822    1740 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (3.008482334s)

	W0904 12:25:51.281835    1740 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I0904 12:25:51.281847    1740 retry.go:31] will retry after 336.458502ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I0904 12:25:51.285609    1740 out.go:177] * Verifying registry addon...

	I0904 12:25:51.294242    1740 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...

	I0904 12:25:51.306837    1740 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry

	I0904 12:25:51.306847    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	W0904 12:25:51.307019    1740 out.go:270] ! Enabling 'default-storageclass' returned an error: running callbacks: [Error making standard the default storage class: Error while marking storage class local-path as non-default: Operation cannot be fulfilled on storageclasses.storage.k8s.io "local-path": the object has been modified; please apply your changes to the latest version and try again]

	I0904 12:25:51.618530    1740 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0904 12:25:51.640773    1740 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (3.215389417s)

	I0904 12:25:51.640793    1740 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (3.080521292s)

	I0904 12:25:51.640801    1740 addons.go:475] Verifying addon metrics-server=true in "addons-970000"

	I0904 12:25:51.640794    1740 addons.go:475] Verifying addon csi-hostpath-driver=true in "addons-970000"

	I0904 12:25:51.644853    1740 out.go:177] * Verifying csi-hostpath-driver addon...

	I0904 12:25:51.655207    1740 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...

	I0904 12:25:51.671343    1740 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver

	I0904 12:25:51.671354    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:25:51.798092    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0904 12:25:52.159770    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:25:52.302474    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0904 12:25:52.735577    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:25:52.815156    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0904 12:25:53.160948    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:25:53.299141    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0904 12:25:53.372809    1740 pod_ready.go:103] pod "etcd-addons-970000" in "kube-system" namespace has status "Ready":"False"

	I0904 12:25:53.712259    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:25:53.796640    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0904 12:25:54.033202    1740 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (2.414710375s)

	I0904 12:25:54.157577    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:25:54.298089    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0904 12:25:54.716174    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:25:54.797902    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0904 12:25:55.159613    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:25:55.297053    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0904 12:25:55.717347    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:25:55.798008    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0904 12:25:55.871363    1740 pod_ready.go:93] pod "etcd-addons-970000" in "kube-system" namespace has status "Ready":"True"

	I0904 12:25:55.871371    1740 pod_ready.go:82] duration metric: took 9.004493208s for pod "etcd-addons-970000" in "kube-system" namespace to be "Ready" ...

	I0904 12:25:55.871376    1740 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-addons-970000" in "kube-system" namespace to be "Ready" ...

	I0904 12:25:55.873188    1740 pod_ready.go:93] pod "kube-apiserver-addons-970000" in "kube-system" namespace has status "Ready":"True"

	I0904 12:25:55.873197    1740 pod_ready.go:82] duration metric: took 1.818ms for pod "kube-apiserver-addons-970000" in "kube-system" namespace to be "Ready" ...

	I0904 12:25:55.873201    1740 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-addons-970000" in "kube-system" namespace to be "Ready" ...

	I0904 12:25:55.875539    1740 pod_ready.go:93] pod "kube-controller-manager-addons-970000" in "kube-system" namespace has status "Ready":"True"

	I0904 12:25:55.875545    1740 pod_ready.go:82] duration metric: took 2.340833ms for pod "kube-controller-manager-addons-970000" in "kube-system" namespace to be "Ready" ...

	I0904 12:25:55.875549    1740 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-fxmzp" in "kube-system" namespace to be "Ready" ...

	I0904 12:25:55.877823    1740 pod_ready.go:93] pod "kube-proxy-fxmzp" in "kube-system" namespace has status "Ready":"True"

	I0904 12:25:55.877829    1740 pod_ready.go:82] duration metric: took 2.2765ms for pod "kube-proxy-fxmzp" in "kube-system" namespace to be "Ready" ...

	I0904 12:25:55.877832    1740 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-addons-970000" in "kube-system" namespace to be "Ready" ...

	I0904 12:25:55.879864    1740 pod_ready.go:93] pod "kube-scheduler-addons-970000" in "kube-system" namespace has status "Ready":"True"

	I0904 12:25:55.879869    1740 pod_ready.go:82] duration metric: took 2.032833ms for pod "kube-scheduler-addons-970000" in "kube-system" namespace to be "Ready" ...

	I0904 12:25:55.879871    1740 pod_ready.go:39] duration metric: took 9.020199208s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0904 12:25:55.879881    1740 api_server.go:52] waiting for apiserver process to appear ...

	I0904 12:25:55.879942    1740 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0904 12:25:55.886906    1740 api_server.go:72] duration metric: took 9.304212292s to wait for apiserver process to appear ...

	I0904 12:25:55.886914    1740 api_server.go:88] waiting for apiserver healthz status ...

	I0904 12:25:55.886921    1740 api_server.go:253] Checking apiserver healthz at https://192.168.105.2:8443/healthz ...

	I0904 12:25:55.889884    1740 api_server.go:279] https://192.168.105.2:8443/healthz returned 200:

	ok

	I0904 12:25:55.890396    1740 api_server.go:141] control plane version: v1.31.0

	I0904 12:25:55.890403    1740 api_server.go:131] duration metric: took 3.486542ms to wait for apiserver health ...

	I0904 12:25:55.890406    1740 system_pods.go:43] waiting for kube-system pods to appear ...

	I0904 12:25:56.076054    1740 system_pods.go:59] 17 kube-system pods found

	I0904 12:25:56.076067    1740 system_pods.go:61] "coredns-6f6b679f8f-9f28x" [50c3900b-01ba-4e8a-adf8-a8433af58bdc] Running

	I0904 12:25:56.076071    1740 system_pods.go:61] "csi-hostpath-attacher-0" [4fbd4ace-a70d-4fc7-970a-6c16b083de57] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])

	I0904 12:25:56.076075    1740 system_pods.go:61] "csi-hostpath-resizer-0" [d39d1f5a-c2c0-48c2-971d-71dc8531883a] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])

	I0904 12:25:56.076081    1740 system_pods.go:61] "csi-hostpathplugin-bgfq2" [4f0503ad-770e-4299-ab1f-e18956492639] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])

	I0904 12:25:56.076085    1740 system_pods.go:61] "etcd-addons-970000" [61205449-44b1-4774-8144-8ebe9a5d1973] Running

	I0904 12:25:56.076087    1740 system_pods.go:61] "kube-apiserver-addons-970000" [82a2f723-2d1d-4afa-a519-7d3e0dcda9c2] Running

	I0904 12:25:56.076089    1740 system_pods.go:61] "kube-controller-manager-addons-970000" [9fbb4ced-189d-44fe-844c-d4f181c64d79] Running

	I0904 12:25:56.076092    1740 system_pods.go:61] "kube-ingress-dns-minikube" [1cb8440d-4a7b-433f-9a4d-9a58171d7ab2] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])

	I0904 12:25:56.076095    1740 system_pods.go:61] "kube-proxy-fxmzp" [d1861af4-2292-49ce-a065-b4db97da1192] Running

	I0904 12:25:56.076096    1740 system_pods.go:61] "kube-scheduler-addons-970000" [77447c35-d662-434e-be3a-66c98ebbdd41] Running

	I0904 12:25:56.076099    1740 system_pods.go:61] "metrics-server-84c5f94fbc-b5mqw" [e8ef34f0-6061-446a-99f1-31ce7bcb791c] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0904 12:25:56.076102    1740 system_pods.go:61] "nvidia-device-plugin-daemonset-4rl79" [e1603688-ffe4-4f9b-bdad-e827397c39d5] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])

	I0904 12:25:56.076105    1740 system_pods.go:61] "registry-6fb4cdfc84-cwbqg" [f7b9bfe5-0693-429f-b374-e1fdc2260b34] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])

	I0904 12:25:56.076107    1740 system_pods.go:61] "registry-proxy-2qzcv" [0bbedfdb-5af5-493c-82d3-98bada5a51cc] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])

	I0904 12:25:56.076110    1740 system_pods.go:61] "snapshot-controller-56fcc65765-m2gwf" [4983e436-349f-4583-8caa-d3fadfcfdf78] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0904 12:25:56.076113    1740 system_pods.go:61] "snapshot-controller-56fcc65765-pq2qv" [f9a56a36-7dc1-450b-8652-62f29a493288] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0904 12:25:56.076114    1740 system_pods.go:61] "storage-provisioner" [531b806b-770d-45d4-887a-a742bc870252] Running

	I0904 12:25:56.076118    1740 system_pods.go:74] duration metric: took 185.700625ms to wait for pod list to return data ...

	I0904 12:25:56.076122    1740 default_sa.go:34] waiting for default service account to be created ...

	I0904 12:25:56.157274    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:25:56.248186    1740 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)

	I0904 12:25:56.248201    1740 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/addons-970000/id_rsa Username:docker}

	I0904 12:25:56.272293    1740 default_sa.go:45] found service account: "default"

	I0904 12:25:56.272302    1740 default_sa.go:55] duration metric: took 196.182167ms for default service account to be created ...

	I0904 12:25:56.272306    1740 system_pods.go:116] waiting for k8s-apps to be running ...

	I0904 12:25:56.282785    1740 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)

	I0904 12:25:56.289807    1740 addons.go:234] Setting addon gcp-auth=true in "addons-970000"

	I0904 12:25:56.289828    1740 host.go:66] Checking if "addons-970000" exists ...

	I0904 12:25:56.290548    1740 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json

	I0904 12:25:56.290557    1740 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/addons-970000/id_rsa Username:docker}

	I0904 12:25:56.296069    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0904 12:25:56.321060    1740 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3

	I0904 12:25:56.325065    1740 out.go:177]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2

	I0904 12:25:56.329921    1740 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml

	I0904 12:25:56.329928    1740 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)

	I0904 12:25:56.336248    1740 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml

	I0904 12:25:56.336256    1740 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)

	I0904 12:25:56.343332    1740 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I0904 12:25:56.343339    1740 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)

	I0904 12:25:56.351668    1740 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I0904 12:25:56.475780    1740 system_pods.go:86] 17 kube-system pods found

	I0904 12:25:56.475792    1740 system_pods.go:89] "coredns-6f6b679f8f-9f28x" [50c3900b-01ba-4e8a-adf8-a8433af58bdc] Running

	I0904 12:25:56.475797    1740 system_pods.go:89] "csi-hostpath-attacher-0" [4fbd4ace-a70d-4fc7-970a-6c16b083de57] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])

	I0904 12:25:56.475800    1740 system_pods.go:89] "csi-hostpath-resizer-0" [d39d1f5a-c2c0-48c2-971d-71dc8531883a] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])

	I0904 12:25:56.475804    1740 system_pods.go:89] "csi-hostpathplugin-bgfq2" [4f0503ad-770e-4299-ab1f-e18956492639] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])

	I0904 12:25:56.475806    1740 system_pods.go:89] "etcd-addons-970000" [61205449-44b1-4774-8144-8ebe9a5d1973] Running

	I0904 12:25:56.475811    1740 system_pods.go:89] "kube-apiserver-addons-970000" [82a2f723-2d1d-4afa-a519-7d3e0dcda9c2] Running

	I0904 12:25:56.475813    1740 system_pods.go:89] "kube-controller-manager-addons-970000" [9fbb4ced-189d-44fe-844c-d4f181c64d79] Running

	I0904 12:25:56.475822    1740 system_pods.go:89] "kube-ingress-dns-minikube" [1cb8440d-4a7b-433f-9a4d-9a58171d7ab2] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])

	I0904 12:25:56.475824    1740 system_pods.go:89] "kube-proxy-fxmzp" [d1861af4-2292-49ce-a065-b4db97da1192] Running

	I0904 12:25:56.475826    1740 system_pods.go:89] "kube-scheduler-addons-970000" [77447c35-d662-434e-be3a-66c98ebbdd41] Running

	I0904 12:25:56.475828    1740 system_pods.go:89] "metrics-server-84c5f94fbc-b5mqw" [e8ef34f0-6061-446a-99f1-31ce7bcb791c] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0904 12:25:56.475832    1740 system_pods.go:89] "nvidia-device-plugin-daemonset-4rl79" [e1603688-ffe4-4f9b-bdad-e827397c39d5] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])

	I0904 12:25:56.475835    1740 system_pods.go:89] "registry-6fb4cdfc84-cwbqg" [f7b9bfe5-0693-429f-b374-e1fdc2260b34] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])

	I0904 12:25:56.475838    1740 system_pods.go:89] "registry-proxy-2qzcv" [0bbedfdb-5af5-493c-82d3-98bada5a51cc] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])

	I0904 12:25:56.475841    1740 system_pods.go:89] "snapshot-controller-56fcc65765-m2gwf" [4983e436-349f-4583-8caa-d3fadfcfdf78] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0904 12:25:56.475844    1740 system_pods.go:89] "snapshot-controller-56fcc65765-pq2qv" [f9a56a36-7dc1-450b-8652-62f29a493288] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0904 12:25:56.475846    1740 system_pods.go:89] "storage-provisioner" [531b806b-770d-45d4-887a-a742bc870252] Running

	I0904 12:25:56.475849    1740 system_pods.go:126] duration metric: took 203.545625ms to wait for k8s-apps to be running ...

	I0904 12:25:56.475853    1740 system_svc.go:44] waiting for kubelet service to be running ....

	I0904 12:25:56.475911    1740 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0904 12:25:56.578773    1740 system_svc.go:56] duration metric: took 102.916333ms WaitForService to wait for kubelet

	I0904 12:25:56.578789    1740 kubeadm.go:582] duration metric: took 9.996113167s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0904 12:25:56.578801    1740 node_conditions.go:102] verifying NodePressure condition ...

	I0904 12:25:56.579787    1740 addons.go:475] Verifying addon gcp-auth=true in "addons-970000"

	I0904 12:25:56.586910    1740 out.go:177] * Verifying gcp-auth addon...

	I0904 12:25:56.593421    1740 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...

	I0904 12:25:56.594694    1740 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=gcp-auth

	I0904 12:25:56.672112    1740 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0904 12:25:56.672121    1740 node_conditions.go:123] node cpu capacity is 2

	I0904 12:25:56.672127    1740 node_conditions.go:105] duration metric: took 93.325334ms to run NodePressure ...

	I0904 12:25:56.672133    1740 start.go:241] waiting for startup goroutines ...

	I0904 12:25:56.696863    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:25:56.798101    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0904 12:25:57.159067    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:25:57.297987    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0904 12:25:57.659163    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:25:57.797901    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0904 12:25:58.198860    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:25:58.429562    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0904 12:25:58.659387    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:25:58.797844    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0904 12:25:59.158063    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:25:59.297162    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0904 12:25:59.659033    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:25:59.797732    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0904 12:26:00.157935    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:00.297807    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0904 12:26:00.659131    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:00.798580    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0904 12:26:01.159071    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:01.297843    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0904 12:26:01.697113    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:01.797846    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0904 12:26:02.199218    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:02.297490    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0904 12:26:02.659818    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:02.798428    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0904 12:26:03.161509    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:03.297977    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0904 12:26:03.698872    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:03.797668    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0904 12:26:04.158626    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:04.297812    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0904 12:26:04.660050    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:04.797005    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0904 12:26:05.159744    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:05.297875    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0904 12:26:05.659021    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:05.797553    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0904 12:26:06.198731    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:06.298069    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0904 12:26:06.659271    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:06.797683    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0904 12:26:07.158914    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:07.296589    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0904 12:26:07.658890    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:07.797811    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0904 12:26:08.161543    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:08.298582    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0904 12:26:08.659832    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:08.798629    1740 kapi.go:107] duration metric: took 17.504353166s to wait for kubernetes.io/minikube-addons=registry ...

	I0904 12:26:09.159651    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:09.658231    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:10.160226    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:10.660377    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:11.160227    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:11.752537    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:12.159376    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:12.659400    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:13.162045    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:13.659575    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:14.161408    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:14.660318    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:15.161961    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:15.661628    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:16.162021    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:16.662149    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:17.162123    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:17.662489    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:18.202575    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:18.662789    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:19.165453    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:19.673395    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:20.166711    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:20.664095    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:21.163893    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:21.663097    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:22.202204    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:22.702166    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:23.164942    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:23.663133    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:24.163776    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:24.700670    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:25.163308    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:25.663896    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:26.164345    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:26.708466    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:27.163734    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:27.720830    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:28.162051    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:28.664249    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:29.165529    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:29.664114    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:30.163193    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:30.664169    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:31.162545    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:31.664998    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:32.164203    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:32.663030    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:33.165181    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:33.663182    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:34.165133    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:34.662826    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:35.164693    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:35.666763    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:36.168268    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:36.665114    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:37.164674    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:37.662946    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:38.166440    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:38.665415    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:39.163181    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:39.663943    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:40.165887    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:40.702645    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:41.163460    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:41.664445    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:42.163938    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:42.704693    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:43.164290    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:43.664628    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:44.165047    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:44.703686    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:45.163846    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:45.665001    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:46.164764    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:46.706346    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0904 12:26:47.170361    1740 kapi.go:107] duration metric: took 55.509727625s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...

	I0904 12:27:13.118315    1740 kapi.go:86] Found 1 Pods for label selector app.kubernetes.io/name=ingress-nginx

	I0904 12:27:13.118326    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:13.620098    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:14.122944    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:14.619412    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:15.122519    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:15.620329    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:16.124217    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:16.622605    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:17.122274    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:17.620183    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:18.122420    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:18.603159    1740 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth

	I0904 12:27:18.603169    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:18.625239    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:19.102134    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:19.119082    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:19.602445    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:19.619198    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:20.107436    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:20.121750    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:20.607156    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:20.622343    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:21.109148    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:21.121797    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:21.602333    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:21.618593    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:22.102448    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:22.119696    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:22.605436    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:22.622321    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:23.103574    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:23.120076    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:23.602504    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:23.619469    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:24.103231    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:24.119809    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:24.602912    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:24.619997    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:25.106364    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:25.121578    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:25.603493    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:25.620217    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:26.109385    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:26.125313    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:26.602960    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:26.620017    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:27.101439    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:27.119479    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:27.602533    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:27.619242    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:28.107876    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:28.122096    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:28.603566    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:28.620859    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:29.107187    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:29.122486    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:29.604166    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:29.620118    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:30.107095    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:30.121096    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:30.603867    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:30.620214    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:31.104828    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:31.121900    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:31.602362    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:31.618844    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:32.102676    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:32.120077    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:32.604076    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:32.620626    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:33.103635    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:33.119348    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:33.603097    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:33.620185    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:34.108188    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:34.122662    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:34.604732    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:34.620477    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:35.107621    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:35.120500    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:35.606349    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:35.622985    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:36.108867    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:36.122018    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:36.605247    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:36.622482    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:37.105901    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:37.121445    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:37.601865    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:37.619689    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:38.103650    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:38.120050    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:38.603878    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:38.619964    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:39.104710    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:39.121730    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:39.606456    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:39.621492    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:40.107427    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:40.122782    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:40.610865    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:40.624592    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:41.108266    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:41.122543    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:41.602121    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:41.618591    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:42.104069    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:42.121032    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:42.605974    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:42.621330    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:43.109781    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:43.122295    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:43.603377    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:43.619717    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:44.104273    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:44.120443    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:44.603441    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:44.619836    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:45.106401    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:45.121880    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:45.602010    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:45.619713    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:46.103312    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:46.119760    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:46.609660    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:46.623204    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:47.109376    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:47.122177    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:47.606732    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:47.621334    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:48.104080    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:48.119416    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:48.605870    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:48.621046    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:49.106368    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:49.120715    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:49.606869    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:49.622394    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:50.106105    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:50.120562    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:50.603521    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:50.620748    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:51.103811    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:51.120324    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:51.602016    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:51.618637    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:52.101373    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:52.118916    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:52.604764    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:52.621254    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:53.104974    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:53.121685    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:53.606732    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:53.621688    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:54.104835    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:54.127865    1740 kapi.go:86] Found 2 Pods for label selector app.kubernetes.io/name=ingress-nginx

	I0904 12:27:54.127877    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:54.601660    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:54.618905    1740 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx

	I0904 12:27:54.618913    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:55.102062    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:55.118938    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:55.601687    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:55.618949    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:56.101168    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:56.118278    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:56.601438    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:56.618648    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:57.101397    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:57.119169    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:57.603586    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:57.621871    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:58.103065    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:58.120279    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:58.602885    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:58.620418    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:59.102684    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:59.119127    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:27:59.602934    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:27:59.619429    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:00.101921    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:00.120950    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:00.602575    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:00.619601    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:01.105576    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:01.204015    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:01.601593    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:01.619327    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:02.101663    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:02.119683    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:02.602180    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:02.619492    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:03.101790    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:03.119754    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:03.601713    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:03.618699    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:04.103437    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:04.120712    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:04.602681    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:04.620306    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:05.102728    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:05.121006    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:05.602652    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:05.620005    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:06.108303    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:06.124921    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:06.606239    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:06.622283    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:07.107038    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:07.123460    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:07.604043    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:07.621873    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:08.102947    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:08.120935    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:08.602339    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:08.620279    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:09.103072    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:09.120928    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:09.601869    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:09.619215    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:10.103314    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:10.120871    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:10.604882    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:10.620356    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:11.102639    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:11.120510    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:11.601739    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:11.618584    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:12.101217    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:12.120710    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:12.607626    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:12.624340    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:13.105979    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:13.123580    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:13.601456    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:13.619763    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:14.102726    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:14.120854    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:14.601519    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:14.702610    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:15.101937    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:15.121008    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:15.606679    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:15.618544    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:16.101695    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:16.118672    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:16.599976    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:16.619451    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:17.100416    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:17.118730    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:17.601183    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:17.619088    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:18.100990    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:18.116768    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:18.601124    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:18.617033    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:19.100974    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:19.118166    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:19.601316    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:19.619002    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:20.100869    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:20.118534    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:20.600774    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:20.617981    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:21.100858    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:21.118380    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:21.600920    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:21.618645    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:22.100221    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:22.117475    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:22.600539    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:22.618352    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:23.101188    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:23.118489    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:23.601155    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:23.619321    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:24.100841    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:24.201745    1740 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0904 12:28:24.599401    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:24.618273    1740 kapi.go:107] duration metric: took 2m33.503846208s to wait for app.kubernetes.io/name=ingress-nginx ...

	I0904 12:28:25.101096    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:25.604606    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:26.100994    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:26.601048    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:27.100232    1740 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0904 12:28:27.601239    1740 kapi.go:107] duration metric: took 2m31.003998625s to wait for kubernetes.io/minikube-addons=gcp-auth ...

	I0904 12:28:27.606257    1740 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-970000 cluster.

	I0904 12:28:27.611246    1740 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.

	I0904 12:28:27.616575    1740 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.

	I0904 12:28:27.621256    1740 out.go:177] * Enabled addons: yakd, inspektor-gadget, volcano, cloud-spanner, ingress-dns, storage-provisioner, nvidia-device-plugin, storage-provisioner-rancher, metrics-server, volumesnapshots, registry, csi-hostpath-driver, ingress, gcp-auth

	I0904 12:28:27.625328    1740 addons.go:510] duration metric: took 2m41.038833916s for enable addons: enabled=[yakd inspektor-gadget volcano cloud-spanner ingress-dns storage-provisioner nvidia-device-plugin storage-provisioner-rancher metrics-server volumesnapshots registry csi-hostpath-driver ingress gcp-auth]

	I0904 12:28:27.625345    1740 start.go:246] waiting for cluster config update ...

	I0904 12:28:27.625356    1740 start.go:255] writing updated cluster config ...

	I0904 12:28:27.625803    1740 ssh_runner.go:195] Run: rm -f paused

	I0904 12:28:27.781192    1740 start.go:600] kubectl: 1.29.2, cluster: 1.31.0 (minor skew: 2)

	I0904 12:28:27.785302    1740 out.go:201] 

	W0904 12:28:27.789228    1740 out.go:270] ! /usr/local/bin/kubectl is version 1.29.2, which may have incompatibilities with Kubernetes 1.31.0.

	I0904 12:28:27.793236    1740 out.go:177]   - Want kubectl v1.31.0? Try 'minikube kubectl -- get pods -A'

	I0904 12:28:27.798252    1740 out.go:177] * Done! kubectl is now configured to use "addons-970000" cluster and "default" namespace by default

	==> Docker <==

	Sep 04 19:38:10 addons-970000 dockerd[1286]: time="2024-09-04T19:38:10.456062929Z" level=info msg="cleaning up dead shim" namespace=moby

	Sep 04 19:38:14 addons-970000 dockerd[1279]: time="2024-09-04T19:38:14.519235107Z" level=info msg="ignoring event" container=5eaf51d7cc055754e4a85e4dbaa7f676d00792d0cdba32f01eecade30c130ec6 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 04 19:38:14 addons-970000 dockerd[1286]: time="2024-09-04T19:38:14.519624096Z" level=info msg="shim disconnected" id=5eaf51d7cc055754e4a85e4dbaa7f676d00792d0cdba32f01eecade30c130ec6 namespace=moby

	Sep 04 19:38:14 addons-970000 dockerd[1286]: time="2024-09-04T19:38:14.519746468Z" level=warning msg="cleaning up after shim disconnected" id=5eaf51d7cc055754e4a85e4dbaa7f676d00792d0cdba32f01eecade30c130ec6 namespace=moby

	Sep 04 19:38:14 addons-970000 dockerd[1286]: time="2024-09-04T19:38:14.519751092Z" level=info msg="cleaning up dead shim" namespace=moby

	Sep 04 19:38:17 addons-970000 dockerd[1279]: time="2024-09-04T19:38:17.802860898Z" level=info msg="ignoring event" container=4a5817d8588aed66111a612b421f22bf922173dc5c2b5de6c15a714db38e22de module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 04 19:38:17 addons-970000 dockerd[1286]: time="2024-09-04T19:38:17.803126974Z" level=info msg="shim disconnected" id=4a5817d8588aed66111a612b421f22bf922173dc5c2b5de6c15a714db38e22de namespace=moby

	Sep 04 19:38:17 addons-970000 dockerd[1286]: time="2024-09-04T19:38:17.803160598Z" level=warning msg="cleaning up after shim disconnected" id=4a5817d8588aed66111a612b421f22bf922173dc5c2b5de6c15a714db38e22de namespace=moby

	Sep 04 19:38:17 addons-970000 dockerd[1286]: time="2024-09-04T19:38:17.803164848Z" level=info msg="cleaning up dead shim" namespace=moby

	Sep 04 19:38:17 addons-970000 dockerd[1279]: time="2024-09-04T19:38:17.941388063Z" level=info msg="ignoring event" container=395ef8a0af1a21c06c5393eb22be47cbed0aa155bf4e04f3adfc104f85c39d44 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 04 19:38:17 addons-970000 dockerd[1286]: time="2024-09-04T19:38:17.941574392Z" level=info msg="shim disconnected" id=395ef8a0af1a21c06c5393eb22be47cbed0aa155bf4e04f3adfc104f85c39d44 namespace=moby

	Sep 04 19:38:17 addons-970000 dockerd[1286]: time="2024-09-04T19:38:17.941607224Z" level=warning msg="cleaning up after shim disconnected" id=395ef8a0af1a21c06c5393eb22be47cbed0aa155bf4e04f3adfc104f85c39d44 namespace=moby

	Sep 04 19:38:17 addons-970000 dockerd[1286]: time="2024-09-04T19:38:17.941611974Z" level=info msg="cleaning up dead shim" namespace=moby

	Sep 04 19:38:17 addons-970000 dockerd[1286]: time="2024-09-04T19:38:17.969989572Z" level=info msg="shim disconnected" id=46dcdf90bb9cb08fa5466ca78613c652e76e8117bac870e2d88e977ab4595840 namespace=moby

	Sep 04 19:38:17 addons-970000 dockerd[1286]: time="2024-09-04T19:38:17.970043112Z" level=warning msg="cleaning up after shim disconnected" id=46dcdf90bb9cb08fa5466ca78613c652e76e8117bac870e2d88e977ab4595840 namespace=moby

	Sep 04 19:38:17 addons-970000 dockerd[1286]: time="2024-09-04T19:38:17.970053945Z" level=info msg="cleaning up dead shim" namespace=moby

	Sep 04 19:38:17 addons-970000 dockerd[1279]: time="2024-09-04T19:38:17.971765690Z" level=info msg="ignoring event" container=46dcdf90bb9cb08fa5466ca78613c652e76e8117bac870e2d88e977ab4595840 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 04 19:38:18 addons-970000 dockerd[1279]: time="2024-09-04T19:38:18.014780122Z" level=info msg="ignoring event" container=4e4ae6c015a4d1c2b484fff5a0c7d7004961707d647a183565a21a9817b9d37f module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 04 19:38:18 addons-970000 dockerd[1286]: time="2024-09-04T19:38:18.015293565Z" level=info msg="shim disconnected" id=4e4ae6c015a4d1c2b484fff5a0c7d7004961707d647a183565a21a9817b9d37f namespace=moby

	Sep 04 19:38:18 addons-970000 dockerd[1286]: time="2024-09-04T19:38:18.015325522Z" level=warning msg="cleaning up after shim disconnected" id=4e4ae6c015a4d1c2b484fff5a0c7d7004961707d647a183565a21a9817b9d37f namespace=moby

	Sep 04 19:38:18 addons-970000 dockerd[1286]: time="2024-09-04T19:38:18.015343355Z" level=info msg="cleaning up dead shim" namespace=moby

	Sep 04 19:38:18 addons-970000 dockerd[1286]: time="2024-09-04T19:38:18.055602890Z" level=info msg="shim disconnected" id=4b6fe9ce41eb96cbbc747c500a970c0b33ee72b3cc73f126fa5a64953efa6e33 namespace=moby

	Sep 04 19:38:18 addons-970000 dockerd[1286]: time="2024-09-04T19:38:18.055636889Z" level=warning msg="cleaning up after shim disconnected" id=4b6fe9ce41eb96cbbc747c500a970c0b33ee72b3cc73f126fa5a64953efa6e33 namespace=moby

	Sep 04 19:38:18 addons-970000 dockerd[1286]: time="2024-09-04T19:38:18.055641472Z" level=info msg="cleaning up dead shim" namespace=moby

	Sep 04 19:38:18 addons-970000 dockerd[1279]: time="2024-09-04T19:38:18.055795092Z" level=info msg="ignoring event" container=4b6fe9ce41eb96cbbc747c500a970c0b33ee72b3cc73f126fa5a64953efa6e33 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	==> container status <==

	CONTAINER           IMAGE                                                                                                                        CREATED             STATE               NAME                       ATTEMPT             POD ID              POD

	34ac11fa0e25e       gcr.io/k8s-minikube/gcp-auth-webhook@sha256:e6c5b3bc32072ea370d34c27836efd11b3519d25bd444c2a8efc339cff0e20fb                 9 minutes ago       Running             gcp-auth                   0                   068ee55f3f018       gcp-auth-89d5ffd79-hx7s7

	07524b1629acf       registry.k8s.io/ingress-nginx/controller@sha256:d5f8217feeac4887cb1ed21f27c2674e58be06bd8f5184cacea2a69abaf78dce             9 minutes ago       Running             controller                 0                   99ed196c88bb4       ingress-nginx-controller-bc57996ff-w7xdq

	2550f8447886d       registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:a320a50cc91bd15fd2d6fa6de58bd98c1bd64b9a6f926ce23a600d87043455a3   10 minutes ago      Exited              patch                      0                   de663a6315131       ingress-nginx-admission-patch-bv58f

	0f7d823fbbecd       registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:a320a50cc91bd15fd2d6fa6de58bd98c1bd64b9a6f926ce23a600d87043455a3   10 minutes ago      Exited              create                     0                   f1c8fa41fbec1       ingress-nginx-admission-create-m2tqw

	974b235d3113e       rancher/local-path-provisioner@sha256:e34c88ae0affb1cdefbb874140d6339d4a27ec4ee420ae8199cd839997b05246                       11 minutes ago      Running             local-path-provisioner     0                   6e7ca48c19fec       local-path-provisioner-86d989889c-vt2vp

	f5f00871017b3       gcr.io/k8s-minikube/minikube-ingress-dns@sha256:4211a1de532376c881851542238121b26792225faa36a7b02dccad88fd05797c             12 minutes ago      Running             minikube-ingress-dns       0                   cfb44ef8f433a       kube-ingress-dns-minikube

	d4e15243e6fa6       nvcr.io/nvidia/k8s-device-plugin@sha256:ed39e22c8b71343fb996737741a99da88ce6c75dd83b5c520e0b3d8e8a884c47                     12 minutes ago      Running             nvidia-device-plugin-ctr   0                   3d352921669e6       nvidia-device-plugin-daemonset-4rl79

	46dcdf90bb9cb       gcr.io/k8s-minikube/kube-registry-proxy@sha256:b3fa0b2df8737fdb85ad5918a7e2652527463e357afff83a5e5bb966bcedc367              12 minutes ago      Exited              registry-proxy             0                   4b6fe9ce41eb9       registry-proxy-2qzcv

	395ef8a0af1a2       registry@sha256:12120425f07de11a1b899e418d4b0ea174c8d4d572d45bdb640f93bc7ca06a3d                                             12 minutes ago      Exited              registry                   0                   4e4ae6c015a4d       registry-6fb4cdfc84-cwbqg

	b4a6b33e44cf6       gcr.io/cloud-spanner-emulator/emulator@sha256:636fdfc528824bae5f0ea2eca6ae307fe81092f05ec21038008bc0d6100e52fc               12 minutes ago      Running             cloud-spanner-emulator     0                   d42c5b329ac53       cloud-spanner-emulator-769b77f747-n5nxb

	3ffbb3a49c768       marcnuri/yakd@sha256:c5414196116a2266ad097b0468833b73ef1d6c7922241115fe203fb826381624                                        12 minutes ago      Running             yakd                       0                   8754a0f7d0491       yakd-dashboard-67d98fc6b-tghdh

	13130b9acdd91       ba04bb24b9575                                                                                                                12 minutes ago      Running             storage-provisioner        0                   38c58bfff05a3       storage-provisioner

	c1ea33efb2245       2437cf7621777                                                                                                                12 minutes ago      Running             coredns                    0                   54eaaf125c952       coredns-6f6b679f8f-9f28x

	3c14e64de28eb       71d55d66fd4ee                                                                                                                12 minutes ago      Running             kube-proxy                 0                   d8908019aa0a3       kube-proxy-fxmzp

	9e049193af794       27e3830e14027                                                                                                                12 minutes ago      Running             etcd                       0                   5e6317a320108       etcd-addons-970000

	15a480f5f3e1b       fbbbd428abb4d                                                                                                                12 minutes ago      Running             kube-scheduler             0                   9b6e64445f6fa       kube-scheduler-addons-970000

	b17584f23a445       fcb0683e6bdbd                                                                                                                12 minutes ago      Running             kube-controller-manager    0                   e9e554b71153e       kube-controller-manager-addons-970000

	908daf31e6f99       cd0f0ae0ec9e0                                                                                                                12 minutes ago      Running             kube-apiserver             0                   a8a56d8d76a88       kube-apiserver-addons-970000

	==> controller_ingress [07524b1629ac] <==

	W0904 19:28:24.125285       7 client_config.go:659] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.

	I0904 19:28:24.125416       7 main.go:205] "Creating API client" host="https://10.96.0.1:443"

	I0904 19:28:24.128449       7 main.go:248] "Running in Kubernetes cluster" major="1" minor="31" git="v1.31.0" state="clean" commit="9edcffcde5595e8a5b1a35f88c421764e575afce" platform="linux/arm64"

	I0904 19:28:24.156587       7 main.go:101] "SSL fake certificate created" file="/etc/ingress-controller/ssl/default-fake-certificate.pem"

	I0904 19:28:24.163865       7 ssl.go:535] "loading tls certificate" path="/usr/local/certificates/cert" key="/usr/local/certificates/key"

	I0904 19:28:24.168543       7 nginx.go:271] "Starting NGINX Ingress controller"

	I0904 19:28:24.173185       7 event.go:377] Event(v1.ObjectReference{Kind:"ConfigMap", Namespace:"ingress-nginx", Name:"ingress-nginx-controller", UID:"ca7504f7-ee67-46a6-ac72-57814021f4e9", APIVersion:"v1", ResourceVersion:"687", FieldPath:""}): type: 'Normal' reason: 'CREATE' ConfigMap ingress-nginx/ingress-nginx-controller

	I0904 19:28:24.174431       7 event.go:377] Event(v1.ObjectReference{Kind:"ConfigMap", Namespace:"ingress-nginx", Name:"tcp-services", UID:"95b525ab-d43f-401e-955b-39d050c22b1b", APIVersion:"v1", ResourceVersion:"695", FieldPath:""}): type: 'Normal' reason: 'CREATE' ConfigMap ingress-nginx/tcp-services

	I0904 19:28:24.174442       7 event.go:377] Event(v1.ObjectReference{Kind:"ConfigMap", Namespace:"ingress-nginx", Name:"udp-services", UID:"8c1adfb2-d655-4d9e-8a34-f442cea64469", APIVersion:"v1", ResourceVersion:"697", FieldPath:""}): type: 'Normal' reason: 'CREATE' ConfigMap ingress-nginx/udp-services

	I0904 19:28:25.370497       7 nginx.go:317] "Starting NGINX process"

	I0904 19:28:25.370534       7 leaderelection.go:250] attempting to acquire leader lease ingress-nginx/ingress-nginx-leader...

	I0904 19:28:25.370678       7 nginx.go:337] "Starting validation webhook" address=":8443" certPath="/usr/local/certificates/cert" keyPath="/usr/local/certificates/key"

	I0904 19:28:25.371102       7 controller.go:193] "Configuration changes detected, backend reload required"

	I0904 19:28:25.378563       7 leaderelection.go:260] successfully acquired lease ingress-nginx/ingress-nginx-leader

	I0904 19:28:25.378715       7 status.go:85] "New leader elected" identity="ingress-nginx-controller-bc57996ff-w7xdq"

	I0904 19:28:25.382539       7 status.go:219] "POD is not ready" pod="ingress-nginx/ingress-nginx-controller-bc57996ff-w7xdq" node="addons-970000"

	I0904 19:28:25.387897       7 controller.go:213] "Backend successfully reloaded"

	I0904 19:28:25.389846       7 controller.go:224] "Initial sync, sleeping for 1 second"

	I0904 19:28:25.390095       7 event.go:377] Event(v1.ObjectReference{Kind:"Pod", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-bc57996ff-w7xdq", UID:"ffbe9c17-dcb7-48d6-9c72-235b21df32d5", APIVersion:"v1", ResourceVersion:"1254", FieldPath:""}): type: 'Normal' reason: 'RELOAD' NGINX reload triggered due to a change in configuration

	  Build:         46e76e5916813cfca2a9b0bfdc34b69a0000f6b9

	  Repository:    https://github.com/kubernetes/ingress-nginx

	  nginx version: nginx/1.25.5

	-------------------------------------------------------------------------------

	==> coredns [c1ea33efb224] <==

	[INFO] 127.0.0.1:38061 - 62447 "HINFO IN 4482410825358278108.3751266110202374879. udp 57 false 512" NXDOMAIN qr,rd,ra 132 0.009653875s

	[INFO] 10.244.0.6:35735 - 32076 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000150417s

	[INFO] 10.244.0.6:35735 - 35649 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000193167s

	[INFO] 10.244.0.6:40125 - 29770 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000051041s

	[INFO] 10.244.0.6:40125 - 13428 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000028833s

	[INFO] 10.244.0.6:59601 - 23598 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000049542s

	[INFO] 10.244.0.6:59601 - 9512 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000126708s

	[INFO] 10.244.0.6:56005 - 233 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.00003975s

	[INFO] 10.244.0.6:56005 - 2534 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000039542s

	[INFO] 10.244.0.6:43853 - 26661 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000043084s

	[INFO] 10.244.0.6:43853 - 8231 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000027667s

	[INFO] 10.244.0.6:38371 - 62822 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000015208s

	[INFO] 10.244.0.6:38371 - 50017 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000021083s

	[INFO] 10.244.0.6:37350 - 24825 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000020083s

	[INFO] 10.244.0.6:37350 - 21498 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000023667s

	[INFO] 10.244.0.6:37996 - 7972 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000016292s

	[INFO] 10.244.0.6:37996 - 45610 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000018292s

	[INFO] 10.244.0.24:39603 - 27853 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.005627844s

	[INFO] 10.244.0.24:44379 - 64034 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.005780927s

	[INFO] 10.244.0.24:40230 - 46069 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000762996s

	[INFO] 10.244.0.24:35533 - 25063 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000319081s

	[INFO] 10.244.0.24:43057 - 31951 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000054083s

	[INFO] 10.244.0.24:59854 - 37197 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.00004975s

	[INFO] 10.244.0.24:38377 - 7021 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 192 0.002594736s

	[INFO] 10.244.0.24:34623 - 36287 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.002634569s

	==> describe nodes <==

	Name:               addons-970000

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=arm64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=arm64

	                    kubernetes.io/hostname=addons-970000

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=8bb47038f7304b869a8e06758662cf35b40689af

	                    minikube.k8s.io/name=addons-970000

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2024_09_04T12_25_41_0700

	                    minikube.k8s.io/version=v1.34.0

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	                    topology.hostpath.csi/node=addons-970000

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Wed, 04 Sep 2024 19:25:38 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  addons-970000

	  AcquireTime:     <unset>

	  RenewTime:       Wed, 04 Sep 2024 19:38:17 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Wed, 04 Sep 2024 19:34:20 +0000   Wed, 04 Sep 2024 19:25:38 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Wed, 04 Sep 2024 19:34:20 +0000   Wed, 04 Sep 2024 19:25:38 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Wed, 04 Sep 2024 19:34:20 +0000   Wed, 04 Sep 2024 19:25:38 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Wed, 04 Sep 2024 19:34:20 +0000   Wed, 04 Sep 2024 19:25:44 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.105.2

	  Hostname:    addons-970000

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3904744Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3904744Ki

	  pods:               110

	System Info:

	  Machine ID:                 d220942cb38140de900e72c7ecb1a229

	  System UUID:                d220942cb38140de900e72c7ecb1a229

	  Boot ID:                    3e655381-2c10-4087-8c0d-f62db1e5610d

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               arm64

	  Container Runtime Version:  docker://27.2.0

	  Kubelet Version:            v1.31.0

	  Kube-Proxy Version:         

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (16 in total)

	  Namespace                   Name                                        CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                        ------------  ----------  ---------------  -------------  ---

	  default                     busybox                                     0 (0%)        0 (0%)      0 (0%)           0 (0%)         9m12s

	  default                     cloud-spanner-emulator-769b77f747-n5nxb     0 (0%)        0 (0%)      0 (0%)           0 (0%)         12m

	  default                     registry-test                               0 (0%)        0 (0%)      0 (0%)           0 (0%)         61s

	  gcp-auth                    gcp-auth-89d5ffd79-hx7s7                    0 (0%)        0 (0%)      0 (0%)           0 (0%)         11m

	  ingress-nginx               ingress-nginx-controller-bc57996ff-w7xdq    100m (5%)     0 (0%)      90Mi (2%)        0 (0%)         11m

	  kube-system                 coredns-6f6b679f8f-9f28x                    100m (5%)     0 (0%)      70Mi (1%)        170Mi (4%)     12m

	  kube-system                 etcd-addons-970000                          100m (5%)     0 (0%)      100Mi (2%)       0 (0%)         12m

	  kube-system                 kube-apiserver-addons-970000                250m (12%)    0 (0%)      0 (0%)           0 (0%)         12m

	  kube-system                 kube-controller-manager-addons-970000       200m (10%)    0 (0%)      0 (0%)           0 (0%)         12m

	  kube-system                 kube-ingress-dns-minikube                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         12m

	  kube-system                 kube-proxy-fxmzp                            0 (0%)        0 (0%)      0 (0%)           0 (0%)         12m

	  kube-system                 kube-scheduler-addons-970000                100m (5%)     0 (0%)      0 (0%)           0 (0%)         12m

	  kube-system                 nvidia-device-plugin-daemonset-4rl79        0 (0%)        0 (0%)      0 (0%)           0 (0%)         12m

	  kube-system                 storage-provisioner                         0 (0%)        0 (0%)      0 (0%)           0 (0%)         12m

	  local-path-storage          local-path-provisioner-86d989889c-vt2vp     0 (0%)        0 (0%)      0 (0%)           0 (0%)         12m

	  yakd-dashboard              yakd-dashboard-67d98fc6b-tghdh              0 (0%)        0 (0%)      128Mi (3%)       256Mi (6%)     12m

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests     Limits

	  --------           --------     ------

	  cpu                850m (42%)   0 (0%)

	  memory             388Mi (10%)  426Mi (11%)

	  ephemeral-storage  0 (0%)       0 (0%)

	  hugepages-1Gi      0 (0%)       0 (0%)

	  hugepages-2Mi      0 (0%)       0 (0%)

	  hugepages-32Mi     0 (0%)       0 (0%)

	  hugepages-64Ki     0 (0%)       0 (0%)

	Events:

	  Type    Reason                   Age                From             Message

	  ----    ------                   ----               ----             -------

	  Normal  Starting                 12m                kube-proxy       

	  Normal  Starting                 12m                kubelet          Starting kubelet.

	  Normal  NodeHasSufficientMemory  12m (x8 over 12m)  kubelet          Node addons-970000 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    12m (x8 over 12m)  kubelet          Node addons-970000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     12m (x7 over 12m)  kubelet          Node addons-970000 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  12m                kubelet          Updated Node Allocatable limit across pods

	  Normal  Starting                 12m                kubelet          Starting kubelet.

	  Normal  NodeAllocatableEnforced  12m                kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  12m                kubelet          Node addons-970000 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    12m                kubelet          Node addons-970000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     12m                kubelet          Node addons-970000 status is now: NodeHasSufficientPID

	  Normal  NodeReady                12m                kubelet          Node addons-970000 status is now: NodeReady

	  Normal  RegisteredNode           12m                node-controller  Node addons-970000 event: Registered Node addons-970000 in Controller

	==> dmesg <==

	[  +6.768242] kauditd_printk_skb: 70 callbacks suppressed

	[Sep 4 19:26] kauditd_printk_skb: 9 callbacks suppressed

	[  +8.827677] kauditd_printk_skb: 4 callbacks suppressed

	[ +12.143015] kauditd_printk_skb: 6 callbacks suppressed

	[  +6.791032] kauditd_printk_skb: 21 callbacks suppressed

	[  +6.306558] kauditd_printk_skb: 5 callbacks suppressed

	[  +6.742105] kauditd_printk_skb: 26 callbacks suppressed

	[Sep 4 19:27] kauditd_printk_skb: 21 callbacks suppressed

	[ +31.006260] kauditd_printk_skb: 2 callbacks suppressed

	[  +5.512267] kauditd_printk_skb: 40 callbacks suppressed

	[Sep 4 19:28] kauditd_printk_skb: 46 callbacks suppressed

	[  +8.027923] kauditd_printk_skb: 22 callbacks suppressed

	[ +13.508484] kauditd_printk_skb: 18 callbacks suppressed

	[ +19.329884] kauditd_printk_skb: 7 callbacks suppressed

	[Sep 4 19:29] kauditd_printk_skb: 20 callbacks suppressed

	[ +19.984815] kauditd_printk_skb: 2 callbacks suppressed

	[Sep 4 19:32] kauditd_printk_skb: 2 callbacks suppressed

	[Sep 4 19:37] kauditd_printk_skb: 2 callbacks suppressed

	[  +7.028082] kauditd_printk_skb: 2 callbacks suppressed

	[  +7.887935] kauditd_printk_skb: 7 callbacks suppressed

	[ +16.389626] kauditd_printk_skb: 10 callbacks suppressed

	[  +6.786775] kauditd_printk_skb: 7 callbacks suppressed

	[Sep 4 19:38] kauditd_printk_skb: 33 callbacks suppressed

	[  +5.468668] kauditd_printk_skb: 6 callbacks suppressed

	[  +5.255638] kauditd_printk_skb: 4 callbacks suppressed

	==> etcd [9e049193af79] <==

	{"level":"info","ts":"2024-09-04T19:25:50.740683Z","caller":"traceutil/trace.go:171","msg":"trace[1565618977] range","detail":"{range_begin:/registry/serviceaccounts/kube-system/metrics-server; range_end:; response_count:1; response_revision:656; }","duration":"124.356902ms","start":"2024-09-04T19:25:50.616324Z","end":"2024-09-04T19:25:50.740681Z","steps":["trace[1565618977] 'agreement among raft nodes before linearized reading'  (duration: 124.334194ms)"],"step_count":1}

	{"level":"warn","ts":"2024-09-04T19:25:50.740710Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"135.755484ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}

	{"level":"info","ts":"2024-09-04T19:25:50.740719Z","caller":"traceutil/trace.go:171","msg":"trace[1845333811] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:656; }","duration":"135.765109ms","start":"2024-09-04T19:25:50.604953Z","end":"2024-09-04T19:25:50.740718Z","steps":["trace[1845333811] 'agreement among raft nodes before linearized reading'  (duration: 135.751734ms)"],"step_count":1}

	{"level":"warn","ts":"2024-09-04T19:25:50.740759Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"142.471917ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/masterleases/192.168.105.2\" ","response":"range_response_count:1 size:133"}

	{"level":"info","ts":"2024-09-04T19:25:50.740768Z","caller":"traceutil/trace.go:171","msg":"trace[1557842050] range","detail":"{range_begin:/registry/masterleases/192.168.105.2; range_end:; response_count:1; response_revision:656; }","duration":"142.482167ms","start":"2024-09-04T19:25:50.598285Z","end":"2024-09-04T19:25:50.740767Z","steps":["trace[1557842050] 'agreement among raft nodes before linearized reading'  (duration: 142.458292ms)"],"step_count":1}

	{"level":"warn","ts":"2024-09-04T19:25:50.740807Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"162.426965ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/replicasets/kube-system/metrics-server-84c5f94fbc\" ","response":"range_response_count:1 size:3282"}

	{"level":"info","ts":"2024-09-04T19:25:50.740814Z","caller":"traceutil/trace.go:171","msg":"trace[820662108] range","detail":"{range_begin:/registry/replicasets/kube-system/metrics-server-84c5f94fbc; range_end:; response_count:1; response_revision:656; }","duration":"162.433757ms","start":"2024-09-04T19:25:50.578379Z","end":"2024-09-04T19:25:50.740812Z","steps":["trace[820662108] 'agreement among raft nodes before linearized reading'  (duration: 162.412715ms)"],"step_count":1}

	{"level":"warn","ts":"2024-09-04T19:25:50.740854Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"162.542173ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/deployments/kube-system/metrics-server\" ","response":"range_response_count:1 size:5308"}

	{"level":"info","ts":"2024-09-04T19:25:50.740863Z","caller":"traceutil/trace.go:171","msg":"trace[1025559165] range","detail":"{range_begin:/registry/deployments/kube-system/metrics-server; range_end:; response_count:1; response_revision:656; }","duration":"162.551632ms","start":"2024-09-04T19:25:50.578310Z","end":"2024-09-04T19:25:50.740861Z","steps":["trace[1025559165] 'agreement among raft nodes before linearized reading'  (duration: 162.529216ms)"],"step_count":1}

	{"level":"warn","ts":"2024-09-04T19:25:50.740898Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"171.56789ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/volumesnapshots.snapshot.storage.k8s.io\" ","response":"range_response_count:1 size:35490"}

	{"level":"info","ts":"2024-09-04T19:25:50.740908Z","caller":"traceutil/trace.go:171","msg":"trace[1009303716] range","detail":"{range_begin:/registry/apiextensions.k8s.io/customresourcedefinitions/volumesnapshots.snapshot.storage.k8s.io; range_end:; response_count:1; response_revision:656; }","duration":"171.57789ms","start":"2024-09-04T19:25:50.569328Z","end":"2024-09-04T19:25:50.740906Z","steps":["trace[1009303716] 'agreement among raft nodes before linearized reading'  (duration: 171.554431ms)"],"step_count":1}

	{"level":"warn","ts":"2024-09-04T19:25:50.740944Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"171.778847ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions/addons-970000\" ","response":"range_response_count:1 size:4476"}

	{"level":"info","ts":"2024-09-04T19:25:50.740953Z","caller":"traceutil/trace.go:171","msg":"trace[1907618] range","detail":"{range_begin:/registry/minions/addons-970000; range_end:; response_count:1; response_revision:656; }","duration":"171.788305ms","start":"2024-09-04T19:25:50.569163Z","end":"2024-09-04T19:25:50.740952Z","steps":["trace[1907618] 'agreement among raft nodes before linearized reading'  (duration: 171.767597ms)"],"step_count":1}

	{"level":"warn","ts":"2024-09-04T19:25:58.503854Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"147.829924ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" ","response":"range_response_count:1 size:1113"}

	{"level":"info","ts":"2024-09-04T19:25:58.503887Z","caller":"traceutil/trace.go:171","msg":"trace[1732751054] range","detail":"{range_begin:/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath; range_end:; response_count:1; response_revision:968; }","duration":"147.901299ms","start":"2024-09-04T19:25:58.355978Z","end":"2024-09-04T19:25:58.503879Z","steps":["trace[1732751054] 'range keys from in-memory index tree'  (duration: 147.711798ms)"],"step_count":1}

	{"level":"warn","ts":"2024-09-04T19:25:58.503861Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"132.231026ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods\" limit:1 ","response":"range_response_count:0 size:5"}

	{"level":"info","ts":"2024-09-04T19:25:58.503949Z","caller":"traceutil/trace.go:171","msg":"trace[1616514125] range","detail":"{range_begin:/registry/pods; range_end:; response_count:0; response_revision:968; }","duration":"132.320651ms","start":"2024-09-04T19:25:58.371623Z","end":"2024-09-04T19:25:58.503944Z","steps":["trace[1616514125] 'range keys from in-memory index tree'  (duration: 132.213609ms)"],"step_count":1}

	{"level":"info","ts":"2024-09-04T19:26:07.206593Z","caller":"traceutil/trace.go:171","msg":"trace[616574155] transaction","detail":"{read_only:false; response_revision:1007; number_of_response:1; }","duration":"296.877676ms","start":"2024-09-04T19:26:06.909705Z","end":"2024-09-04T19:26:07.206582Z","steps":["trace[616574155] 'process raft request'  (duration: 296.816301ms)"],"step_count":1}

	{"level":"info","ts":"2024-09-04T19:26:26.929705Z","caller":"traceutil/trace.go:171","msg":"trace[88517706] transaction","detail":"{read_only:false; response_revision:1081; number_of_response:1; }","duration":"177.751136ms","start":"2024-09-04T19:26:26.751947Z","end":"2024-09-04T19:26:26.929699Z","steps":["trace[88517706] 'process raft request'  (duration: 176.319262ms)"],"step_count":1}

	{"level":"info","ts":"2024-09-04T19:26:26.929705Z","caller":"traceutil/trace.go:171","msg":"trace[1815474364] linearizableReadLoop","detail":"{readStateIndex:1100; appliedIndex:1099; }","duration":"158.989365ms","start":"2024-09-04T19:26:26.770704Z","end":"2024-09-04T19:26:26.929693Z","steps":["trace[1815474364] 'read index received'  (duration: 157.550075ms)","trace[1815474364] 'applied index is now lower than readState.Index'  (duration: 1.438915ms)"],"step_count":2}

	{"level":"warn","ts":"2024-09-04T19:26:26.929867Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"159.154782ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiregistration.k8s.io/apiservices/v1beta1.metrics.k8s.io\" ","response":"range_response_count:1 size:2270"}

	{"level":"info","ts":"2024-09-04T19:26:26.929898Z","caller":"traceutil/trace.go:171","msg":"trace[1503295461] range","detail":"{range_begin:/registry/apiregistration.k8s.io/apiservices/v1beta1.metrics.k8s.io; range_end:; response_count:1; response_revision:1081; }","duration":"159.197323ms","start":"2024-09-04T19:26:26.770696Z","end":"2024-09-04T19:26:26.929893Z","steps":["trace[1503295461] 'agreement among raft nodes before linearized reading'  (duration: 159.011948ms)"],"step_count":1}

	{"level":"info","ts":"2024-09-04T19:35:38.809073Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1877}

	{"level":"info","ts":"2024-09-04T19:35:38.904692Z","caller":"mvcc/kvstore_compaction.go:69","msg":"finished scheduled compaction","compact-revision":1877,"took":"92.785724ms","hash":480879567,"current-db-size-bytes":8876032,"current-db-size":"8.9 MB","current-db-size-in-use-bytes":4853760,"current-db-size-in-use":"4.9 MB"}

	{"level":"info","ts":"2024-09-04T19:35:38.904722Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":480879567,"revision":1877,"compact-revision":-1}

	==> gcp-auth [34ac11fa0e25] <==

	2024/09/04 19:28:27 GCP Auth Webhook started!

	2024/09/04 19:28:43 Ready to marshal response ...

	2024/09/04 19:28:43 Ready to write response ...

	2024/09/04 19:28:43 Ready to marshal response ...

	2024/09/04 19:28:43 Ready to write response ...

	2024/09/04 19:29:06 Ready to marshal response ...

	2024/09/04 19:29:06 Ready to write response ...

	2024/09/04 19:29:06 Ready to marshal response ...

	2024/09/04 19:29:06 Ready to write response ...

	2024/09/04 19:29:06 Ready to marshal response ...

	2024/09/04 19:29:06 Ready to write response ...

	2024/09/04 19:37:17 Ready to marshal response ...

	2024/09/04 19:37:17 Ready to write response ...

	2024/09/04 19:37:24 Ready to marshal response ...

	2024/09/04 19:37:24 Ready to write response ...

	2024/09/04 19:37:48 Ready to marshal response ...

	2024/09/04 19:37:48 Ready to write response ...

	==> kernel <==

	 19:38:18 up 12 min,  0 users,  load average: 0.59, 0.64, 0.46

	Linux addons-970000 5.10.207 #1 SMP PREEMPT Tue Sep 3 18:23:52 UTC 2024 aarch64 GNU/Linux

	PRETTY_NAME="Buildroot 2023.02.9"

	==> kube-apiserver [908daf31e6f9] <==

	I0904 19:28:56.908439       1 handler.go:286] Adding GroupVersion flow.volcano.sh v1alpha1 to ResourceManager

	I0904 19:28:57.020396       1 handler.go:286] Adding GroupVersion flow.volcano.sh v1alpha1 to ResourceManager

	W0904 19:28:57.565211       1 cacher.go:171] Terminating all watchers from cacher commands.bus.volcano.sh

	W0904 19:28:57.887206       1 cacher.go:171] Terminating all watchers from cacher numatopologies.nodeinfo.volcano.sh

	W0904 19:28:57.887206       1 cacher.go:171] Terminating all watchers from cacher podgroups.scheduling.volcano.sh

	W0904 19:28:57.904474       1 cacher.go:171] Terminating all watchers from cacher jobs.batch.volcano.sh

	W0904 19:28:57.982473       1 cacher.go:171] Terminating all watchers from cacher queues.scheduling.volcano.sh

	W0904 19:28:58.022243       1 cacher.go:171] Terminating all watchers from cacher jobtemplates.flow.volcano.sh

	W0904 19:28:58.047850       1 cacher.go:171] Terminating all watchers from cacher jobflows.flow.volcano.sh

	I0904 19:37:31.797451       1 controller.go:615] quota admission added evaluator for: volumesnapshots.snapshot.storage.k8s.io

	I0904 19:38:03.702461       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0904 19:38:03.702491       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0904 19:38:03.707969       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0904 19:38:03.707983       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0904 19:38:03.743880       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0904 19:38:03.743991       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0904 19:38:03.751220       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0904 19:38:03.751248       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0904 19:38:03.770638       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0904 19:38:03.770659       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	W0904 19:38:04.751596       1 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io

	W0904 19:38:04.771060       1 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io

	W0904 19:38:04.837214       1 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io

	I0904 19:38:14.491431       1 handler.go:286] Adding GroupVersion gadget.kinvolk.io v1alpha1 to ResourceManager

	W0904 19:38:15.501445       1 cacher.go:171] Terminating all watchers from cacher traces.gadget.kinvolk.io

	==> kube-controller-manager [b17584f23a44] <==

	W0904 19:38:08.986411       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0904 19:38:08.986502       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	I0904 19:38:09.236558       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/metrics-server-84c5f94fbc" duration="1.416µs"

	W0904 19:38:12.400035       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0904 19:38:12.400140       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	W0904 19:38:15.045212       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0904 19:38:15.045336       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	W0904 19:38:15.123306       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0904 19:38:15.123399       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	W0904 19:38:15.276166       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0904 19:38:15.276210       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	W0904 19:38:15.340129       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0904 19:38:15.340173       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	E0904 19:38:15.502219       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	W0904 19:38:16.470367       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0904 19:38:16.470484       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	I0904 19:38:16.577948       1 shared_informer.go:313] Waiting for caches to sync for resource quota

	I0904 19:38:16.578020       1 shared_informer.go:320] Caches are synced for resource quota

	I0904 19:38:16.943036       1 shared_informer.go:313] Waiting for caches to sync for garbage collector

	I0904 19:38:16.943137       1 shared_informer.go:320] Caches are synced for garbage collector

	I0904 19:38:17.901812       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/registry-6fb4cdfc84" duration="1.541µs"

	W0904 19:38:18.021763       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0904 19:38:18.021785       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	W0904 19:38:18.321386       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0904 19:38:18.321410       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	==> kube-proxy [3c14e64de28e] <==

		add table ip kube-proxy

		^^^^^^^^^^^^^^^^^^^^^^^^

	 >

	E0904 19:25:47.011310       1 proxier.go:734] "Error cleaning up nftables rules" err=<

		could not run nftables command: /dev/stdin:1:1-25: Error: Could not process rule: Operation not supported

		add table ip6 kube-proxy

		^^^^^^^^^^^^^^^^^^^^^^^^^

	 >

	I0904 19:25:47.019970       1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.105.2"]

	E0904 19:25:47.020006       1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"

	I0904 19:25:47.062286       1 server_linux.go:146] "No iptables support for family" ipFamily="IPv6"

	I0904 19:25:47.062306       1 server.go:245] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I0904 19:25:47.062328       1 server_linux.go:169] "Using iptables Proxier"

	I0904 19:25:47.063094       1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"

	I0904 19:25:47.063212       1 server.go:483] "Version info" version="v1.31.0"

	I0904 19:25:47.063218       1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0904 19:25:47.064196       1 config.go:197] "Starting service config controller"

	I0904 19:25:47.064204       1 shared_informer.go:313] Waiting for caches to sync for service config

	I0904 19:25:47.064219       1 config.go:104] "Starting endpoint slice config controller"

	I0904 19:25:47.064221       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config

	I0904 19:25:47.064418       1 config.go:326] "Starting node config controller"

	I0904 19:25:47.064421       1 shared_informer.go:313] Waiting for caches to sync for node config

	I0904 19:25:47.165366       1 shared_informer.go:320] Caches are synced for node config

	I0904 19:25:47.165391       1 shared_informer.go:320] Caches are synced for service config

	I0904 19:25:47.165503       1 shared_informer.go:320] Caches are synced for endpoint slice config

	==> kube-scheduler [15a480f5f3e1] <==

	W0904 19:25:38.833394       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0904 19:25:38.833430       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError"

	W0904 19:25:38.833420       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0904 19:25:38.833458       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError"

	W0904 19:25:38.833508       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0904 19:25:38.833517       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"

	W0904 19:25:38.833536       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E0904 19:25:38.833545       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User \"system:kube-scheduler\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError"

	W0904 19:25:38.833566       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E0904 19:25:38.833593       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError"

	W0904 19:25:38.833634       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0904 19:25:38.833661       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError"

	W0904 19:25:38.834412       1 reflector.go:561] runtime/asm_arm64.s:1222: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0904 19:25:38.834423       1 reflector.go:158] "Unhandled Error" err="runtime/asm_arm64.s:1222: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError"

	W0904 19:25:39.655398       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0904 19:25:39.655510       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError"

	W0904 19:25:39.786365       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0904 19:25:39.786825       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"

	W0904 19:25:39.812926       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E0904 19:25:39.812980       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError"

	W0904 19:25:39.878752       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0904 19:25:39.878850       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError"

	W0904 19:25:39.883645       1 reflector.go:561] runtime/asm_arm64.s:1222: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0904 19:25:39.883703       1 reflector.go:158] "Unhandled Error" err="runtime/asm_arm64.s:1222: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError"

	I0904 19:25:42.730804       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	==> kubelet <==

	Sep 04 19:38:14 addons-970000 kubelet[2051]: I0904 19:38:14.764235    2051 reconciler_common.go:288] "Volume detached for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d1f1f896-446b-4ecb-b3be-9fce7b2c33e1-host\") on node \"addons-970000\" DevicePath \"\""

	Sep 04 19:38:14 addons-970000 kubelet[2051]: I0904 19:38:14.764241    2051 reconciler_common.go:288] "Volume detached for volume \"cgroup\" (UniqueName: \"kubernetes.io/host-path/d1f1f896-446b-4ecb-b3be-9fce7b2c33e1-cgroup\") on node \"addons-970000\" DevicePath \"\""

	Sep 04 19:38:14 addons-970000 kubelet[2051]: I0904 19:38:14.764248    2051 reconciler_common.go:288] "Volume detached for volume \"modules\" (UniqueName: \"kubernetes.io/host-path/d1f1f896-446b-4ecb-b3be-9fce7b2c33e1-modules\") on node \"addons-970000\" DevicePath \"\""

	Sep 04 19:38:15 addons-970000 kubelet[2051]: I0904 19:38:15.481686    2051 scope.go:117] "RemoveContainer" containerID="763d5083d07c78ae6e6b346b093ee799e767d984f8b22f37db01d876a124f297"

	Sep 04 19:38:17 addons-970000 kubelet[2051]: I0904 19:38:17.267528    2051 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1f1f896-446b-4ecb-b3be-9fce7b2c33e1" path="/var/lib/kubelet/pods/d1f1f896-446b-4ecb-b3be-9fce7b2c33e1/volumes"

	Sep 04 19:38:17 addons-970000 kubelet[2051]: I0904 19:38:17.903115    2051 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8wn2r\" (UniqueName: \"kubernetes.io/projected/a04b9460-f2bf-4d98-b2c1-681facd48bc2-kube-api-access-8wn2r\") pod \"a04b9460-f2bf-4d98-b2c1-681facd48bc2\" (UID: \"a04b9460-f2bf-4d98-b2c1-681facd48bc2\") "

	Sep 04 19:38:17 addons-970000 kubelet[2051]: I0904 19:38:17.903141    2051 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/a04b9460-f2bf-4d98-b2c1-681facd48bc2-gcp-creds\") pod \"a04b9460-f2bf-4d98-b2c1-681facd48bc2\" (UID: \"a04b9460-f2bf-4d98-b2c1-681facd48bc2\") "

	Sep 04 19:38:17 addons-970000 kubelet[2051]: I0904 19:38:17.903187    2051 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a04b9460-f2bf-4d98-b2c1-681facd48bc2-gcp-creds" (OuterVolumeSpecName: "gcp-creds") pod "a04b9460-f2bf-4d98-b2c1-681facd48bc2" (UID: "a04b9460-f2bf-4d98-b2c1-681facd48bc2"). InnerVolumeSpecName "gcp-creds". PluginName "kubernetes.io/host-path", VolumeGidValue ""

	Sep 04 19:38:17 addons-970000 kubelet[2051]: I0904 19:38:17.904835    2051 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a04b9460-f2bf-4d98-b2c1-681facd48bc2-kube-api-access-8wn2r" (OuterVolumeSpecName: "kube-api-access-8wn2r") pod "a04b9460-f2bf-4d98-b2c1-681facd48bc2" (UID: "a04b9460-f2bf-4d98-b2c1-681facd48bc2"). InnerVolumeSpecName "kube-api-access-8wn2r". PluginName "kubernetes.io/projected", VolumeGidValue ""

	Sep 04 19:38:18 addons-970000 kubelet[2051]: I0904 19:38:18.003316    2051 reconciler_common.go:288] "Volume detached for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/a04b9460-f2bf-4d98-b2c1-681facd48bc2-gcp-creds\") on node \"addons-970000\" DevicePath \"\""

	Sep 04 19:38:18 addons-970000 kubelet[2051]: I0904 19:38:18.003333    2051 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-8wn2r\" (UniqueName: \"kubernetes.io/projected/a04b9460-f2bf-4d98-b2c1-681facd48bc2-kube-api-access-8wn2r\") on node \"addons-970000\" DevicePath \"\""

	Sep 04 19:38:18 addons-970000 kubelet[2051]: I0904 19:38:18.103815    2051 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55kdj\" (UniqueName: \"kubernetes.io/projected/f7b9bfe5-0693-429f-b374-e1fdc2260b34-kube-api-access-55kdj\") pod \"f7b9bfe5-0693-429f-b374-e1fdc2260b34\" (UID: \"f7b9bfe5-0693-429f-b374-e1fdc2260b34\") "

	Sep 04 19:38:18 addons-970000 kubelet[2051]: I0904 19:38:18.104454    2051 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7b9bfe5-0693-429f-b374-e1fdc2260b34-kube-api-access-55kdj" (OuterVolumeSpecName: "kube-api-access-55kdj") pod "f7b9bfe5-0693-429f-b374-e1fdc2260b34" (UID: "f7b9bfe5-0693-429f-b374-e1fdc2260b34"). InnerVolumeSpecName "kube-api-access-55kdj". PluginName "kubernetes.io/projected", VolumeGidValue ""

	Sep 04 19:38:18 addons-970000 kubelet[2051]: I0904 19:38:18.204206    2051 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6lsr\" (UniqueName: \"kubernetes.io/projected/0bbedfdb-5af5-493c-82d3-98bada5a51cc-kube-api-access-v6lsr\") pod \"0bbedfdb-5af5-493c-82d3-98bada5a51cc\" (UID: \"0bbedfdb-5af5-493c-82d3-98bada5a51cc\") "

	Sep 04 19:38:18 addons-970000 kubelet[2051]: I0904 19:38:18.204249    2051 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-55kdj\" (UniqueName: \"kubernetes.io/projected/f7b9bfe5-0693-429f-b374-e1fdc2260b34-kube-api-access-55kdj\") on node \"addons-970000\" DevicePath \"\""

	Sep 04 19:38:18 addons-970000 kubelet[2051]: I0904 19:38:18.204888    2051 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bbedfdb-5af5-493c-82d3-98bada5a51cc-kube-api-access-v6lsr" (OuterVolumeSpecName: "kube-api-access-v6lsr") pod "0bbedfdb-5af5-493c-82d3-98bada5a51cc" (UID: "0bbedfdb-5af5-493c-82d3-98bada5a51cc"). InnerVolumeSpecName "kube-api-access-v6lsr". PluginName "kubernetes.io/projected", VolumeGidValue ""

	Sep 04 19:38:18 addons-970000 kubelet[2051]: I0904 19:38:18.305086    2051 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-v6lsr\" (UniqueName: \"kubernetes.io/projected/0bbedfdb-5af5-493c-82d3-98bada5a51cc-kube-api-access-v6lsr\") on node \"addons-970000\" DevicePath \"\""

	Sep 04 19:38:18 addons-970000 kubelet[2051]: I0904 19:38:18.538073    2051 scope.go:117] "RemoveContainer" containerID="46dcdf90bb9cb08fa5466ca78613c652e76e8117bac870e2d88e977ab4595840"

	Sep 04 19:38:18 addons-970000 kubelet[2051]: I0904 19:38:18.566916    2051 scope.go:117] "RemoveContainer" containerID="46dcdf90bb9cb08fa5466ca78613c652e76e8117bac870e2d88e977ab4595840"

	Sep 04 19:38:18 addons-970000 kubelet[2051]: E0904 19:38:18.567921    2051 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = Unknown desc = Error response from daemon: No such container: 46dcdf90bb9cb08fa5466ca78613c652e76e8117bac870e2d88e977ab4595840" containerID="46dcdf90bb9cb08fa5466ca78613c652e76e8117bac870e2d88e977ab4595840"

	Sep 04 19:38:18 addons-970000 kubelet[2051]: I0904 19:38:18.567940    2051 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"docker","ID":"46dcdf90bb9cb08fa5466ca78613c652e76e8117bac870e2d88e977ab4595840"} err="failed to get container status \"46dcdf90bb9cb08fa5466ca78613c652e76e8117bac870e2d88e977ab4595840\": rpc error: code = Unknown desc = Error response from daemon: No such container: 46dcdf90bb9cb08fa5466ca78613c652e76e8117bac870e2d88e977ab4595840"

	Sep 04 19:38:18 addons-970000 kubelet[2051]: I0904 19:38:18.567953    2051 scope.go:117] "RemoveContainer" containerID="395ef8a0af1a21c06c5393eb22be47cbed0aa155bf4e04f3adfc104f85c39d44"

	Sep 04 19:38:18 addons-970000 kubelet[2051]: I0904 19:38:18.576779    2051 scope.go:117] "RemoveContainer" containerID="395ef8a0af1a21c06c5393eb22be47cbed0aa155bf4e04f3adfc104f85c39d44"

	Sep 04 19:38:18 addons-970000 kubelet[2051]: E0904 19:38:18.577635    2051 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = Unknown desc = Error response from daemon: No such container: 395ef8a0af1a21c06c5393eb22be47cbed0aa155bf4e04f3adfc104f85c39d44" containerID="395ef8a0af1a21c06c5393eb22be47cbed0aa155bf4e04f3adfc104f85c39d44"

	Sep 04 19:38:18 addons-970000 kubelet[2051]: I0904 19:38:18.577719    2051 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"docker","ID":"395ef8a0af1a21c06c5393eb22be47cbed0aa155bf4e04f3adfc104f85c39d44"} err="failed to get container status \"395ef8a0af1a21c06c5393eb22be47cbed0aa155bf4e04f3adfc104f85c39d44\": rpc error: code = Unknown desc = Error response from daemon: No such container: 395ef8a0af1a21c06c5393eb22be47cbed0aa155bf4e04f3adfc104f85c39d44"

	==> storage-provisioner [13130b9acdd9] <==

	I0904 19:25:50.056416       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0904 19:25:50.094423       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0904 19:25:50.094448       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I0904 19:25:50.198823       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0904 19:25:50.198950       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-970000_3bac47ae-d5cd-47ed-a7cf-4c8caeedda86!

	I0904 19:25:50.199022       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"121d56bd-8e39-458a-8838-350c1228431b", APIVersion:"v1", ResourceVersion:"606", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-970000_3bac47ae-d5cd-47ed-a7cf-4c8caeedda86 became leader

	I0904 19:25:50.343081       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-970000_3bac47ae-d5cd-47ed-a7cf-4c8caeedda86!

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.APIServer}} -p addons-970000 -n addons-970000

helpers_test.go:261: (dbg) Run:  kubectl --context addons-970000 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:272: non-running pods: busybox ingress-nginx-admission-create-m2tqw ingress-nginx-admission-patch-bv58f

helpers_test.go:274: ======> post-mortem[TestAddons/parallel/Registry]: describe non-running pods <======

helpers_test.go:277: (dbg) Run:  kubectl --context addons-970000 describe pod busybox ingress-nginx-admission-create-m2tqw ingress-nginx-admission-patch-bv58f

helpers_test.go:277: (dbg) Non-zero exit: kubectl --context addons-970000 describe pod busybox ingress-nginx-admission-create-m2tqw ingress-nginx-admission-patch-bv58f: exit status 1 (42.445292ms)

-- stdout --

	Name:             busybox

	Namespace:        default

	Priority:         0

	Service Account:  default

	Node:             addons-970000/192.168.105.2

	Start Time:       Wed, 04 Sep 2024 12:29:06 -0700

	Labels:           integration-test=busybox

	Annotations:      <none>

	Status:           Pending

	IP:               10.244.0.26

	IPs:

	  IP:  10.244.0.26

	Containers:

	  busybox:

	    Container ID:  

	    Image:         gcr.io/k8s-minikube/busybox:1.28.4-glibc

	    Image ID:      

	    Port:          <none>

	    Host Port:     <none>

	    Command:

	      sleep

	      3600

	    State:          Waiting

	      Reason:       ImagePullBackOff

	    Ready:          False

	    Restart Count:  0

	    Environment:

	      GOOGLE_APPLICATION_CREDENTIALS:  /google-app-creds.json

	      PROJECT_ID:                      this_is_fake

	      GCP_PROJECT:                     this_is_fake

	      GCLOUD_PROJECT:                  this_is_fake

	      GOOGLE_CLOUD_PROJECT:            this_is_fake

	      CLOUDSDK_CORE_PROJECT:           this_is_fake

	    Mounts:

	      /google-app-creds.json from gcp-creds (ro)

	      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-4kxn8 (ro)

	Conditions:

	  Type                        Status

	  PodReadyToStartContainers   True 

	  Initialized                 True 

	  Ready                       False 

	  ContainersReady             False 

	  PodScheduled                True 

	Volumes:

	  kube-api-access-4kxn8:

	    Type:                    Projected (a volume that contains injected data from multiple sources)

	    TokenExpirationSeconds:  3607

	    ConfigMapName:           kube-root-ca.crt

	    ConfigMapOptional:       <nil>

	    DownwardAPI:             true

	  gcp-creds:

	    Type:          HostPath (bare host directory volume)

	    Path:          /var/lib/minikube/google_application_credentials.json

	    HostPathType:  File

	QoS Class:         BestEffort

	Node-Selectors:    <none>

	Tolerations:       node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

	                   node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

	Events:

	  Type     Reason     Age                    From               Message

	  ----     ------     ----                   ----               -------

	  Normal   Scheduled  9m12s                  default-scheduler  Successfully assigned default/busybox to addons-970000

	  Normal   Pulling    7m42s (x4 over 9m12s)  kubelet            Pulling image "gcr.io/k8s-minikube/busybox:1.28.4-glibc"

	  Warning  Failed     7m42s (x4 over 9m12s)  kubelet            Failed to pull image "gcr.io/k8s-minikube/busybox:1.28.4-glibc": Error response from daemon: Head "https://gcr.io/v2/k8s-minikube/busybox/manifests/1.28.4-glibc": unauthorized: authentication failed

	  Warning  Failed     7m42s (x4 over 9m12s)  kubelet            Error: ErrImagePull

	  Warning  Failed     7m30s (x6 over 9m11s)  kubelet            Error: ImagePullBackOff

	  Normal   BackOff    4m5s (x21 over 9m11s)  kubelet            Back-off pulling image "gcr.io/k8s-minikube/busybox:1.28.4-glibc"

-- /stdout --

** stderr ** 

	Error from server (NotFound): pods "ingress-nginx-admission-create-m2tqw" not found

	Error from server (NotFound): pods "ingress-nginx-admission-patch-bv58f" not found

** /stderr **

helpers_test.go:279: kubectl --context addons-970000 describe pod busybox ingress-nginx-admission-create-m2tqw ingress-nginx-admission-patch-bv58f: exit status 1

--- FAIL: TestAddons/parallel/Registry (71.29s)

=== RUN   TestCertOptions

=== PAUSE TestCertOptions

=== CONT  TestCertOptions

cert_options_test.go:49: (dbg) Run:  out/minikube-darwin-arm64 start -p cert-options-659000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=qemu2 

cert_options_test.go:49: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p cert-options-659000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=qemu2 : exit status 80 (9.970185375s)

-- stdout --

	* [cert-options-659000] minikube v1.34.0 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19575

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19575-1140/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19575-1140/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "cert-options-659000" primary control-plane node in "cert-options-659000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "cert-options-659000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p cert-options-659000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

cert_options_test.go:51: failed to start minikube with args: "out/minikube-darwin-arm64 start -p cert-options-659000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=qemu2 " : exit status 80

cert_options_test.go:60: (dbg) Run:  out/minikube-darwin-arm64 -p cert-options-659000 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"

cert_options_test.go:60: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p cert-options-659000 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt": exit status 83 (78.023833ms)

-- stdout --

	* The control-plane node cert-options-659000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p cert-options-659000"

-- /stdout --

cert_options_test.go:62: failed to read apiserver cert inside minikube. args "out/minikube-darwin-arm64 -p cert-options-659000 ssh \"openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt\"": exit status 83

cert_options_test.go:69: apiserver cert does not include 127.0.0.1 in SAN.

cert_options_test.go:69: apiserver cert does not include 192.168.15.15 in SAN.

cert_options_test.go:69: apiserver cert does not include localhost in SAN.

cert_options_test.go:69: apiserver cert does not include www.google.com in SAN.

cert_options_test.go:88: (dbg) Run:  kubectl --context cert-options-659000 config view

cert_options_test.go:93: Kubeconfig apiserver server port incorrect. Output of 

'kubectl config view' = "\n-- stdout --\n\tapiVersion: v1\n\tclusters: null\n\tcontexts: null\n\tcurrent-context: \"\"\n\tkind: Config\n\tpreferences: {}\n\tusers: null\n\n-- /stdout --"

cert_options_test.go:100: (dbg) Run:  out/minikube-darwin-arm64 ssh -p cert-options-659000 -- "sudo cat /etc/kubernetes/admin.conf"

cert_options_test.go:100: (dbg) Non-zero exit: out/minikube-darwin-arm64 ssh -p cert-options-659000 -- "sudo cat /etc/kubernetes/admin.conf": exit status 83 (42.283208ms)

-- stdout --

	* The control-plane node cert-options-659000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p cert-options-659000"

-- /stdout --

cert_options_test.go:102: failed to SSH to minikube with args: "out/minikube-darwin-arm64 ssh -p cert-options-659000 -- \"sudo cat /etc/kubernetes/admin.conf\"" : exit status 83

cert_options_test.go:106: Internal minikube kubeconfig (admin.conf) does not contains the right api port. 

-- stdout --

	* The control-plane node cert-options-659000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p cert-options-659000"

-- /stdout --

cert_options_test.go:109: *** TestCertOptions FAILED at 2024-09-04 13:11:09.682421 -0700 PDT m=+2786.741021334

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p cert-options-659000 -n cert-options-659000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p cert-options-659000 -n cert-options-659000: exit status 7 (30.719125ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "cert-options-659000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "cert-options-659000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p cert-options-659000

--- FAIL: TestCertOptions (10.23s)

=== RUN   TestCertExpiration

=== PAUSE TestCertExpiration

=== CONT  TestCertExpiration

cert_options_test.go:123: (dbg) Run:  out/minikube-darwin-arm64 start -p cert-expiration-733000 --memory=2048 --cert-expiration=3m --driver=qemu2 

cert_options_test.go:123: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p cert-expiration-733000 --memory=2048 --cert-expiration=3m --driver=qemu2 : exit status 80 (9.892659375s)

-- stdout --

	* [cert-expiration-733000] minikube v1.34.0 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19575

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19575-1140/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19575-1140/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "cert-expiration-733000" primary control-plane node in "cert-expiration-733000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "cert-expiration-733000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p cert-expiration-733000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

cert_options_test.go:125: failed to start minikube with args: "out/minikube-darwin-arm64 start -p cert-expiration-733000 --memory=2048 --cert-expiration=3m --driver=qemu2 " : exit status 80

cert_options_test.go:131: (dbg) Run:  out/minikube-darwin-arm64 start -p cert-expiration-733000 --memory=2048 --cert-expiration=8760h --driver=qemu2 

cert_options_test.go:131: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p cert-expiration-733000 --memory=2048 --cert-expiration=8760h --driver=qemu2 : exit status 80 (5.212620833s)

-- stdout --

	* [cert-expiration-733000] minikube v1.34.0 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19575

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19575-1140/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19575-1140/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on existing profile

	* Starting "cert-expiration-733000" primary control-plane node in "cert-expiration-733000" cluster

	* Restarting existing qemu2 VM for "cert-expiration-733000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Restarting existing qemu2 VM for "cert-expiration-733000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p cert-expiration-733000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

cert_options_test.go:133: failed to start minikube after cert expiration: "out/minikube-darwin-arm64 start -p cert-expiration-733000 --memory=2048 --cert-expiration=8760h --driver=qemu2 " : exit status 80

cert_options_test.go:136: minikube start output did not warn about expired certs: 

-- stdout --

	* [cert-expiration-733000] minikube v1.34.0 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19575

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19575-1140/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19575-1140/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on existing profile

	* Starting "cert-expiration-733000" primary control-plane node in "cert-expiration-733000" cluster

	* Restarting existing qemu2 VM for "cert-expiration-733000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Restarting existing qemu2 VM for "cert-expiration-733000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p cert-expiration-733000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

cert_options_test.go:138: *** TestCertExpiration FAILED at 2024-09-04 13:14:09.654331 -0700 PDT m=+2966.716018084

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p cert-expiration-733000 -n cert-expiration-733000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p cert-expiration-733000 -n cert-expiration-733000: exit status 7 (52.490833ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "cert-expiration-733000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "cert-expiration-733000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p cert-expiration-733000

--- FAIL: TestCertExpiration (195.24s)

=== RUN   TestDockerFlags

=== PAUSE TestDockerFlags

=== CONT  TestDockerFlags

docker_test.go:51: (dbg) Run:  out/minikube-darwin-arm64 start -p docker-flags-174000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=qemu2 

docker_test.go:51: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p docker-flags-174000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=qemu2 : exit status 80 (10.155080417s)

-- stdout --

	* [docker-flags-174000] minikube v1.34.0 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19575

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19575-1140/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19575-1140/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "docker-flags-174000" primary control-plane node in "docker-flags-174000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "docker-flags-174000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0904 13:10:49.201709    4383 out.go:345] Setting OutFile to fd 1 ...

	I0904 13:10:49.201815    4383 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:10:49.201819    4383 out.go:358] Setting ErrFile to fd 2...

	I0904 13:10:49.201832    4383 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:10:49.201955    4383 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19575-1140/.minikube/bin

	I0904 13:10:49.203008    4383 out.go:352] Setting JSON to false

	I0904 13:10:49.219197    4383 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":4213,"bootTime":1725476436,"procs":467,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0904 13:10:49.219257    4383 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0904 13:10:49.226250    4383 out.go:177] * [docker-flags-174000] minikube v1.34.0 on Darwin 14.5 (arm64)

	I0904 13:10:49.233088    4383 out.go:177]   - MINIKUBE_LOCATION=19575

	I0904 13:10:49.233140    4383 notify.go:220] Checking for updates...

	I0904 13:10:49.241177    4383 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19575-1140/kubeconfig

	I0904 13:10:49.244118    4383 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0904 13:10:49.247176    4383 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0904 13:10:49.250077    4383 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19575-1140/.minikube

	I0904 13:10:49.253122    4383 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0904 13:10:49.256470    4383 config.go:182] Loaded profile config "force-systemd-flag-747000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0904 13:10:49.256537    4383 config.go:182] Loaded profile config "multinode-452000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0904 13:10:49.256589    4383 driver.go:394] Setting default libvirt URI to qemu:///system

	I0904 13:10:49.261048    4383 out.go:177] * Using the qemu2 driver based on user configuration

	I0904 13:10:49.268092    4383 start.go:297] selected driver: qemu2

	I0904 13:10:49.268098    4383 start.go:901] validating driver "qemu2" against <nil>

	I0904 13:10:49.268109    4383 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0904 13:10:49.270450    4383 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0904 13:10:49.274122    4383 out.go:177] * Automatically selected the socket_vmnet network

	I0904 13:10:49.277178    4383 start_flags.go:942] Waiting for no components: map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false]

	I0904 13:10:49.277218    4383 cni.go:84] Creating CNI manager for ""

	I0904 13:10:49.277226    4383 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0904 13:10:49.277230    4383 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0904 13:10:49.277258    4383 start.go:340] cluster config:

	{Name:docker-flags-174000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:docker-flags-174000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local

ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket

_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0904 13:10:49.280964    4383 iso.go:125] acquiring lock: {Name:mkebc4172c19bd1bff0f54edbc3322d94476263f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0904 13:10:49.289046    4383 out.go:177] * Starting "docker-flags-174000" primary control-plane node in "docker-flags-174000" cluster

	I0904 13:10:49.293130    4383 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0904 13:10:49.293150    4383 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19575-1140/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4

	I0904 13:10:49.293160    4383 cache.go:56] Caching tarball of preloaded images

	I0904 13:10:49.293240    4383 preload.go:172] Found /Users/jenkins/minikube-integration/19575-1140/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0904 13:10:49.293247    4383 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker

	I0904 13:10:49.293328    4383 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/docker-flags-174000/config.json ...

	I0904 13:10:49.293341    4383 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/docker-flags-174000/config.json: {Name:mk28d9b7ac1e85c35ef7cdc09384caaae3d93f14 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0904 13:10:49.293563    4383 start.go:360] acquireMachinesLock for docker-flags-174000: {Name:mkffea5767ac0f54c70242857234a501d8b5b2f4 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0904 13:10:49.293607    4383 start.go:364] duration metric: took 34.625µs to acquireMachinesLock for "docker-flags-174000"

	I0904 13:10:49.293620    4383 start.go:93] Provisioning new machine with config: &{Name:docker-flags-174000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.34.0-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31

.0 ClusterName:docker-flags-174000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPor

t:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0904 13:10:49.293653    4383 start.go:125] createHost starting for "" (driver="qemu2")

	I0904 13:10:49.302061    4383 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0904 13:10:49.320751    4383 start.go:159] libmachine.API.Create for "docker-flags-174000" (driver="qemu2")

	I0904 13:10:49.320777    4383 client.go:168] LocalClient.Create starting

	I0904 13:10:49.320854    4383 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19575-1140/.minikube/certs/ca.pem

	I0904 13:10:49.320886    4383 main.go:141] libmachine: Decoding PEM data...

	I0904 13:10:49.320895    4383 main.go:141] libmachine: Parsing certificate...

	I0904 13:10:49.320939    4383 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19575-1140/.minikube/certs/cert.pem

	I0904 13:10:49.320963    4383 main.go:141] libmachine: Decoding PEM data...

	I0904 13:10:49.320970    4383 main.go:141] libmachine: Parsing certificate...

	I0904 13:10:49.321329    4383 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19575-1140/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19575-1140/.minikube/cache/iso/arm64/minikube-v1.34.0-arm64.iso...

	I0904 13:10:49.473705    4383 main.go:141] libmachine: Creating SSH key...

	I0904 13:10:49.679709    4383 main.go:141] libmachine: Creating Disk image...

	I0904 13:10:49.679718    4383 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0904 13:10:49.679956    4383 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/docker-flags-174000/disk.qcow2.raw /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/docker-flags-174000/disk.qcow2

	I0904 13:10:49.689928    4383 main.go:141] libmachine: STDOUT: 

	I0904 13:10:49.690010    4383 main.go:141] libmachine: STDERR: 

	I0904 13:10:49.690075    4383 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/docker-flags-174000/disk.qcow2 +20000M

	I0904 13:10:49.697963    4383 main.go:141] libmachine: STDOUT: Image resized.

	I0904 13:10:49.697986    4383 main.go:141] libmachine: STDERR: 

	I0904 13:10:49.697997    4383 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/docker-flags-174000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/docker-flags-174000/disk.qcow2

	I0904 13:10:49.698003    4383 main.go:141] libmachine: Starting QEMU VM...

	I0904 13:10:49.698018    4383 qemu.go:418] Using hvf for hardware acceleration

	I0904 13:10:49.698045    4383 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/docker-flags-174000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/docker-flags-174000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/docker-flags-174000/qemu.pid -device virtio-net-pci,netdev=net0,mac=c6:0d:20:ea:0e:0d -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/docker-flags-174000/disk.qcow2

	I0904 13:10:49.699655    4383 main.go:141] libmachine: STDOUT: 

	I0904 13:10:49.699673    4383 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0904 13:10:49.699692    4383 client.go:171] duration metric: took 378.917666ms to LocalClient.Create

	I0904 13:10:51.701821    4383 start.go:128] duration metric: took 2.40819375s to createHost

	I0904 13:10:51.701862    4383 start.go:83] releasing machines lock for "docker-flags-174000", held for 2.40828375s

	W0904 13:10:51.701940    4383 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0904 13:10:51.719150    4383 out.go:177] * Deleting "docker-flags-174000" in qemu2 ...

	W0904 13:10:51.750082    4383 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0904 13:10:51.750105    4383 start.go:729] Will try again in 5 seconds ...

	I0904 13:10:56.752290    4383 start.go:360] acquireMachinesLock for docker-flags-174000: {Name:mkffea5767ac0f54c70242857234a501d8b5b2f4 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0904 13:10:56.962503    4383 start.go:364] duration metric: took 210.026709ms to acquireMachinesLock for "docker-flags-174000"

	I0904 13:10:56.962594    4383 start.go:93] Provisioning new machine with config: &{Name:docker-flags-174000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.34.0-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31

.0 ClusterName:docker-flags-174000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPor

t:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0904 13:10:56.962830    4383 start.go:125] createHost starting for "" (driver="qemu2")

	I0904 13:10:56.973299    4383 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0904 13:10:57.022172    4383 start.go:159] libmachine.API.Create for "docker-flags-174000" (driver="qemu2")

	I0904 13:10:57.022219    4383 client.go:168] LocalClient.Create starting

	I0904 13:10:57.022345    4383 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19575-1140/.minikube/certs/ca.pem

	I0904 13:10:57.022413    4383 main.go:141] libmachine: Decoding PEM data...

	I0904 13:10:57.022429    4383 main.go:141] libmachine: Parsing certificate...

	I0904 13:10:57.022499    4383 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19575-1140/.minikube/certs/cert.pem

	I0904 13:10:57.022543    4383 main.go:141] libmachine: Decoding PEM data...

	I0904 13:10:57.022559    4383 main.go:141] libmachine: Parsing certificate...

	I0904 13:10:57.023116    4383 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19575-1140/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19575-1140/.minikube/cache/iso/arm64/minikube-v1.34.0-arm64.iso...

	I0904 13:10:57.199300    4383 main.go:141] libmachine: Creating SSH key...

	I0904 13:10:57.253728    4383 main.go:141] libmachine: Creating Disk image...

	I0904 13:10:57.253733    4383 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0904 13:10:57.253909    4383 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/docker-flags-174000/disk.qcow2.raw /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/docker-flags-174000/disk.qcow2

	I0904 13:10:57.263101    4383 main.go:141] libmachine: STDOUT: 

	I0904 13:10:57.263124    4383 main.go:141] libmachine: STDERR: 

	I0904 13:10:57.263169    4383 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/docker-flags-174000/disk.qcow2 +20000M

	I0904 13:10:57.271065    4383 main.go:141] libmachine: STDOUT: Image resized.

	I0904 13:10:57.271077    4383 main.go:141] libmachine: STDERR: 

	I0904 13:10:57.271092    4383 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/docker-flags-174000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/docker-flags-174000/disk.qcow2

	I0904 13:10:57.271097    4383 main.go:141] libmachine: Starting QEMU VM...

	I0904 13:10:57.271108    4383 qemu.go:418] Using hvf for hardware acceleration

	I0904 13:10:57.271136    4383 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/docker-flags-174000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/docker-flags-174000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/docker-flags-174000/qemu.pid -device virtio-net-pci,netdev=net0,mac=5e:0a:f6:f8:73:c8 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/docker-flags-174000/disk.qcow2

	I0904 13:10:57.272663    4383 main.go:141] libmachine: STDOUT: 

	I0904 13:10:57.272679    4383 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0904 13:10:57.272692    4383 client.go:171] duration metric: took 250.469917ms to LocalClient.Create

	I0904 13:10:59.274870    4383 start.go:128] duration metric: took 2.312032792s to createHost

	I0904 13:10:59.274935    4383 start.go:83] releasing machines lock for "docker-flags-174000", held for 2.312439s

	W0904 13:10:59.275292    4383 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p docker-flags-174000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p docker-flags-174000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0904 13:10:59.296877    4383 out.go:201] 

	W0904 13:10:59.301780    4383 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0904 13:10:59.301805    4383 out.go:270] * 

	* 

	W0904 13:10:59.304305    4383 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0904 13:10:59.314718    4383 out.go:201] 

** /stderr **

docker_test.go:53: failed to start minikube with args: "out/minikube-darwin-arm64 start -p docker-flags-174000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=qemu2 " : exit status 80

docker_test.go:56: (dbg) Run:  out/minikube-darwin-arm64 -p docker-flags-174000 ssh "sudo systemctl show docker --property=Environment --no-pager"

docker_test.go:56: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p docker-flags-174000 ssh "sudo systemctl show docker --property=Environment --no-pager": exit status 83 (77.001875ms)

-- stdout --

	* The control-plane node docker-flags-174000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p docker-flags-174000"

-- /stdout --

docker_test.go:58: failed to 'systemctl show docker' inside minikube. args "out/minikube-darwin-arm64 -p docker-flags-174000 ssh \"sudo systemctl show docker --property=Environment --no-pager\"": exit status 83

docker_test.go:63: expected env key/value "FOO=BAR" to be passed to minikube's docker and be included in: *"* The control-plane node docker-flags-174000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p docker-flags-174000\"\n"*.

docker_test.go:63: expected env key/value "BAZ=BAT" to be passed to minikube's docker and be included in: *"* The control-plane node docker-flags-174000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p docker-flags-174000\"\n"*.

docker_test.go:67: (dbg) Run:  out/minikube-darwin-arm64 -p docker-flags-174000 ssh "sudo systemctl show docker --property=ExecStart --no-pager"

docker_test.go:67: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p docker-flags-174000 ssh "sudo systemctl show docker --property=ExecStart --no-pager": exit status 83 (42.790375ms)

-- stdout --

	* The control-plane node docker-flags-174000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p docker-flags-174000"

-- /stdout --

docker_test.go:69: failed on the second 'systemctl show docker' inside minikube. args "out/minikube-darwin-arm64 -p docker-flags-174000 ssh \"sudo systemctl show docker --property=ExecStart --no-pager\"": exit status 83

docker_test.go:73: expected "out/minikube-darwin-arm64 -p docker-flags-174000 ssh \"sudo systemctl show docker --property=ExecStart --no-pager\"" output to have include *--debug* . output: "* The control-plane node docker-flags-174000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p docker-flags-174000\"\n"

panic.go:626: *** TestDockerFlags FAILED at 2024-09-04 13:10:59.452657 -0700 PDT m=+2776.511082167

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p docker-flags-174000 -n docker-flags-174000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p docker-flags-174000 -n docker-flags-174000: exit status 7 (29.156542ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "docker-flags-174000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "docker-flags-174000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p docker-flags-174000

--- FAIL: TestDockerFlags (10.38s)

=== RUN   TestForceSystemdFlag

=== PAUSE TestForceSystemdFlag

=== CONT  TestForceSystemdFlag

docker_test.go:91: (dbg) Run:  out/minikube-darwin-arm64 start -p force-systemd-flag-747000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=qemu2 

docker_test.go:91: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p force-systemd-flag-747000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=qemu2 : exit status 80 (10.379642709s)

-- stdout --

	* [force-systemd-flag-747000] minikube v1.34.0 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19575

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19575-1140/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19575-1140/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "force-systemd-flag-747000" primary control-plane node in "force-systemd-flag-747000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "force-systemd-flag-747000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0904 13:10:44.004987    4362 out.go:345] Setting OutFile to fd 1 ...

	I0904 13:10:44.005119    4362 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:10:44.005122    4362 out.go:358] Setting ErrFile to fd 2...

	I0904 13:10:44.005125    4362 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:10:44.005270    4362 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19575-1140/.minikube/bin

	I0904 13:10:44.006328    4362 out.go:352] Setting JSON to false

	I0904 13:10:44.022533    4362 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":4208,"bootTime":1725476436,"procs":469,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0904 13:10:44.022604    4362 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0904 13:10:44.029329    4362 out.go:177] * [force-systemd-flag-747000] minikube v1.34.0 on Darwin 14.5 (arm64)

	I0904 13:10:44.036180    4362 out.go:177]   - MINIKUBE_LOCATION=19575

	I0904 13:10:44.036209    4362 notify.go:220] Checking for updates...

	I0904 13:10:44.044235    4362 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19575-1140/kubeconfig

	I0904 13:10:44.047253    4362 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0904 13:10:44.050313    4362 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0904 13:10:44.053239    4362 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19575-1140/.minikube

	I0904 13:10:44.056234    4362 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0904 13:10:44.059491    4362 config.go:182] Loaded profile config "force-systemd-env-978000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0904 13:10:44.059560    4362 config.go:182] Loaded profile config "multinode-452000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0904 13:10:44.059604    4362 driver.go:394] Setting default libvirt URI to qemu:///system

	I0904 13:10:44.064206    4362 out.go:177] * Using the qemu2 driver based on user configuration

	I0904 13:10:44.071213    4362 start.go:297] selected driver: qemu2

	I0904 13:10:44.071219    4362 start.go:901] validating driver "qemu2" against <nil>

	I0904 13:10:44.071226    4362 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0904 13:10:44.073548    4362 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0904 13:10:44.077315    4362 out.go:177] * Automatically selected the socket_vmnet network

	I0904 13:10:44.080262    4362 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]

	I0904 13:10:44.080308    4362 cni.go:84] Creating CNI manager for ""

	I0904 13:10:44.080317    4362 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0904 13:10:44.080321    4362 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0904 13:10:44.080366    4362 start.go:340] cluster config:

	{Name:force-systemd-flag-747000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:force-systemd-flag-747000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:

docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgen

tPID:0 GPUs: AutoPauseInterval:1m0s}

	I0904 13:10:44.084008    4362 iso.go:125] acquiring lock: {Name:mkebc4172c19bd1bff0f54edbc3322d94476263f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0904 13:10:44.091175    4362 out.go:177] * Starting "force-systemd-flag-747000" primary control-plane node in "force-systemd-flag-747000" cluster

	I0904 13:10:44.095210    4362 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0904 13:10:44.095226    4362 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19575-1140/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4

	I0904 13:10:44.095234    4362 cache.go:56] Caching tarball of preloaded images

	I0904 13:10:44.095286    4362 preload.go:172] Found /Users/jenkins/minikube-integration/19575-1140/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0904 13:10:44.095292    4362 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker

	I0904 13:10:44.095349    4362 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/force-systemd-flag-747000/config.json ...

	I0904 13:10:44.095361    4362 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/force-systemd-flag-747000/config.json: {Name:mkdbe81a88afe2d9a245d36b1e5cef7172528b77 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0904 13:10:44.095590    4362 start.go:360] acquireMachinesLock for force-systemd-flag-747000: {Name:mkffea5767ac0f54c70242857234a501d8b5b2f4 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0904 13:10:44.095625    4362 start.go:364] duration metric: took 27.542µs to acquireMachinesLock for "force-systemd-flag-747000"

	I0904 13:10:44.095637    4362 start.go:93] Provisioning new machine with config: &{Name:force-systemd-flag-747000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.34.0-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:force-sy

stemd-flag-747000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Cust

omQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0904 13:10:44.095672    4362 start.go:125] createHost starting for "" (driver="qemu2")

	I0904 13:10:44.104208    4362 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0904 13:10:44.121403    4362 start.go:159] libmachine.API.Create for "force-systemd-flag-747000" (driver="qemu2")

	I0904 13:10:44.121429    4362 client.go:168] LocalClient.Create starting

	I0904 13:10:44.121494    4362 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19575-1140/.minikube/certs/ca.pem

	I0904 13:10:44.121522    4362 main.go:141] libmachine: Decoding PEM data...

	I0904 13:10:44.121531    4362 main.go:141] libmachine: Parsing certificate...

	I0904 13:10:44.121574    4362 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19575-1140/.minikube/certs/cert.pem

	I0904 13:10:44.121596    4362 main.go:141] libmachine: Decoding PEM data...

	I0904 13:10:44.121604    4362 main.go:141] libmachine: Parsing certificate...

	I0904 13:10:44.122104    4362 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19575-1140/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19575-1140/.minikube/cache/iso/arm64/minikube-v1.34.0-arm64.iso...

	I0904 13:10:44.273157    4362 main.go:141] libmachine: Creating SSH key...

	I0904 13:10:44.522063    4362 main.go:141] libmachine: Creating Disk image...

	I0904 13:10:44.522070    4362 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0904 13:10:44.522360    4362 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/force-systemd-flag-747000/disk.qcow2.raw /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/force-systemd-flag-747000/disk.qcow2

	I0904 13:10:44.532346    4362 main.go:141] libmachine: STDOUT: 

	I0904 13:10:44.532366    4362 main.go:141] libmachine: STDERR: 

	I0904 13:10:44.532416    4362 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/force-systemd-flag-747000/disk.qcow2 +20000M

	I0904 13:10:44.540354    4362 main.go:141] libmachine: STDOUT: Image resized.

	I0904 13:10:44.540378    4362 main.go:141] libmachine: STDERR: 

	I0904 13:10:44.540394    4362 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/force-systemd-flag-747000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/force-systemd-flag-747000/disk.qcow2

	I0904 13:10:44.540399    4362 main.go:141] libmachine: Starting QEMU VM...

	I0904 13:10:44.540410    4362 qemu.go:418] Using hvf for hardware acceleration

	I0904 13:10:44.540438    4362 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/force-systemd-flag-747000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/force-systemd-flag-747000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/force-systemd-flag-747000/qemu.pid -device virtio-net-pci,netdev=net0,mac=06:9e:1f:7f:38:16 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/force-systemd-flag-747000/disk.qcow2

	I0904 13:10:44.542041    4362 main.go:141] libmachine: STDOUT: 

	I0904 13:10:44.542055    4362 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0904 13:10:44.542073    4362 client.go:171] duration metric: took 420.6475ms to LocalClient.Create

	I0904 13:10:46.544204    4362 start.go:128] duration metric: took 2.448555083s to createHost

	I0904 13:10:46.544249    4362 start.go:83] releasing machines lock for "force-systemd-flag-747000", held for 2.4486535s

	W0904 13:10:46.544312    4362 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0904 13:10:46.564356    4362 out.go:177] * Deleting "force-systemd-flag-747000" in qemu2 ...

	W0904 13:10:46.592478    4362 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0904 13:10:46.592497    4362 start.go:729] Will try again in 5 seconds ...

	I0904 13:10:51.594675    4362 start.go:360] acquireMachinesLock for force-systemd-flag-747000: {Name:mkffea5767ac0f54c70242857234a501d8b5b2f4 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0904 13:10:51.701976    4362 start.go:364] duration metric: took 107.174625ms to acquireMachinesLock for "force-systemd-flag-747000"

	I0904 13:10:51.702133    4362 start.go:93] Provisioning new machine with config: &{Name:force-systemd-flag-747000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.34.0-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:force-sy

stemd-flag-747000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Cust

omQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0904 13:10:51.702439    4362 start.go:125] createHost starting for "" (driver="qemu2")

	I0904 13:10:51.714224    4362 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0904 13:10:51.763381    4362 start.go:159] libmachine.API.Create for "force-systemd-flag-747000" (driver="qemu2")

	I0904 13:10:51.763431    4362 client.go:168] LocalClient.Create starting

	I0904 13:10:51.763555    4362 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19575-1140/.minikube/certs/ca.pem

	I0904 13:10:51.763624    4362 main.go:141] libmachine: Decoding PEM data...

	I0904 13:10:51.763651    4362 main.go:141] libmachine: Parsing certificate...

	I0904 13:10:51.763712    4362 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19575-1140/.minikube/certs/cert.pem

	I0904 13:10:51.763757    4362 main.go:141] libmachine: Decoding PEM data...

	I0904 13:10:51.763771    4362 main.go:141] libmachine: Parsing certificate...

	I0904 13:10:51.764305    4362 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19575-1140/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19575-1140/.minikube/cache/iso/arm64/minikube-v1.34.0-arm64.iso...

	I0904 13:10:51.938861    4362 main.go:141] libmachine: Creating SSH key...

	I0904 13:10:52.291145    4362 main.go:141] libmachine: Creating Disk image...

	I0904 13:10:52.291158    4362 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0904 13:10:52.291407    4362 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/force-systemd-flag-747000/disk.qcow2.raw /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/force-systemd-flag-747000/disk.qcow2

	I0904 13:10:52.301338    4362 main.go:141] libmachine: STDOUT: 

	I0904 13:10:52.301360    4362 main.go:141] libmachine: STDERR: 

	I0904 13:10:52.301423    4362 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/force-systemd-flag-747000/disk.qcow2 +20000M

	I0904 13:10:52.309327    4362 main.go:141] libmachine: STDOUT: Image resized.

	I0904 13:10:52.309354    4362 main.go:141] libmachine: STDERR: 

	I0904 13:10:52.309368    4362 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/force-systemd-flag-747000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/force-systemd-flag-747000/disk.qcow2

	I0904 13:10:52.309374    4362 main.go:141] libmachine: Starting QEMU VM...

	I0904 13:10:52.309381    4362 qemu.go:418] Using hvf for hardware acceleration

	I0904 13:10:52.309417    4362 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/force-systemd-flag-747000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/force-systemd-flag-747000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/force-systemd-flag-747000/qemu.pid -device virtio-net-pci,netdev=net0,mac=a6:cb:52:30:29:c0 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/force-systemd-flag-747000/disk.qcow2

	I0904 13:10:52.311035    4362 main.go:141] libmachine: STDOUT: 

	I0904 13:10:52.311053    4362 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0904 13:10:52.311065    4362 client.go:171] duration metric: took 547.639125ms to LocalClient.Create

	I0904 13:10:54.312807    4362 start.go:128] duration metric: took 2.610370917s to createHost

	I0904 13:10:54.312871    4362 start.go:83] releasing machines lock for "force-systemd-flag-747000", held for 2.610915375s

	W0904 13:10:54.313221    4362 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p force-systemd-flag-747000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p force-systemd-flag-747000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0904 13:10:54.324493    4362 out.go:201] 

	W0904 13:10:54.328763    4362 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0904 13:10:54.328799    4362 out.go:270] * 

	* 

	W0904 13:10:54.331718    4362 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0904 13:10:54.341723    4362 out.go:201] 

** /stderr **

docker_test.go:93: failed to start minikube with args: "out/minikube-darwin-arm64 start -p force-systemd-flag-747000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=qemu2 " : exit status 80

docker_test.go:110: (dbg) Run:  out/minikube-darwin-arm64 -p force-systemd-flag-747000 ssh "docker info --format {{.CgroupDriver}}"

docker_test.go:110: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p force-systemd-flag-747000 ssh "docker info --format {{.CgroupDriver}}": exit status 83 (76.734583ms)

-- stdout --

	* The control-plane node force-systemd-flag-747000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p force-systemd-flag-747000"

-- /stdout --

docker_test.go:112: failed to get docker cgroup driver. args "out/minikube-darwin-arm64 -p force-systemd-flag-747000 ssh \"docker info --format {{.CgroupDriver}}\"": exit status 83

docker_test.go:106: *** TestForceSystemdFlag FAILED at 2024-09-04 13:10:54.436369 -0700 PDT m=+2771.494708334

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-flag-747000 -n force-systemd-flag-747000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-flag-747000 -n force-systemd-flag-747000: exit status 7 (34.236041ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "force-systemd-flag-747000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "force-systemd-flag-747000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p force-systemd-flag-747000

--- FAIL: TestForceSystemdFlag (10.57s)

=== RUN   TestForceSystemdEnv

=== PAUSE TestForceSystemdEnv

=== CONT  TestForceSystemdEnv

docker_test.go:155: (dbg) Run:  out/minikube-darwin-arm64 start -p force-systemd-env-978000 --memory=2048 --alsologtostderr -v=5 --driver=qemu2 

docker_test.go:155: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p force-systemd-env-978000 --memory=2048 --alsologtostderr -v=5 --driver=qemu2 : exit status 80 (10.190341583s)

-- stdout --

	* [force-systemd-env-978000] minikube v1.34.0 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19575

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19575-1140/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19575-1140/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=true

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "force-systemd-env-978000" primary control-plane node in "force-systemd-env-978000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "force-systemd-env-978000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0904 13:10:38.822505    4327 out.go:345] Setting OutFile to fd 1 ...

	I0904 13:10:38.822619    4327 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:10:38.822623    4327 out.go:358] Setting ErrFile to fd 2...

	I0904 13:10:38.822625    4327 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:10:38.822750    4327 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19575-1140/.minikube/bin

	I0904 13:10:38.823804    4327 out.go:352] Setting JSON to false

	I0904 13:10:38.840142    4327 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":4202,"bootTime":1725476436,"procs":471,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0904 13:10:38.840203    4327 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0904 13:10:38.846273    4327 out.go:177] * [force-systemd-env-978000] minikube v1.34.0 on Darwin 14.5 (arm64)

	I0904 13:10:38.853326    4327 notify.go:220] Checking for updates...

	I0904 13:10:38.858265    4327 out.go:177]   - MINIKUBE_LOCATION=19575

	I0904 13:10:38.866192    4327 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19575-1140/kubeconfig

	I0904 13:10:38.877258    4327 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0904 13:10:38.884225    4327 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0904 13:10:38.891210    4327 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19575-1140/.minikube

	I0904 13:10:38.899237    4327 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=true

	I0904 13:10:38.903540    4327 config.go:182] Loaded profile config "multinode-452000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0904 13:10:38.903586    4327 driver.go:394] Setting default libvirt URI to qemu:///system

	I0904 13:10:38.907215    4327 out.go:177] * Using the qemu2 driver based on user configuration

	I0904 13:10:38.914188    4327 start.go:297] selected driver: qemu2

	I0904 13:10:38.914194    4327 start.go:901] validating driver "qemu2" against <nil>

	I0904 13:10:38.914198    4327 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0904 13:10:38.916538    4327 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0904 13:10:38.921220    4327 out.go:177] * Automatically selected the socket_vmnet network

	I0904 13:10:38.925270    4327 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]

	I0904 13:10:38.925285    4327 cni.go:84] Creating CNI manager for ""

	I0904 13:10:38.925292    4327 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0904 13:10:38.925296    4327 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0904 13:10:38.925330    4327 start.go:340] cluster config:

	{Name:force-systemd-env-978000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:force-systemd-env-978000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:do

cker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentP

ID:0 GPUs: AutoPauseInterval:1m0s}

	I0904 13:10:38.928951    4327 iso.go:125] acquiring lock: {Name:mkebc4172c19bd1bff0f54edbc3322d94476263f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0904 13:10:38.937245    4327 out.go:177] * Starting "force-systemd-env-978000" primary control-plane node in "force-systemd-env-978000" cluster

	I0904 13:10:38.941164    4327 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0904 13:10:38.941183    4327 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19575-1140/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4

	I0904 13:10:38.941190    4327 cache.go:56] Caching tarball of preloaded images

	I0904 13:10:38.941245    4327 preload.go:172] Found /Users/jenkins/minikube-integration/19575-1140/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0904 13:10:38.941251    4327 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker

	I0904 13:10:38.941312    4327 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/force-systemd-env-978000/config.json ...

	I0904 13:10:38.941323    4327 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/force-systemd-env-978000/config.json: {Name:mk5d3fdb307f1956ec01343608da4d00389b3760 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0904 13:10:38.941618    4327 start.go:360] acquireMachinesLock for force-systemd-env-978000: {Name:mkffea5767ac0f54c70242857234a501d8b5b2f4 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0904 13:10:38.941653    4327 start.go:364] duration metric: took 27.917µs to acquireMachinesLock for "force-systemd-env-978000"

	I0904 13:10:38.941665    4327 start.go:93] Provisioning new machine with config: &{Name:force-systemd-env-978000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.34.0-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:force-sys

temd-env-978000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Custom

QemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0904 13:10:38.941697    4327 start.go:125] createHost starting for "" (driver="qemu2")

	I0904 13:10:38.949226    4327 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0904 13:10:38.965484    4327 start.go:159] libmachine.API.Create for "force-systemd-env-978000" (driver="qemu2")

	I0904 13:10:38.965507    4327 client.go:168] LocalClient.Create starting

	I0904 13:10:38.965569    4327 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19575-1140/.minikube/certs/ca.pem

	I0904 13:10:38.965599    4327 main.go:141] libmachine: Decoding PEM data...

	I0904 13:10:38.965617    4327 main.go:141] libmachine: Parsing certificate...

	I0904 13:10:38.965652    4327 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19575-1140/.minikube/certs/cert.pem

	I0904 13:10:38.965674    4327 main.go:141] libmachine: Decoding PEM data...

	I0904 13:10:38.965683    4327 main.go:141] libmachine: Parsing certificate...

	I0904 13:10:38.965998    4327 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19575-1140/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19575-1140/.minikube/cache/iso/arm64/minikube-v1.34.0-arm64.iso...

	I0904 13:10:39.165639    4327 main.go:141] libmachine: Creating SSH key...

	I0904 13:10:39.234574    4327 main.go:141] libmachine: Creating Disk image...

	I0904 13:10:39.234583    4327 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0904 13:10:39.234834    4327 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/force-systemd-env-978000/disk.qcow2.raw /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/force-systemd-env-978000/disk.qcow2

	I0904 13:10:39.244744    4327 main.go:141] libmachine: STDOUT: 

	I0904 13:10:39.244778    4327 main.go:141] libmachine: STDERR: 

	I0904 13:10:39.244854    4327 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/force-systemd-env-978000/disk.qcow2 +20000M

	I0904 13:10:39.253956    4327 main.go:141] libmachine: STDOUT: Image resized.

	I0904 13:10:39.253980    4327 main.go:141] libmachine: STDERR: 

	I0904 13:10:39.253996    4327 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/force-systemd-env-978000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/force-systemd-env-978000/disk.qcow2

	I0904 13:10:39.254002    4327 main.go:141] libmachine: Starting QEMU VM...

	I0904 13:10:39.254022    4327 qemu.go:418] Using hvf for hardware acceleration

	I0904 13:10:39.254061    4327 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/force-systemd-env-978000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/force-systemd-env-978000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/force-systemd-env-978000/qemu.pid -device virtio-net-pci,netdev=net0,mac=ba:3e:2e:ec:cf:4d -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/force-systemd-env-978000/disk.qcow2

	I0904 13:10:39.255941    4327 main.go:141] libmachine: STDOUT: 

	I0904 13:10:39.255958    4327 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0904 13:10:39.255979    4327 client.go:171] duration metric: took 290.471792ms to LocalClient.Create

	I0904 13:10:41.258233    4327 start.go:128] duration metric: took 2.316541084s to createHost

	I0904 13:10:41.258304    4327 start.go:83] releasing machines lock for "force-systemd-env-978000", held for 2.316681583s

	W0904 13:10:41.258363    4327 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0904 13:10:41.269608    4327 out.go:177] * Deleting "force-systemd-env-978000" in qemu2 ...

	W0904 13:10:41.302321    4327 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0904 13:10:41.302352    4327 start.go:729] Will try again in 5 seconds ...

	I0904 13:10:46.304442    4327 start.go:360] acquireMachinesLock for force-systemd-env-978000: {Name:mkffea5767ac0f54c70242857234a501d8b5b2f4 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0904 13:10:46.544431    4327 start.go:364] duration metric: took 239.86025ms to acquireMachinesLock for "force-systemd-env-978000"

	I0904 13:10:46.544587    4327 start.go:93] Provisioning new machine with config: &{Name:force-systemd-env-978000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.34.0-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:force-sys

temd-env-978000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Custom

QemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0904 13:10:46.544776    4327 start.go:125] createHost starting for "" (driver="qemu2")

	I0904 13:10:46.555500    4327 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0904 13:10:46.607270    4327 start.go:159] libmachine.API.Create for "force-systemd-env-978000" (driver="qemu2")

	I0904 13:10:46.607326    4327 client.go:168] LocalClient.Create starting

	I0904 13:10:46.607442    4327 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19575-1140/.minikube/certs/ca.pem

	I0904 13:10:46.607511    4327 main.go:141] libmachine: Decoding PEM data...

	I0904 13:10:46.607527    4327 main.go:141] libmachine: Parsing certificate...

	I0904 13:10:46.607593    4327 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19575-1140/.minikube/certs/cert.pem

	I0904 13:10:46.607635    4327 main.go:141] libmachine: Decoding PEM data...

	I0904 13:10:46.607650    4327 main.go:141] libmachine: Parsing certificate...

	I0904 13:10:46.608291    4327 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19575-1140/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19575-1140/.minikube/cache/iso/arm64/minikube-v1.34.0-arm64.iso...

	I0904 13:10:46.799325    4327 main.go:141] libmachine: Creating SSH key...

	I0904 13:10:46.917930    4327 main.go:141] libmachine: Creating Disk image...

	I0904 13:10:46.917935    4327 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0904 13:10:46.918128    4327 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/force-systemd-env-978000/disk.qcow2.raw /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/force-systemd-env-978000/disk.qcow2

	I0904 13:10:46.927516    4327 main.go:141] libmachine: STDOUT: 

	I0904 13:10:46.927533    4327 main.go:141] libmachine: STDERR: 

	I0904 13:10:46.927593    4327 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/force-systemd-env-978000/disk.qcow2 +20000M

	I0904 13:10:46.935432    4327 main.go:141] libmachine: STDOUT: Image resized.

	I0904 13:10:46.935456    4327 main.go:141] libmachine: STDERR: 

	I0904 13:10:46.935468    4327 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/force-systemd-env-978000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/force-systemd-env-978000/disk.qcow2

	I0904 13:10:46.935476    4327 main.go:141] libmachine: Starting QEMU VM...

	I0904 13:10:46.935486    4327 qemu.go:418] Using hvf for hardware acceleration

	I0904 13:10:46.935511    4327 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/force-systemd-env-978000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/force-systemd-env-978000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/force-systemd-env-978000/qemu.pid -device virtio-net-pci,netdev=net0,mac=d2:e0:de:18:e9:4d -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/force-systemd-env-978000/disk.qcow2

	I0904 13:10:46.937126    4327 main.go:141] libmachine: STDOUT: 

	I0904 13:10:46.937141    4327 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0904 13:10:46.937154    4327 client.go:171] duration metric: took 329.828084ms to LocalClient.Create

	I0904 13:10:48.939322    4327 start.go:128] duration metric: took 2.394550417s to createHost

	I0904 13:10:48.939383    4327 start.go:83] releasing machines lock for "force-systemd-env-978000", held for 2.394965667s

	W0904 13:10:48.939690    4327 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p force-systemd-env-978000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p force-systemd-env-978000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0904 13:10:48.952128    4327 out.go:201] 

	W0904 13:10:48.957033    4327 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0904 13:10:48.957061    4327 out.go:270] * 

	* 

	W0904 13:10:48.959759    4327 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0904 13:10:48.969106    4327 out.go:201] 

** /stderr **

docker_test.go:157: failed to start minikube with args: "out/minikube-darwin-arm64 start -p force-systemd-env-978000 --memory=2048 --alsologtostderr -v=5 --driver=qemu2 " : exit status 80

docker_test.go:110: (dbg) Run:  out/minikube-darwin-arm64 -p force-systemd-env-978000 ssh "docker info --format {{.CgroupDriver}}"

docker_test.go:110: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p force-systemd-env-978000 ssh "docker info --format {{.CgroupDriver}}": exit status 83 (76.784708ms)

-- stdout --

	* The control-plane node force-systemd-env-978000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p force-systemd-env-978000"

-- /stdout --

docker_test.go:112: failed to get docker cgroup driver. args "out/minikube-darwin-arm64 -p force-systemd-env-978000 ssh \"docker info --format {{.CgroupDriver}}\"": exit status 83

docker_test.go:166: *** TestForceSystemdEnv FAILED at 2024-09-04 13:10:49.063099 -0700 PDT m=+2766.121346251

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-env-978000 -n force-systemd-env-978000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-env-978000 -n force-systemd-env-978000: exit status 7 (33.421917ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "force-systemd-env-978000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "force-systemd-env-978000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p force-systemd-env-978000

--- FAIL: TestForceSystemdEnv (10.38s)

=== RUN   TestFunctional/parallel/ServiceCmdConnect

=== PAUSE TestFunctional/parallel/ServiceCmdConnect

=== CONT  TestFunctional/parallel/ServiceCmdConnect

functional_test.go:1627: (dbg) Run:  kubectl --context functional-143000 create deployment hello-node-connect --image=registry.k8s.io/echoserver-arm:1.8

functional_test.go:1635: (dbg) Run:  kubectl --context functional-143000 expose deployment hello-node-connect --type=NodePort --port=8080

functional_test.go:1640: (dbg) TestFunctional/parallel/ServiceCmdConnect: waiting 10m0s for pods matching "app=hello-node-connect" in namespace "default" ...

helpers_test.go:344: "hello-node-connect-65d86f57f4-r7tzh" [cde65b9c-6ab1-4475-b29d-0859555ddde0] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])

E0904 12:44:08.798633    1661 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/addons-970000/client.crt: no such file or directory" logger="UnhandledError"

helpers_test.go:344: "hello-node-connect-65d86f57f4-r7tzh" [cde65b9c-6ab1-4475-b29d-0859555ddde0] Running / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])

functional_test.go:1640: (dbg) TestFunctional/parallel/ServiceCmdConnect: app=hello-node-connect healthy within 11.008655166s

functional_test.go:1649: (dbg) Run:  out/minikube-darwin-arm64 -p functional-143000 service hello-node-connect --url

functional_test.go:1655: found endpoint for hello-node-connect: http://192.168.105.4:32410

functional_test.go:1661: error fetching http://192.168.105.4:32410: Get "http://192.168.105.4:32410": dial tcp 192.168.105.4:32410: connect: connection refused

functional_test.go:1661: error fetching http://192.168.105.4:32410: Get "http://192.168.105.4:32410": dial tcp 192.168.105.4:32410: connect: connection refused

functional_test.go:1661: error fetching http://192.168.105.4:32410: Get "http://192.168.105.4:32410": dial tcp 192.168.105.4:32410: connect: connection refused

functional_test.go:1661: error fetching http://192.168.105.4:32410: Get "http://192.168.105.4:32410": dial tcp 192.168.105.4:32410: connect: connection refused

functional_test.go:1661: error fetching http://192.168.105.4:32410: Get "http://192.168.105.4:32410": dial tcp 192.168.105.4:32410: connect: connection refused

functional_test.go:1661: error fetching http://192.168.105.4:32410: Get "http://192.168.105.4:32410": dial tcp 192.168.105.4:32410: connect: connection refused

functional_test.go:1661: error fetching http://192.168.105.4:32410: Get "http://192.168.105.4:32410": dial tcp 192.168.105.4:32410: connect: connection refused

functional_test.go:1681: failed to fetch http://192.168.105.4:32410: Get "http://192.168.105.4:32410": dial tcp 192.168.105.4:32410: connect: connection refused

functional_test.go:1598: service test failed - dumping debug information

functional_test.go:1599: -----------------------service failure post-mortem--------------------------------

functional_test.go:1602: (dbg) Run:  kubectl --context functional-143000 describe po hello-node-connect

functional_test.go:1606: hello-node pod describe:

Name:             hello-node-connect-65d86f57f4-r7tzh

Namespace:        default

Priority:         0

Service Account:  default

Node:             functional-143000/192.168.105.4

Start Time:       Wed, 04 Sep 2024 12:44:07 -0700

Labels:           app=hello-node-connect

pod-template-hash=65d86f57f4

Annotations:      <none>

Status:           Running

IP:               10.244.0.9

IPs:

IP:           10.244.0.9

Controlled By:  ReplicaSet/hello-node-connect-65d86f57f4

Containers:

echoserver-arm:

Container ID:   docker://795d717048d2c928aca581fa17bbf7df7e5cab76ca210f7141d3c1d9a68c07c5

Image:          registry.k8s.io/echoserver-arm:1.8

Image ID:       docker-pullable://registry.k8s.io/echoserver-arm@sha256:b33d4cdf6ed097f4e9b77b135d83a596ab73c6268b0342648818eb85f5edfdb5

Port:           <none>

Host Port:      <none>

State:          Terminated

Reason:       Error

Exit Code:    1

Started:      Wed, 04 Sep 2024 12:44:27 -0700

Finished:     Wed, 04 Sep 2024 12:44:27 -0700

Ready:          False

Restart Count:  2

Environment:    <none>

Mounts:

/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-qlb52 (ro)

Conditions:

Type                        Status

PodReadyToStartContainers   True 

Initialized                 True 

Ready                       False 

ContainersReady             False 

PodScheduled                True 

Volumes:

kube-api-access-qlb52:

Type:                    Projected (a volume that contains injected data from multiple sources)

TokenExpirationSeconds:  3607

ConfigMapName:           kube-root-ca.crt

ConfigMapOptional:       <nil>

DownwardAPI:             true

QoS Class:                   BestEffort

Node-Selectors:              <none>

Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

Events:

Type     Reason     Age                From               Message

----     ------     ----               ----               -------

Normal   Scheduled  30s                default-scheduler  Successfully assigned default/hello-node-connect-65d86f57f4-r7tzh to functional-143000

Normal   Pulling    29s                kubelet            Pulling image "registry.k8s.io/echoserver-arm:1.8"

Normal   Pulled     26s                kubelet            Successfully pulled image "registry.k8s.io/echoserver-arm:1.8" in 3.545s (3.545s including waiting). Image size: 84957542 bytes.

Normal   Created    10s (x3 over 25s)  kubelet            Created container echoserver-arm

Normal   Started    10s (x3 over 25s)  kubelet            Started container echoserver-arm

Normal   Pulled     10s (x2 over 25s)  kubelet            Container image "registry.k8s.io/echoserver-arm:1.8" already present on machine

Warning  BackOff    9s (x3 over 24s)   kubelet            Back-off restarting failed container echoserver-arm in pod hello-node-connect-65d86f57f4-r7tzh_default(cde65b9c-6ab1-4475-b29d-0859555ddde0)

functional_test.go:1608: (dbg) Run:  kubectl --context functional-143000 logs -l app=hello-node-connect

functional_test.go:1612: hello-node logs:

exec /usr/sbin/nginx: exec format error

functional_test.go:1614: (dbg) Run:  kubectl --context functional-143000 describe svc hello-node-connect

functional_test.go:1618: hello-node svc describe:

Name:                     hello-node-connect

Namespace:                default

Labels:                   app=hello-node-connect

Annotations:              <none>

Selector:                 app=hello-node-connect

Type:                     NodePort

IP Family Policy:         SingleStack

IP Families:              IPv4

IP:                       10.100.29.242

IPs:                      10.100.29.242

Port:                     <unset>  8080/TCP

TargetPort:               8080/TCP

NodePort:                 <unset>  32410/TCP

Endpoints:                

Session Affinity:         None

External Traffic Policy:  Cluster

Events:                   <none>

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p functional-143000 -n functional-143000

helpers_test.go:244: <<< TestFunctional/parallel/ServiceCmdConnect FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestFunctional/parallel/ServiceCmdConnect]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-darwin-arm64 -p functional-143000 logs -n 25

helpers_test.go:252: TestFunctional/parallel/ServiceCmdConnect logs: 

-- stdout --

	==> Audit <==

	|-----------|----------------------------------------------------------------------------------------------------------------------|-------------------|---------|---------|---------------------|---------------------|

	|  Command  |                                                         Args                                                         |      Profile      |  User   | Version |     Start Time      |      End Time       |

	|-----------|----------------------------------------------------------------------------------------------------------------------|-------------------|---------|---------|---------------------|---------------------|

	| mount     | -p functional-143000                                                                                                 | functional-143000 | jenkins | v1.34.0 | 04 Sep 24 12:44 PDT |                     |

	|           | /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestFunctionalparallelMountCmdany-port139397152/001:/mount-9p       |                   |         |         |                     |                     |

	|           | --alsologtostderr -v=1                                                                                               |                   |         |         |                     |                     |

	| ssh       | functional-143000 ssh findmnt                                                                                        | functional-143000 | jenkins | v1.34.0 | 04 Sep 24 12:44 PDT |                     |

	|           | -T /mount-9p | grep 9p                                                                                               |                   |         |         |                     |                     |

	| ssh       | functional-143000 ssh findmnt                                                                                        | functional-143000 | jenkins | v1.34.0 | 04 Sep 24 12:44 PDT | 04 Sep 24 12:44 PDT |

	|           | -T /mount-9p | grep 9p                                                                                               |                   |         |         |                     |                     |

	| ssh       | functional-143000 ssh -- ls                                                                                          | functional-143000 | jenkins | v1.34.0 | 04 Sep 24 12:44 PDT | 04 Sep 24 12:44 PDT |

	|           | -la /mount-9p                                                                                                        |                   |         |         |                     |                     |

	| ssh       | functional-143000 ssh cat                                                                                            | functional-143000 | jenkins | v1.34.0 | 04 Sep 24 12:44 PDT | 04 Sep 24 12:44 PDT |

	|           | /mount-9p/test-1725479069190839000                                                                                   |                   |         |         |                     |                     |

	| ssh       | functional-143000 ssh stat                                                                                           | functional-143000 | jenkins | v1.34.0 | 04 Sep 24 12:44 PDT | 04 Sep 24 12:44 PDT |

	|           | /mount-9p/created-by-test                                                                                            |                   |         |         |                     |                     |

	| ssh       | functional-143000 ssh stat                                                                                           | functional-143000 | jenkins | v1.34.0 | 04 Sep 24 12:44 PDT | 04 Sep 24 12:44 PDT |

	|           | /mount-9p/created-by-pod                                                                                             |                   |         |         |                     |                     |

	| ssh       | functional-143000 ssh sudo                                                                                           | functional-143000 | jenkins | v1.34.0 | 04 Sep 24 12:44 PDT | 04 Sep 24 12:44 PDT |

	|           | umount -f /mount-9p                                                                                                  |                   |         |         |                     |                     |

	| ssh       | functional-143000 ssh findmnt                                                                                        | functional-143000 | jenkins | v1.34.0 | 04 Sep 24 12:44 PDT |                     |

	|           | -T /mount-9p | grep 9p                                                                                               |                   |         |         |                     |                     |

	| mount     | -p functional-143000                                                                                                 | functional-143000 | jenkins | v1.34.0 | 04 Sep 24 12:44 PDT |                     |

	|           | /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestFunctionalparallelMountCmdspecific-port2654515076/001:/mount-9p |                   |         |         |                     |                     |

	|           | --alsologtostderr -v=1 --port 46464                                                                                  |                   |         |         |                     |                     |

	| ssh       | functional-143000 ssh findmnt                                                                                        | functional-143000 | jenkins | v1.34.0 | 04 Sep 24 12:44 PDT | 04 Sep 24 12:44 PDT |

	|           | -T /mount-9p | grep 9p                                                                                               |                   |         |         |                     |                     |

	| ssh       | functional-143000 ssh -- ls                                                                                          | functional-143000 | jenkins | v1.34.0 | 04 Sep 24 12:44 PDT | 04 Sep 24 12:44 PDT |

	|           | -la /mount-9p                                                                                                        |                   |         |         |                     |                     |

	| ssh       | functional-143000 ssh sudo                                                                                           | functional-143000 | jenkins | v1.34.0 | 04 Sep 24 12:44 PDT |                     |

	|           | umount -f /mount-9p                                                                                                  |                   |         |         |                     |                     |

	| mount     | -p functional-143000                                                                                                 | functional-143000 | jenkins | v1.34.0 | 04 Sep 24 12:44 PDT |                     |

	|           | /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestFunctionalparallelMountCmdVerifyCleanup651616618/001:/mount1    |                   |         |         |                     |                     |

	|           | --alsologtostderr -v=1                                                                                               |                   |         |         |                     |                     |

	| mount     | -p functional-143000                                                                                                 | functional-143000 | jenkins | v1.34.0 | 04 Sep 24 12:44 PDT |                     |

	|           | /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestFunctionalparallelMountCmdVerifyCleanup651616618/001:/mount2    |                   |         |         |                     |                     |

	|           | --alsologtostderr -v=1                                                                                               |                   |         |         |                     |                     |

	| mount     | -p functional-143000                                                                                                 | functional-143000 | jenkins | v1.34.0 | 04 Sep 24 12:44 PDT |                     |

	|           | /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/TestFunctionalparallelMountCmdVerifyCleanup651616618/001:/mount3    |                   |         |         |                     |                     |

	|           | --alsologtostderr -v=1                                                                                               |                   |         |         |                     |                     |

	| ssh       | functional-143000 ssh findmnt                                                                                        | functional-143000 | jenkins | v1.34.0 | 04 Sep 24 12:44 PDT |                     |

	|           | -T /mount1                                                                                                           |                   |         |         |                     |                     |

	| ssh       | functional-143000 ssh findmnt                                                                                        | functional-143000 | jenkins | v1.34.0 | 04 Sep 24 12:44 PDT | 04 Sep 24 12:44 PDT |

	|           | -T /mount1                                                                                                           |                   |         |         |                     |                     |

	| ssh       | functional-143000 ssh findmnt                                                                                        | functional-143000 | jenkins | v1.34.0 | 04 Sep 24 12:44 PDT | 04 Sep 24 12:44 PDT |

	|           | -T /mount2                                                                                                           |                   |         |         |                     |                     |

	| ssh       | functional-143000 ssh findmnt                                                                                        | functional-143000 | jenkins | v1.34.0 | 04 Sep 24 12:44 PDT | 04 Sep 24 12:44 PDT |

	|           | -T /mount3                                                                                                           |                   |         |         |                     |                     |

	| mount     | -p functional-143000                                                                                                 | functional-143000 | jenkins | v1.34.0 | 04 Sep 24 12:44 PDT |                     |

	|           | --kill=true                                                                                                          |                   |         |         |                     |                     |

	| start     | -p functional-143000                                                                                                 | functional-143000 | jenkins | v1.34.0 | 04 Sep 24 12:44 PDT |                     |

	|           | --dry-run --memory                                                                                                   |                   |         |         |                     |                     |

	|           | 250MB --alsologtostderr                                                                                              |                   |         |         |                     |                     |

	|           | --driver=qemu2                                                                                                       |                   |         |         |                     |                     |

	| start     | -p functional-143000                                                                                                 | functional-143000 | jenkins | v1.34.0 | 04 Sep 24 12:44 PDT |                     |

	|           | --dry-run --memory                                                                                                   |                   |         |         |                     |                     |

	|           | 250MB --alsologtostderr                                                                                              |                   |         |         |                     |                     |

	|           | --driver=qemu2                                                                                                       |                   |         |         |                     |                     |

	| start     | -p functional-143000 --dry-run                                                                                       | functional-143000 | jenkins | v1.34.0 | 04 Sep 24 12:44 PDT |                     |

	|           | --alsologtostderr -v=1                                                                                               |                   |         |         |                     |                     |

	|           | --driver=qemu2                                                                                                       |                   |         |         |                     |                     |

	| dashboard | --url --port 36195                                                                                                   | functional-143000 | jenkins | v1.34.0 | 04 Sep 24 12:44 PDT |                     |

	|           | -p functional-143000                                                                                                 |                   |         |         |                     |                     |

	|           | --alsologtostderr -v=1                                                                                               |                   |         |         |                     |                     |

	|-----------|----------------------------------------------------------------------------------------------------------------------|-------------------|---------|---------|---------------------|---------------------|

	==> Last Start <==

	Log file created at: 2024/09/04 12:44:37

	Running on machine: MacOS-M1-Agent-2

	Binary: Built with gc go1.22.5 for darwin/arm64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0904 12:44:37.847694    2697 out.go:345] Setting OutFile to fd 1 ...

	I0904 12:44:37.847846    2697 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 12:44:37.847849    2697 out.go:358] Setting ErrFile to fd 2...

	I0904 12:44:37.847851    2697 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 12:44:37.847985    2697 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19575-1140/.minikube/bin

	I0904 12:44:37.849624    2697 out.go:352] Setting JSON to false

	I0904 12:44:37.867916    2697 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":2641,"bootTime":1725476436,"procs":468,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0904 12:44:37.868028    2697 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0904 12:44:37.871665    2697 out.go:177] * [functional-143000] minikube v1.34.0 on Darwin 14.5 (arm64)

	I0904 12:44:37.878742    2697 out.go:177]   - MINIKUBE_LOCATION=19575

	I0904 12:44:37.878754    2697 notify.go:220] Checking for updates...

	I0904 12:44:37.885647    2697 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19575-1140/kubeconfig

	I0904 12:44:37.888748    2697 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0904 12:44:37.891630    2697 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0904 12:44:37.894703    2697 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19575-1140/.minikube

	I0904 12:44:37.897668    2697 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0904 12:44:37.899031    2697 config.go:182] Loaded profile config "functional-143000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0904 12:44:37.899310    2697 driver.go:394] Setting default libvirt URI to qemu:///system

	I0904 12:44:37.903666    2697 out.go:177] * Using the qemu2 driver based on existing profile

	I0904 12:44:37.910528    2697 start.go:297] selected driver: qemu2

	I0904 12:44:37.910537    2697 start.go:901] validating driver "qemu2" against &{Name:functional-143000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.34.0-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:functional-143000 N

amespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.4 Port:8441 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikub

e-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0904 12:44:37.910582    2697 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0904 12:44:37.912884    2697 cni.go:84] Creating CNI manager for ""

	I0904 12:44:37.912900    2697 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0904 12:44:37.912956    2697 start.go:340] cluster config:

	{Name:functional-143000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.34.0-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:functional-143000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] API

ServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.4 Port:8441 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 Mount

Options:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0904 12:44:37.925659    2697 out.go:177] * dry-run validation complete!

	==> Docker <==

	Sep 04 19:44:31 functional-143000 dockerd[6021]: time="2024-09-04T19:44:31.453762768Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Sep 04 19:44:31 functional-143000 dockerd[6021]: time="2024-09-04T19:44:31.453961092Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Sep 04 19:44:31 functional-143000 dockerd[6021]: time="2024-09-04T19:44:31.454082003Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Sep 04 19:44:31 functional-143000 cri-dockerd[6269]: time="2024-09-04T19:44:31Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/b0ac6d5bbd802c3475042d3066e193ac2b76e7426cefb1813b4ba1bed79f11f6/resolv.conf as [nameserver 10.96.0.10 search default.svc.cluster.local svc.cluster.local cluster.local options ndots:5]"

	Sep 04 19:44:32 functional-143000 cri-dockerd[6269]: time="2024-09-04T19:44:32Z" level=info msg="Stop pulling image gcr.io/k8s-minikube/busybox:1.28.4-glibc: Status: Downloaded newer image for gcr.io/k8s-minikube/busybox:1.28.4-glibc"

	Sep 04 19:44:32 functional-143000 dockerd[6021]: time="2024-09-04T19:44:32.885783243Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Sep 04 19:44:32 functional-143000 dockerd[6021]: time="2024-09-04T19:44:32.885817741Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Sep 04 19:44:32 functional-143000 dockerd[6021]: time="2024-09-04T19:44:32.885826574Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Sep 04 19:44:32 functional-143000 dockerd[6021]: time="2024-09-04T19:44:32.886254054Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Sep 04 19:44:32 functional-143000 dockerd[6015]: time="2024-09-04T19:44:32.920017833Z" level=info msg="ignoring event" container=119055ffc614b5f05bc65da124951ec398ee427044cde90138cfe996c12f9496 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 04 19:44:32 functional-143000 dockerd[6021]: time="2024-09-04T19:44:32.920220948Z" level=info msg="shim disconnected" id=119055ffc614b5f05bc65da124951ec398ee427044cde90138cfe996c12f9496 namespace=moby

	Sep 04 19:44:32 functional-143000 dockerd[6021]: time="2024-09-04T19:44:32.920251155Z" level=warning msg="cleaning up after shim disconnected" id=119055ffc614b5f05bc65da124951ec398ee427044cde90138cfe996c12f9496 namespace=moby

	Sep 04 19:44:32 functional-143000 dockerd[6021]: time="2024-09-04T19:44:32.920255280Z" level=info msg="cleaning up dead shim" namespace=moby

	Sep 04 19:44:34 functional-143000 dockerd[6021]: time="2024-09-04T19:44:34.121730710Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Sep 04 19:44:34 functional-143000 dockerd[6021]: time="2024-09-04T19:44:34.121788374Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Sep 04 19:44:34 functional-143000 dockerd[6021]: time="2024-09-04T19:44:34.121797165Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Sep 04 19:44:34 functional-143000 dockerd[6021]: time="2024-09-04T19:44:34.121836663Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Sep 04 19:44:34 functional-143000 dockerd[6015]: time="2024-09-04T19:44:34.150554395Z" level=info msg="ignoring event" container=9b1984edfdb9e8b57d50c2279465b41ff6708319454c64ee67c7be21eecb4dd9 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 04 19:44:34 functional-143000 dockerd[6021]: time="2024-09-04T19:44:34.150853714Z" level=info msg="shim disconnected" id=9b1984edfdb9e8b57d50c2279465b41ff6708319454c64ee67c7be21eecb4dd9 namespace=moby

	Sep 04 19:44:34 functional-143000 dockerd[6021]: time="2024-09-04T19:44:34.150885004Z" level=warning msg="cleaning up after shim disconnected" id=9b1984edfdb9e8b57d50c2279465b41ff6708319454c64ee67c7be21eecb4dd9 namespace=moby

	Sep 04 19:44:34 functional-143000 dockerd[6021]: time="2024-09-04T19:44:34.150889170Z" level=info msg="cleaning up dead shim" namespace=moby

	Sep 04 19:44:34 functional-143000 dockerd[6015]: time="2024-09-04T19:44:34.178964350Z" level=info msg="ignoring event" container=b0ac6d5bbd802c3475042d3066e193ac2b76e7426cefb1813b4ba1bed79f11f6 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 04 19:44:34 functional-143000 dockerd[6021]: time="2024-09-04T19:44:34.179138550Z" level=info msg="shim disconnected" id=b0ac6d5bbd802c3475042d3066e193ac2b76e7426cefb1813b4ba1bed79f11f6 namespace=moby

	Sep 04 19:44:34 functional-143000 dockerd[6021]: time="2024-09-04T19:44:34.179170215Z" level=warning msg="cleaning up after shim disconnected" id=b0ac6d5bbd802c3475042d3066e193ac2b76e7426cefb1813b4ba1bed79f11f6 namespace=moby

	Sep 04 19:44:34 functional-143000 dockerd[6021]: time="2024-09-04T19:44:34.179187381Z" level=info msg="cleaning up dead shim" namespace=moby

	==> container status <==

	CONTAINER           IMAGE                                                                                                 CREATED              STATE               NAME                      ATTEMPT             POD ID              POD

	9b1984edfdb9e       72565bf5bbedf                                                                                         4 seconds ago        Exited              echoserver-arm            2                   266369a66eb38       hello-node-64b4f8f9ff-x4fnh

	119055ffc614b       gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e   6 seconds ago        Exited              mount-munger              0                   b0ac6d5bbd802       busybox-mount

	795d717048d2c       72565bf5bbedf                                                                                         11 seconds ago       Exited              echoserver-arm            2                   23674dff7e873       hello-node-connect-65d86f57f4-r7tzh

	a2d366170ee1c       nginx@sha256:447a8665cc1dab95b1ca778e162215839ccbb9189104c79d7ec3a81e14577add                         24 seconds ago       Running             myfrontend                0                   dcb4d8b3ec7e6       sp-pod

	920f09d43d7a3       nginx@sha256:c04c18adc2a407740a397c8407c011fc6c90026a9b65cceddef7ae5484360158                         39 seconds ago       Running             nginx                     0                   fa272a1ee7538       nginx-svc

	80873eb951bf1       2437cf7621777                                                                                         About a minute ago   Running             coredns                   2                   005dd7484a918       coredns-6f6b679f8f-5qn5p

	003b60e8d0209       71d55d66fd4ee                                                                                         About a minute ago   Running             kube-proxy                2                   04c2d234f36cf       kube-proxy-4dsp8

	2b8e57e0a510d       ba04bb24b9575                                                                                         About a minute ago   Running             storage-provisioner       2                   45bbd982582db       storage-provisioner

	e7f707198ab0d       fbbbd428abb4d                                                                                         About a minute ago   Running             kube-scheduler            2                   2e6cfe8701102       kube-scheduler-functional-143000

	ec3445aa2b5f9       27e3830e14027                                                                                         About a minute ago   Running             etcd                      2                   bd9fe645fea19       etcd-functional-143000

	690e93f97402e       fcb0683e6bdbd                                                                                         About a minute ago   Running             kube-controller-manager   2                   a74c2a4b43768       kube-controller-manager-functional-143000

	3b3bfd2a95b12       cd0f0ae0ec9e0                                                                                         About a minute ago   Running             kube-apiserver            0                   af716838465fa       kube-apiserver-functional-143000

	139989dffc04f       2437cf7621777                                                                                         About a minute ago   Exited              coredns                   1                   a8596eaa77698       coredns-6f6b679f8f-5qn5p

	496ee0afa53b3       ba04bb24b9575                                                                                         About a minute ago   Exited              storage-provisioner       1                   fe7458ca6d6df       storage-provisioner

	468aaaf0d649e       71d55d66fd4ee                                                                                         About a minute ago   Exited              kube-proxy                1                   5c2a7bbf88df8       kube-proxy-4dsp8

	06bd59aa7c4c8       27e3830e14027                                                                                         About a minute ago   Exited              etcd                      1                   63e7e0a087a99       etcd-functional-143000

	3c0794799ebc6       fbbbd428abb4d                                                                                         About a minute ago   Exited              kube-scheduler            1                   2e1dd2415e3bb       kube-scheduler-functional-143000

	0ca8a8a934381       fcb0683e6bdbd                                                                                         About a minute ago   Exited              kube-controller-manager   1                   b7d303c86070c       kube-controller-manager-functional-143000

	==> coredns [139989dffc04] <==

	.:53

	[INFO] plugin/reload: Running configuration SHA512 = ea7a0d73d9d208f758b1f67640ef03c58089b9d9366cf3478df3bb369b210e39f213811b46224f8a04380814b6e0890ccd358f5b5e8c80bc22ac19c8601ee35b

	CoreDNS-1.11.1

	linux/arm64, go1.20.7, ae2bbc2

	[INFO] 127.0.0.1:37684 - 42256 "HINFO IN 5149652880064842449.561678928653281121. udp 56 false 512" NXDOMAIN qr,rd,ra 131 0.008993955s

	[INFO] SIGTERM: Shutting down servers then terminating

	[INFO] plugin/health: Going into lameduck mode for 5s

	==> coredns [80873eb951bf] <==

	.:53

	[INFO] plugin/reload: Running configuration SHA512 = ea7a0d73d9d208f758b1f67640ef03c58089b9d9366cf3478df3bb369b210e39f213811b46224f8a04380814b6e0890ccd358f5b5e8c80bc22ac19c8601ee35b

	CoreDNS-1.11.1

	linux/arm64, go1.20.7, ae2bbc2

	[INFO] 127.0.0.1:44654 - 3141 "HINFO IN 7565908254960965498.2452697154633047455. udp 57 false 512" NXDOMAIN qr,rd,ra 132 0.009588689s

	[INFO] 10.244.0.1:13771 - 23400 "A IN nginx-svc.default.svc.cluster.local. udp 64 false 4096" NOERROR qr,aa,rd 104 0.000090912s

	[INFO] 10.244.0.1:8399 - 53871 "AAAA IN nginx-svc.default.svc.cluster.local. udp 53 false 512" NOERROR qr,aa,rd 146 0.000082121s

	[INFO] 10.244.0.1:24064 - 703 "SVCB IN _dns.resolver.arpa. udp 36 false 512" NXDOMAIN qr,rd,ra 116 0.00163921s

	[INFO] 10.244.0.1:60629 - 1765 "A IN nginx-svc.default.svc.cluster.local. udp 53 false 512" NOERROR qr,aa,rd 104 0.000062663s

	[INFO] 10.244.0.1:18476 - 46753 "AAAA IN nginx-svc.default.svc.cluster.local. udp 64 false 1232" NOERROR qr,aa,rd 146 0.000081704s

	[INFO] 10.244.0.1:35696 - 27816 "A IN nginx-svc.default.svc.cluster.local. udp 64 false 1232" NOERROR qr,aa,rd 104 0.000245071s

	==> describe nodes <==

	Name:               functional-143000

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=arm64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=arm64

	                    kubernetes.io/hostname=functional-143000

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=8bb47038f7304b869a8e06758662cf35b40689af

	                    minikube.k8s.io/name=functional-143000

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2024_09_04T12_41_42_0700

	                    minikube.k8s.io/version=v1.34.0

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Wed, 04 Sep 2024 19:41:40 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  functional-143000

	  AcquireTime:     <unset>

	  RenewTime:       Wed, 04 Sep 2024 19:44:31 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Wed, 04 Sep 2024 19:44:30 +0000   Wed, 04 Sep 2024 19:41:39 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Wed, 04 Sep 2024 19:44:30 +0000   Wed, 04 Sep 2024 19:41:39 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Wed, 04 Sep 2024 19:44:30 +0000   Wed, 04 Sep 2024 19:41:39 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Wed, 04 Sep 2024 19:44:30 +0000   Wed, 04 Sep 2024 19:41:46 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.105.4

	  Hostname:    functional-143000

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3904744Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3904744Ki

	  pods:               110

	System Info:

	  Machine ID:                 9a079bbc739c49cf975195a183203823

	  System UUID:                9a079bbc739c49cf975195a183203823

	  Boot ID:                    33f017b2-1da8-48f2-ae48-83be0d047939

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               arm64

	  Container Runtime Version:  docker://27.2.0

	  Kubelet Version:            v1.31.0

	  Kube-Proxy Version:         

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (11 in total)

	  Namespace                   Name                                         CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                         ------------  ----------  ---------------  -------------  ---

	  default                     hello-node-64b4f8f9ff-x4fnh                  0 (0%)        0 (0%)      0 (0%)           0 (0%)         17s

	  default                     hello-node-connect-65d86f57f4-r7tzh          0 (0%)        0 (0%)      0 (0%)           0 (0%)         31s

	  default                     nginx-svc                                    0 (0%)        0 (0%)      0 (0%)           0 (0%)         42s

	  default                     sp-pod                                       0 (0%)        0 (0%)      0 (0%)           0 (0%)         25s

	  kube-system                 coredns-6f6b679f8f-5qn5p                     100m (5%)     0 (0%)      70Mi (1%)        170Mi (4%)     2m50s

	  kube-system                 etcd-functional-143000                       100m (5%)     0 (0%)      100Mi (2%)       0 (0%)         2m56s

	  kube-system                 kube-apiserver-functional-143000             250m (12%)    0 (0%)      0 (0%)           0 (0%)         68s

	  kube-system                 kube-controller-manager-functional-143000    200m (10%)    0 (0%)      0 (0%)           0 (0%)         2m56s

	  kube-system                 kube-proxy-4dsp8                             0 (0%)        0 (0%)      0 (0%)           0 (0%)         2m51s

	  kube-system                 kube-scheduler-functional-143000             100m (5%)     0 (0%)      0 (0%)           0 (0%)         2m56s

	  kube-system                 storage-provisioner                          0 (0%)        0 (0%)      0 (0%)           0 (0%)         2m50s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%)  0 (0%)

	  memory             170Mi (4%)  170Mi (4%)

	  ephemeral-storage  0 (0%)      0 (0%)

	  hugepages-1Gi      0 (0%)      0 (0%)

	  hugepages-2Mi      0 (0%)      0 (0%)

	  hugepages-32Mi     0 (0%)      0 (0%)

	  hugepages-64Ki     0 (0%)      0 (0%)

	Events:

	  Type    Reason                   Age                  From             Message

	  ----    ------                   ----                 ----             -------

	  Normal  Starting                 2m49s                kube-proxy       

	  Normal  Starting                 67s                  kube-proxy       

	  Normal  Starting                 110s                 kube-proxy       

	  Normal  NodeHasSufficientMemory  2m56s                kubelet          Node functional-143000 status is now: NodeHasSufficientMemory

	  Normal  NodeAllocatableEnforced  2m56s                kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasNoDiskPressure    2m56s                kubelet          Node functional-143000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     2m56s                kubelet          Node functional-143000 status is now: NodeHasSufficientPID

	  Normal  Starting                 2m56s                kubelet          Starting kubelet.

	  Normal  NodeReady                2m52s                kubelet          Node functional-143000 status is now: NodeReady

	  Normal  RegisteredNode           2m51s                node-controller  Node functional-143000 event: Registered Node functional-143000 in Controller

	  Normal  NodeHasNoDiskPressure    115s (x8 over 115s)  kubelet          Node functional-143000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientMemory  115s (x8 over 115s)  kubelet          Node functional-143000 status is now: NodeHasSufficientMemory

	  Normal  Starting                 115s                 kubelet          Starting kubelet.

	  Normal  NodeHasSufficientPID     115s (x7 over 115s)  kubelet          Node functional-143000 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  115s                 kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           109s                 node-controller  Node functional-143000 event: Registered Node functional-143000 in Controller

	  Normal  Starting                 71s                  kubelet          Starting kubelet.

	  Normal  NodeHasSufficientMemory  71s (x8 over 71s)    kubelet          Node functional-143000 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    71s (x8 over 71s)    kubelet          Node functional-143000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     71s (x7 over 71s)    kubelet          Node functional-143000 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  71s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           66s                  node-controller  Node functional-143000 event: Registered Node functional-143000 in Controller

	==> dmesg <==

	[  +4.417974] kauditd_printk_skb: 199 callbacks suppressed

	[  +6.578097] kauditd_printk_skb: 33 callbacks suppressed

	[Sep 4 19:43] systemd-fstab-generator[5113]: Ignoring "noauto" option for root device

	[ +10.005207] systemd-fstab-generator[5538]: Ignoring "noauto" option for root device

	[  +0.052506] kauditd_printk_skb: 12 callbacks suppressed

	[  +0.096497] systemd-fstab-generator[5572]: Ignoring "noauto" option for root device

	[  +0.096435] systemd-fstab-generator[5585]: Ignoring "noauto" option for root device

	[  +0.113630] systemd-fstab-generator[5598]: Ignoring "noauto" option for root device

	[  +5.119855] kauditd_printk_skb: 89 callbacks suppressed

	[  +7.393587] systemd-fstab-generator[6222]: Ignoring "noauto" option for root device

	[  +0.080906] systemd-fstab-generator[6234]: Ignoring "noauto" option for root device

	[  +0.091040] systemd-fstab-generator[6246]: Ignoring "noauto" option for root device

	[  +0.100583] systemd-fstab-generator[6261]: Ignoring "noauto" option for root device

	[  +0.235077] systemd-fstab-generator[6428]: Ignoring "noauto" option for root device

	[  +0.915400] systemd-fstab-generator[6548]: Ignoring "noauto" option for root device

	[  +3.430690] kauditd_printk_skb: 199 callbacks suppressed

	[  +7.690845] kauditd_printk_skb: 33 callbacks suppressed

	[  +8.354254] systemd-fstab-generator[7583]: Ignoring "noauto" option for root device

	[  +5.373828] kauditd_printk_skb: 16 callbacks suppressed

	[  +5.415388] kauditd_printk_skb: 29 callbacks suppressed

	[Sep 4 19:44] kauditd_printk_skb: 13 callbacks suppressed

	[  +5.716994] kauditd_printk_skb: 11 callbacks suppressed

	[  +9.943436] kauditd_printk_skb: 29 callbacks suppressed

	[  +5.155103] kauditd_printk_skb: 20 callbacks suppressed

	[  +5.777967] kauditd_printk_skb: 8 callbacks suppressed

	==> etcd [06bd59aa7c4c] <==

	{"level":"info","ts":"2024-09-04T19:42:45.833052Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became pre-candidate at term 2"}

	{"level":"info","ts":"2024-09-04T19:42:45.833113Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 received MsgPreVoteResp from 7520ddf439b1d16 at term 2"}

	{"level":"info","ts":"2024-09-04T19:42:45.833191Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became candidate at term 3"}

	{"level":"info","ts":"2024-09-04T19:42:45.833241Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 received MsgVoteResp from 7520ddf439b1d16 at term 3"}

	{"level":"info","ts":"2024-09-04T19:42:45.833272Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became leader at term 3"}

	{"level":"info","ts":"2024-09-04T19:42:45.833303Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 7520ddf439b1d16 elected leader 7520ddf439b1d16 at term 3"}

	{"level":"info","ts":"2024-09-04T19:42:45.838753Z","caller":"etcdserver/server.go:2118","msg":"published local member to cluster through raft","local-member-id":"7520ddf439b1d16","local-member-attributes":"{Name:functional-143000 ClientURLs:[https://192.168.105.4:2379]}","request-path":"/0/members/7520ddf439b1d16/attributes","cluster-id":"80e92d98c466b02f","publish-timeout":"7s"}

	{"level":"info","ts":"2024-09-04T19:42:45.839048Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2024-09-04T19:42:45.839262Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2024-09-04T19:42:45.839221Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}

	{"level":"info","ts":"2024-09-04T19:42:45.839676Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}

	{"level":"info","ts":"2024-09-04T19:42:45.840875Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}

	{"level":"info","ts":"2024-09-04T19:42:45.842576Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}

	{"level":"info","ts":"2024-09-04T19:42:45.840875Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}

	{"level":"info","ts":"2024-09-04T19:42:45.844183Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.105.4:2379"}

	{"level":"info","ts":"2024-09-04T19:43:13.091400Z","caller":"osutil/interrupt_unix.go:64","msg":"received signal; shutting down","signal":"terminated"}

	{"level":"info","ts":"2024-09-04T19:43:13.091428Z","caller":"embed/etcd.go:377","msg":"closing etcd server","name":"functional-143000","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.105.4:2380"],"advertise-client-urls":["https://192.168.105.4:2379"]}

	{"level":"warn","ts":"2024-09-04T19:43:13.091487Z","caller":"embed/serve.go:212","msg":"stopping secure grpc server due to error","error":"accept tcp 192.168.105.4:2379: use of closed network connection"}

	{"level":"warn","ts":"2024-09-04T19:43:13.091497Z","caller":"embed/serve.go:214","msg":"stopped secure grpc server due to error","error":"accept tcp 192.168.105.4:2379: use of closed network connection"}

	{"level":"warn","ts":"2024-09-04T19:43:13.092744Z","caller":"embed/serve.go:212","msg":"stopping secure grpc server due to error","error":"accept tcp 127.0.0.1:2379: use of closed network connection"}

	{"level":"warn","ts":"2024-09-04T19:43:13.092784Z","caller":"embed/serve.go:214","msg":"stopped secure grpc server due to error","error":"accept tcp 127.0.0.1:2379: use of closed network connection"}

	{"level":"info","ts":"2024-09-04T19:43:13.111863Z","caller":"etcdserver/server.go:1521","msg":"skipped leadership transfer for single voting member cluster","local-member-id":"7520ddf439b1d16","current-leader-member-id":"7520ddf439b1d16"}

	{"level":"info","ts":"2024-09-04T19:43:13.113306Z","caller":"embed/etcd.go:581","msg":"stopping serving peer traffic","address":"192.168.105.4:2380"}

	{"level":"info","ts":"2024-09-04T19:43:13.113334Z","caller":"embed/etcd.go:586","msg":"stopped serving peer traffic","address":"192.168.105.4:2380"}

	{"level":"info","ts":"2024-09-04T19:43:13.113339Z","caller":"embed/etcd.go:379","msg":"closed etcd server","name":"functional-143000","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.105.4:2380"],"advertise-client-urls":["https://192.168.105.4:2379"]}

	==> etcd [ec3445aa2b5f] <==

	{"level":"info","ts":"2024-09-04T19:43:28.073496Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"80e92d98c466b02f","local-member-id":"7520ddf439b1d16","added-peer-id":"7520ddf439b1d16","added-peer-peer-urls":["https://192.168.105.4:2380"]}

	{"level":"info","ts":"2024-09-04T19:43:28.073592Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"80e92d98c466b02f","local-member-id":"7520ddf439b1d16","cluster-version":"3.5"}

	{"level":"info","ts":"2024-09-04T19:43:28.073636Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}

	{"level":"info","ts":"2024-09-04T19:43:28.075698Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}

	{"level":"info","ts":"2024-09-04T19:43:28.077335Z","caller":"embed/etcd.go:728","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}

	{"level":"info","ts":"2024-09-04T19:43:28.079708Z","caller":"embed/etcd.go:599","msg":"serving peer traffic","address":"192.168.105.4:2380"}

	{"level":"info","ts":"2024-09-04T19:43:28.080130Z","caller":"embed/etcd.go:571","msg":"cmux::serve","address":"192.168.105.4:2380"}

	{"level":"info","ts":"2024-09-04T19:43:28.080598Z","caller":"embed/etcd.go:279","msg":"now serving peer/client/metrics","local-member-id":"7520ddf439b1d16","initial-advertise-peer-urls":["https://192.168.105.4:2380"],"listen-peer-urls":["https://192.168.105.4:2380"],"advertise-client-urls":["https://192.168.105.4:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.105.4:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}

	{"level":"info","ts":"2024-09-04T19:43:28.080631Z","caller":"embed/etcd.go:870","msg":"serving metrics","address":"http://127.0.0.1:2381"}

	{"level":"info","ts":"2024-09-04T19:43:29.367979Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 is starting a new election at term 3"}

	{"level":"info","ts":"2024-09-04T19:43:29.368152Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became pre-candidate at term 3"}

	{"level":"info","ts":"2024-09-04T19:43:29.368224Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 received MsgPreVoteResp from 7520ddf439b1d16 at term 3"}

	{"level":"info","ts":"2024-09-04T19:43:29.368599Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became candidate at term 4"}

	{"level":"info","ts":"2024-09-04T19:43:29.368644Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 received MsgVoteResp from 7520ddf439b1d16 at term 4"}

	{"level":"info","ts":"2024-09-04T19:43:29.368678Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became leader at term 4"}

	{"level":"info","ts":"2024-09-04T19:43:29.368701Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 7520ddf439b1d16 elected leader 7520ddf439b1d16 at term 4"}

	{"level":"info","ts":"2024-09-04T19:43:29.373392Z","caller":"etcdserver/server.go:2118","msg":"published local member to cluster through raft","local-member-id":"7520ddf439b1d16","local-member-attributes":"{Name:functional-143000 ClientURLs:[https://192.168.105.4:2379]}","request-path":"/0/members/7520ddf439b1d16/attributes","cluster-id":"80e92d98c466b02f","publish-timeout":"7s"}

	{"level":"info","ts":"2024-09-04T19:43:29.373547Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2024-09-04T19:43:29.374166Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}

	{"level":"info","ts":"2024-09-04T19:43:29.374219Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}

	{"level":"info","ts":"2024-09-04T19:43:29.374264Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2024-09-04T19:43:29.376244Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}

	{"level":"info","ts":"2024-09-04T19:43:29.376244Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}

	{"level":"info","ts":"2024-09-04T19:43:29.378563Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}

	{"level":"info","ts":"2024-09-04T19:43:29.379320Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.105.4:2379"}

	==> kernel <==

	 19:44:38 up 3 min,  0 users,  load average: 0.55, 0.38, 0.16

	Linux functional-143000 5.10.207 #1 SMP PREEMPT Tue Sep 3 18:23:52 UTC 2024 aarch64 GNU/Linux

	PRETTY_NAME="Buildroot 2023.02.9"

	==> kube-apiserver [3b3bfd2a95b1] <==

	I0904 19:43:30.009219       1 apf_controller.go:382] Running API Priority and Fairness config worker

	I0904 19:43:30.009252       1 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process

	I0904 19:43:30.009315       1 shared_informer.go:320] Caches are synced for crd-autoregister

	I0904 19:43:30.009528       1 aggregator.go:171] initial CRD sync complete...

	I0904 19:43:30.009555       1 autoregister_controller.go:144] Starting autoregister controller

	I0904 19:43:30.009570       1 cache.go:32] Waiting for caches to sync for autoregister controller

	I0904 19:43:30.009588       1 cache.go:39] Caches are synced for autoregister controller

	I0904 19:43:30.011439       1 handler_discovery.go:450] Starting ResourceDiscoveryManager

	I0904 19:43:30.032848       1 controller.go:615] quota admission added evaluator for: leases.coordination.k8s.io

	I0904 19:43:30.882461       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.

	I0904 19:43:31.113519       1 controller.go:615] quota admission added evaluator for: serviceaccounts

	I0904 19:43:31.117229       1 controller.go:615] quota admission added evaluator for: deployments.apps

	I0904 19:43:31.142786       1 controller.go:615] quota admission added evaluator for: daemonsets.apps

	I0904 19:43:31.154115       1 controller.go:615] quota admission added evaluator for: roles.rbac.authorization.k8s.io

	I0904 19:43:31.163951       1 controller.go:615] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io

	I0904 19:43:32.651573       1 controller.go:615] quota admission added evaluator for: endpointslices.discovery.k8s.io

	I0904 19:43:32.700214       1 controller.go:615] quota admission added evaluator for: endpoints

	I0904 19:43:51.433162       1 alloc.go:330] "allocated clusterIPs" service="default/invalid-svc" clusterIPs={"IPv4":"10.98.45.172"}

	I0904 19:43:56.201373       1 alloc.go:330] "allocated clusterIPs" service="default/nginx-svc" clusterIPs={"IPv4":"10.111.193.119"}

	I0904 19:44:07.571755       1 controller.go:615] quota admission added evaluator for: replicasets.apps

	I0904 19:44:07.613102       1 alloc.go:330] "allocated clusterIPs" service="default/hello-node-connect" clusterIPs={"IPv4":"10.100.29.242"}

	I0904 19:44:21.961297       1 alloc.go:330] "allocated clusterIPs" service="default/hello-node" clusterIPs={"IPv4":"10.97.20.141"}

	I0904 19:44:38.429344       1 controller.go:615] quota admission added evaluator for: namespaces

	I0904 19:44:38.573139       1 alloc.go:330] "allocated clusterIPs" service="kubernetes-dashboard/kubernetes-dashboard" clusterIPs={"IPv4":"10.106.190.247"}

	I0904 19:44:38.597495       1 alloc.go:330] "allocated clusterIPs" service="kubernetes-dashboard/dashboard-metrics-scraper" clusterIPs={"IPv4":"10.98.66.43"}

	==> kube-controller-manager [0ca8a8a93438] <==

	I0904 19:42:49.861302       1 shared_informer.go:320] Caches are synced for GC

	I0904 19:42:49.863060       1 shared_informer.go:320] Caches are synced for node

	I0904 19:42:49.863097       1 range_allocator.go:171] "Sending events to api server" logger="node-ipam-controller"

	I0904 19:42:49.863110       1 range_allocator.go:177] "Starting range CIDR allocator" logger="node-ipam-controller"

	I0904 19:42:49.863122       1 shared_informer.go:313] Waiting for caches to sync for cidrallocator

	I0904 19:42:49.863126       1 shared_informer.go:320] Caches are synced for cidrallocator

	I0904 19:42:49.863169       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="functional-143000"

	I0904 19:42:49.865491       1 shared_informer.go:320] Caches are synced for daemon sets

	I0904 19:42:49.870938       1 shared_informer.go:320] Caches are synced for attach detach

	I0904 19:42:49.877142       1 shared_informer.go:320] Caches are synced for endpoint_slice

	I0904 19:42:49.887749       1 shared_informer.go:320] Caches are synced for PV protection

	I0904 19:42:49.889915       1 shared_informer.go:320] Caches are synced for taint-eviction-controller

	I0904 19:42:49.905783       1 shared_informer.go:320] Caches are synced for taint

	I0904 19:42:49.905901       1 node_lifecycle_controller.go:1232] "Initializing eviction metric for zone" logger="node-lifecycle-controller" zone=""

	I0904 19:42:49.905957       1 node_lifecycle_controller.go:884] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="functional-143000"

	I0904 19:42:49.906048       1 node_lifecycle_controller.go:1078] "Controller detected that zone is now in new state" logger="node-lifecycle-controller" zone="" newState="Normal"

	I0904 19:42:49.911160       1 shared_informer.go:320] Caches are synced for persistent volume

	I0904 19:42:49.911249       1 shared_informer.go:320] Caches are synced for TTL

	I0904 19:42:49.970513       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-6f6b679f8f" duration="261.585554ms"

	I0904 19:42:49.971344       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-6f6b679f8f" duration="597.722µs"

	I0904 19:42:50.322374       1 shared_informer.go:320] Caches are synced for garbage collector

	I0904 19:42:50.409902       1 shared_informer.go:320] Caches are synced for garbage collector

	I0904 19:42:50.409978       1 garbagecollector.go:157] "All resource monitors have synced. Proceeding to collect garbage" logger="garbage-collector-controller"

	I0904 19:42:54.124851       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-6f6b679f8f" duration="9.809912ms"

	I0904 19:42:54.125957       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-6f6b679f8f" duration="34.498µs"

	==> kube-controller-manager [690e93f97402] <==

	I0904 19:44:30.743355       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="functional-143000"

	I0904 19:44:34.085151       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-64b4f8f9ff" duration="48.79µs"

	I0904 19:44:35.107719       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-64b4f8f9ff" duration="55.539µs"

	I0904 19:44:38.483304       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4" duration="27.006984ms"

	E0904 19:44:38.483636       1 replica_set.go:560] "Unhandled Error" err="sync \"kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4\" failed with pods \"dashboard-metrics-scraper-c5db448b4-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found" logger="UnhandledError"

	I0904 19:44:38.487349       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-695b96c756" duration="19.925691ms"

	E0904 19:44:38.487623       1 replica_set.go:560] "Unhandled Error" err="sync \"kubernetes-dashboard/kubernetes-dashboard-695b96c756\" failed with pods \"kubernetes-dashboard-695b96c756-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found" logger="UnhandledError"

	I0904 19:44:38.492377       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4" duration="7.43436ms"

	E0904 19:44:38.492400       1 replica_set.go:560] "Unhandled Error" err="sync \"kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4\" failed with pods \"dashboard-metrics-scraper-c5db448b4-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found" logger="UnhandledError"

	I0904 19:44:38.492421       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-695b96c756" duration="3.734242ms"

	E0904 19:44:38.492427       1 replica_set.go:560] "Unhandled Error" err="sync \"kubernetes-dashboard/kubernetes-dashboard-695b96c756\" failed with pods \"kubernetes-dashboard-695b96c756-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found" logger="UnhandledError"

	I0904 19:44:38.500032       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4" duration="6.387284ms"

	E0904 19:44:38.500050       1 replica_set.go:560] "Unhandled Error" err="sync \"kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4\" failed with pods \"dashboard-metrics-scraper-c5db448b4-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found" logger="UnhandledError"

	I0904 19:44:38.500166       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-695b96c756" duration="6.452155ms"

	E0904 19:44:38.500198       1 replica_set.go:560] "Unhandled Error" err="sync \"kubernetes-dashboard/kubernetes-dashboard-695b96c756\" failed with pods \"kubernetes-dashboard-695b96c756-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found" logger="UnhandledError"

	I0904 19:44:38.506330       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4" duration="1.931493ms"

	E0904 19:44:38.506346       1 replica_set.go:560] "Unhandled Error" err="sync \"kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4\" failed with pods \"dashboard-metrics-scraper-c5db448b4-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found" logger="UnhandledError"

	I0904 19:44:38.543052       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-695b96c756" duration="20.370878ms"

	I0904 19:44:38.548543       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-695b96c756" duration="5.464202ms"

	I0904 19:44:38.551116       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-695b96c756" duration="20.166µs"

	I0904 19:44:38.554434       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-695b96c756" duration="17.374µs"

	I0904 19:44:38.562440       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4" duration="14.143753ms"

	I0904 19:44:38.573440       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4" duration="10.974194ms"

	I0904 19:44:38.590058       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4" duration="16.589097ms"

	I0904 19:44:38.590094       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4" duration="20.624µs"

	==> kube-proxy [003b60e8d020] <==

		add table ip kube-proxy

		^^^^^^^^^^^^^^^^^^^^^^^^

	 >

	E0904 19:43:30.606665       1 proxier.go:734] "Error cleaning up nftables rules" err=<

		could not run nftables command: /dev/stdin:1:1-25: Error: Could not process rule: Operation not supported

		add table ip6 kube-proxy

		^^^^^^^^^^^^^^^^^^^^^^^^^

	 >

	I0904 19:43:30.611452       1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.105.4"]

	E0904 19:43:30.611484       1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"

	I0904 19:43:30.619735       1 server_linux.go:146] "No iptables support for family" ipFamily="IPv6"

	I0904 19:43:30.619751       1 server.go:245] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I0904 19:43:30.619763       1 server_linux.go:169] "Using iptables Proxier"

	I0904 19:43:30.620344       1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"

	I0904 19:43:30.620430       1 server.go:483] "Version info" version="v1.31.0"

	I0904 19:43:30.620444       1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0904 19:43:30.620880       1 config.go:197] "Starting service config controller"

	I0904 19:43:30.620894       1 shared_informer.go:313] Waiting for caches to sync for service config

	I0904 19:43:30.620902       1 config.go:104] "Starting endpoint slice config controller"

	I0904 19:43:30.620905       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config

	I0904 19:43:30.621076       1 config.go:326] "Starting node config controller"

	I0904 19:43:30.621079       1 shared_informer.go:313] Waiting for caches to sync for node config

	I0904 19:43:30.721856       1 shared_informer.go:320] Caches are synced for node config

	I0904 19:43:30.721857       1 shared_informer.go:320] Caches are synced for service config

	I0904 19:43:30.721874       1 shared_informer.go:320] Caches are synced for endpoint slice config

	==> kube-proxy [468aaaf0d649] <==

		add table ip kube-proxy

		^^^^^^^^^^^^^^^^^^^^^^^^

	 >

	E0904 19:42:47.803938       1 proxier.go:734] "Error cleaning up nftables rules" err=<

		could not run nftables command: /dev/stdin:1:1-25: Error: Could not process rule: Operation not supported

		add table ip6 kube-proxy

		^^^^^^^^^^^^^^^^^^^^^^^^^

	 >

	I0904 19:42:47.810451       1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.105.4"]

	E0904 19:42:47.810479       1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"

	I0904 19:42:47.825180       1 server_linux.go:146] "No iptables support for family" ipFamily="IPv6"

	I0904 19:42:47.825200       1 server.go:245] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I0904 19:42:47.825216       1 server_linux.go:169] "Using iptables Proxier"

	I0904 19:42:47.826294       1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"

	I0904 19:42:47.826456       1 server.go:483] "Version info" version="v1.31.0"

	I0904 19:42:47.826467       1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0904 19:42:47.826938       1 config.go:197] "Starting service config controller"

	I0904 19:42:47.826954       1 shared_informer.go:313] Waiting for caches to sync for service config

	I0904 19:42:47.826963       1 config.go:104] "Starting endpoint slice config controller"

	I0904 19:42:47.826967       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config

	I0904 19:42:47.827167       1 config.go:326] "Starting node config controller"

	I0904 19:42:47.827170       1 shared_informer.go:313] Waiting for caches to sync for node config

	I0904 19:42:47.928685       1 shared_informer.go:320] Caches are synced for node config

	I0904 19:42:47.928688       1 shared_informer.go:320] Caches are synced for service config

	I0904 19:42:47.928722       1 shared_informer.go:320] Caches are synced for endpoint slice config

	==> kube-scheduler [3c0794799ebc] <==

	I0904 19:42:44.501160       1 serving.go:386] Generated self-signed cert in-memory

	W0904 19:42:46.357103       1 requestheader_controller.go:196] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'

	W0904 19:42:46.357201       1 authentication.go:370] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"

	W0904 19:42:46.357238       1 authentication.go:371] Continuing without authentication configuration. This may treat all requests as anonymous.

	W0904 19:42:46.357259       1 authentication.go:372] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false

	I0904 19:42:46.389450       1 server.go:167] "Starting Kubernetes Scheduler" version="v1.31.0"

	I0904 19:42:46.389468       1 server.go:169] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0904 19:42:46.390791       1 secure_serving.go:213] Serving securely on 127.0.0.1:10259

	I0904 19:42:46.390871       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"

	I0904 19:42:46.390885       1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0904 19:42:46.390920       1 tlsconfig.go:243] "Starting DynamicServingCertificateController"

	I0904 19:42:46.492361       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0904 19:43:13.101264       1 secure_serving.go:258] Stopped listening on 127.0.0.1:10259

	I0904 19:43:13.101316       1 tlsconfig.go:258] "Shutting down DynamicServingCertificateController"

	E0904 19:43:13.101379       1 run.go:72] "command failed" err="finished without leader elect"

	==> kube-scheduler [e7f707198ab0] <==

	I0904 19:43:28.279305       1 serving.go:386] Generated self-signed cert in-memory

	W0904 19:43:29.910225       1 requestheader_controller.go:196] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'

	W0904 19:43:29.910242       1 authentication.go:370] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"

	W0904 19:43:29.910247       1 authentication.go:371] Continuing without authentication configuration. This may treat all requests as anonymous.

	W0904 19:43:29.910250       1 authentication.go:372] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false

	I0904 19:43:29.927899       1 server.go:167] "Starting Kubernetes Scheduler" version="v1.31.0"

	I0904 19:43:29.927917       1 server.go:169] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0904 19:43:29.929388       1 secure_serving.go:213] Serving securely on 127.0.0.1:10259

	I0904 19:43:29.929753       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"

	I0904 19:43:29.929770       1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0904 19:43:29.929777       1 tlsconfig.go:243] "Starting DynamicServingCertificateController"

	I0904 19:43:30.030035       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	==> kubelet <==

	Sep 04 19:44:27 functional-143000 kubelet[6555]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Sep 04 19:44:27 functional-143000 kubelet[6555]: I0904 19:44:27.058304    6555 scope.go:117] "RemoveContainer" containerID="b2fed9253e91176d92ecaf3aa3c33e49bd67941ed6992ab16c57803dc8d8bed3"

	Sep 04 19:44:27 functional-143000 kubelet[6555]: I0904 19:44:27.126092    6555 scope.go:117] "RemoveContainer" containerID="431c68753123630d4b3c6477b51b129bae9f9eefe80b5df148b0ab857a8d1e70"

	Sep 04 19:44:27 functional-143000 kubelet[6555]: I0904 19:44:27.132998    6555 scope.go:117] "RemoveContainer" containerID="b2fed9253e91176d92ecaf3aa3c33e49bd67941ed6992ab16c57803dc8d8bed3"

	Sep 04 19:44:28 functional-143000 kubelet[6555]: I0904 19:44:28.014076    6555 scope.go:117] "RemoveContainer" containerID="795d717048d2c928aca581fa17bbf7df7e5cab76ca210f7141d3c1d9a68c07c5"

	Sep 04 19:44:28 functional-143000 kubelet[6555]: E0904 19:44:28.014187    6555 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echoserver-arm\" with CrashLoopBackOff: \"back-off 20s restarting failed container=echoserver-arm pod=hello-node-connect-65d86f57f4-r7tzh_default(cde65b9c-6ab1-4475-b29d-0859555ddde0)\"" pod="default/hello-node-connect-65d86f57f4-r7tzh" podUID="cde65b9c-6ab1-4475-b29d-0859555ddde0"

	Sep 04 19:44:31 functional-143000 kubelet[6555]: I0904 19:44:31.292108    6555 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9vqf\" (UniqueName: \"kubernetes.io/projected/b93d6ab4-d69e-431c-ab21-e3a1b54273a9-kube-api-access-c9vqf\") pod \"busybox-mount\" (UID: \"b93d6ab4-d69e-431c-ab21-e3a1b54273a9\") " pod="default/busybox-mount"

	Sep 04 19:44:31 functional-143000 kubelet[6555]: I0904 19:44:31.292164    6555 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-volume\" (UniqueName: \"kubernetes.io/host-path/b93d6ab4-d69e-431c-ab21-e3a1b54273a9-test-volume\") pod \"busybox-mount\" (UID: \"b93d6ab4-d69e-431c-ab21-e3a1b54273a9\") " pod="default/busybox-mount"

	Sep 04 19:44:34 functional-143000 kubelet[6555]: I0904 19:44:34.048936    6555 scope.go:117] "RemoveContainer" containerID="94d6776421b087c5db5a1809481750246227cbba4211e7cc76b7fd106b465ffc"

	Sep 04 19:44:34 functional-143000 kubelet[6555]: I0904 19:44:34.317186    6555 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"test-volume\" (UniqueName: \"kubernetes.io/host-path/b93d6ab4-d69e-431c-ab21-e3a1b54273a9-test-volume\") pod \"b93d6ab4-d69e-431c-ab21-e3a1b54273a9\" (UID: \"b93d6ab4-d69e-431c-ab21-e3a1b54273a9\") "

	Sep 04 19:44:34 functional-143000 kubelet[6555]: I0904 19:44:34.317221    6555 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9vqf\" (UniqueName: \"kubernetes.io/projected/b93d6ab4-d69e-431c-ab21-e3a1b54273a9-kube-api-access-c9vqf\") pod \"b93d6ab4-d69e-431c-ab21-e3a1b54273a9\" (UID: \"b93d6ab4-d69e-431c-ab21-e3a1b54273a9\") "

	Sep 04 19:44:34 functional-143000 kubelet[6555]: I0904 19:44:34.317425    6555 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b93d6ab4-d69e-431c-ab21-e3a1b54273a9-test-volume" (OuterVolumeSpecName: "test-volume") pod "b93d6ab4-d69e-431c-ab21-e3a1b54273a9" (UID: "b93d6ab4-d69e-431c-ab21-e3a1b54273a9"). InnerVolumeSpecName "test-volume". PluginName "kubernetes.io/host-path", VolumeGidValue ""

	Sep 04 19:44:34 functional-143000 kubelet[6555]: I0904 19:44:34.317986    6555 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b93d6ab4-d69e-431c-ab21-e3a1b54273a9-kube-api-access-c9vqf" (OuterVolumeSpecName: "kube-api-access-c9vqf") pod "b93d6ab4-d69e-431c-ab21-e3a1b54273a9" (UID: "b93d6ab4-d69e-431c-ab21-e3a1b54273a9"). InnerVolumeSpecName "kube-api-access-c9vqf". PluginName "kubernetes.io/projected", VolumeGidValue ""

	Sep 04 19:44:34 functional-143000 kubelet[6555]: I0904 19:44:34.418261    6555 reconciler_common.go:288] "Volume detached for volume \"test-volume\" (UniqueName: \"kubernetes.io/host-path/b93d6ab4-d69e-431c-ab21-e3a1b54273a9-test-volume\") on node \"functional-143000\" DevicePath \"\""

	Sep 04 19:44:34 functional-143000 kubelet[6555]: I0904 19:44:34.418296    6555 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-c9vqf\" (UniqueName: \"kubernetes.io/projected/b93d6ab4-d69e-431c-ab21-e3a1b54273a9-kube-api-access-c9vqf\") on node \"functional-143000\" DevicePath \"\""

	Sep 04 19:44:35 functional-143000 kubelet[6555]: I0904 19:44:35.097134    6555 scope.go:117] "RemoveContainer" containerID="94d6776421b087c5db5a1809481750246227cbba4211e7cc76b7fd106b465ffc"

	Sep 04 19:44:35 functional-143000 kubelet[6555]: I0904 19:44:35.097651    6555 scope.go:117] "RemoveContainer" containerID="9b1984edfdb9e8b57d50c2279465b41ff6708319454c64ee67c7be21eecb4dd9"

	Sep 04 19:44:35 functional-143000 kubelet[6555]: E0904 19:44:35.097916    6555 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echoserver-arm\" with CrashLoopBackOff: \"back-off 20s restarting failed container=echoserver-arm pod=hello-node-64b4f8f9ff-x4fnh_default(18033e89-e3c0-4ea2-9ec5-0b766b4306ff)\"" pod="default/hello-node-64b4f8f9ff-x4fnh" podUID="18033e89-e3c0-4ea2-9ec5-0b766b4306ff"

	Sep 04 19:44:35 functional-143000 kubelet[6555]: I0904 19:44:35.111478    6555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b0ac6d5bbd802c3475042d3066e193ac2b76e7426cefb1813b4ba1bed79f11f6"

	Sep 04 19:44:38 functional-143000 kubelet[6555]: E0904 19:44:38.537873    6555 cpu_manager.go:395] "RemoveStaleState: removing container" podUID="b93d6ab4-d69e-431c-ab21-e3a1b54273a9" containerName="mount-munger"

	Sep 04 19:44:38 functional-143000 kubelet[6555]: I0904 19:44:38.537898    6555 memory_manager.go:354] "RemoveStaleState removing state" podUID="b93d6ab4-d69e-431c-ab21-e3a1b54273a9" containerName="mount-munger"

	Sep 04 19:44:38 functional-143000 kubelet[6555]: I0904 19:44:38.559035    6555 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a20288b-f6e0-4f01-87c4-4022419eb14a-tmp-volume\") pod \"kubernetes-dashboard-695b96c756-vwchb\" (UID: \"9a20288b-f6e0-4f01-87c4-4022419eb14a\") " pod="kubernetes-dashboard/kubernetes-dashboard-695b96c756-vwchb"

	Sep 04 19:44:38 functional-143000 kubelet[6555]: I0904 19:44:38.559128    6555 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w77jm\" (UniqueName: \"kubernetes.io/projected/9a20288b-f6e0-4f01-87c4-4022419eb14a-kube-api-access-w77jm\") pod \"kubernetes-dashboard-695b96c756-vwchb\" (UID: \"9a20288b-f6e0-4f01-87c4-4022419eb14a\") " pod="kubernetes-dashboard/kubernetes-dashboard-695b96c756-vwchb"

	Sep 04 19:44:38 functional-143000 kubelet[6555]: I0904 19:44:38.760298    6555 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-volume\" (UniqueName: \"kubernetes.io/empty-dir/0288ef48-f80c-4d22-84d7-f082a3420033-tmp-volume\") pod \"dashboard-metrics-scraper-c5db448b4-mqz9p\" (UID: \"0288ef48-f80c-4d22-84d7-f082a3420033\") " pod="kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4-mqz9p"

	Sep 04 19:44:38 functional-143000 kubelet[6555]: I0904 19:44:38.760328    6555 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qtjp\" (UniqueName: \"kubernetes.io/projected/0288ef48-f80c-4d22-84d7-f082a3420033-kube-api-access-6qtjp\") pod \"dashboard-metrics-scraper-c5db448b4-mqz9p\" (UID: \"0288ef48-f80c-4d22-84d7-f082a3420033\") " pod="kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4-mqz9p"

	==> storage-provisioner [2b8e57e0a510] <==

	I0904 19:43:30.560167       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0904 19:43:30.565870       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0904 19:43:30.565892       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I0904 19:43:47.978786       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0904 19:43:47.979951       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_functional-143000_21cf5ce1-dc7f-4dfb-9a4a-5dc3c3166f97!

	I0904 19:43:47.981621       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"23410317-2675-49af-9e2f-1144e1fa7087", APIVersion:"v1", ResourceVersion:"631", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' functional-143000_21cf5ce1-dc7f-4dfb-9a4a-5dc3c3166f97 became leader

	I0904 19:43:48.080161       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_functional-143000_21cf5ce1-dc7f-4dfb-9a4a-5dc3c3166f97!

	I0904 19:44:01.089579       1 controller.go:1332] provision "default/myclaim" class "standard": started

	I0904 19:44:01.089781       1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"myclaim", UID:"8a01514f-c5dd-420f-aa55-8cd29cd6df65", APIVersion:"v1", ResourceVersion:"692", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/myclaim"

	I0904 19:44:01.089654       1 storage_provisioner.go:61] Provisioning volume {&StorageClass{ObjectMeta:{standard    91ab10db-1f04-46e9-9831-62f6aba429b9 339 0 2024-09-04 19:41:48 +0000 UTC <nil> <nil> map[addonmanager.kubernetes.io/mode:EnsureExists] map[kubectl.kubernetes.io/last-applied-configuration:{"apiVersion":"storage.k8s.io/v1","kind":"StorageClass","metadata":{"annotations":{"storageclass.kubernetes.io/is-default-class":"true"},"labels":{"addonmanager.kubernetes.io/mode":"EnsureExists"},"name":"standard"},"provisioner":"k8s.io/minikube-hostpath"}

	 storageclass.kubernetes.io/is-default-class:true] [] []  [{kubectl-client-side-apply Update storage.k8s.io/v1 2024-09-04 19:41:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubectl.kubernetes.io/last-applied-configuration":{},"f:storageclass.kubernetes.io/is-default-class":{}},"f:labels":{".":{},"f:addonmanager.kubernetes.io/mode":{}}},"f:provisioner":{},"f:reclaimPolicy":{},"f:volumeBindingMode":{}}}]},Provisioner:k8s.io/minikube-hostpath,Parameters:map[string]string{},ReclaimPolicy:*Delete,MountOptions:[],AllowVolumeExpansion:nil,VolumeBindingMode:*Immediate,AllowedTopologies:[]TopologySelectorTerm{},} pvc-8a01514f-c5dd-420f-aa55-8cd29cd6df65 &PersistentVolumeClaim{ObjectMeta:{myclaim  default  8a01514f-c5dd-420f-aa55-8cd29cd6df65 692 0 2024-09-04 19:44:01 +0000 UTC <nil> <nil> map[] map[kubectl.kubernetes.io/last-applied-configuration:{"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"name":"myclaim","namespace":"default"},"spec":{"accessModes":["Rea

dWriteOnce"],"resources":{"requests":{"storage":"500Mi"}},"volumeMode":"Filesystem"}}

	 volume.beta.kubernetes.io/storage-provisioner:k8s.io/minikube-hostpath volume.kubernetes.io/storage-provisioner:k8s.io/minikube-hostpath] [] [kubernetes.io/pvc-protection]  [{kube-controller-manager Update v1 2024-09-04 19:44:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:volume.beta.kubernetes.io/storage-provisioner":{},"f:volume.kubernetes.io/storage-provisioner":{}}}}} {kubectl-client-side-apply Update v1 2024-09-04 19:44:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubectl.kubernetes.io/last-applied-configuration":{}}},"f:spec":{"f:accessModes":{},"f:resources":{"f:requests":{".":{},"f:storage":{}}},"f:volumeMode":{}}}}]},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{524288000 0} {<nil>} 500Mi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*standard,VolumeMode:*Filesystem,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:

ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},},} nil} to /tmp/hostpath-provisioner/default/myclaim

	I0904 19:44:01.090128       1 controller.go:1439] provision "default/myclaim" class "standard": volume "pvc-8a01514f-c5dd-420f-aa55-8cd29cd6df65" provisioned

	I0904 19:44:01.090148       1 controller.go:1456] provision "default/myclaim" class "standard": succeeded

	I0904 19:44:01.090155       1 volume_store.go:212] Trying to save persistentvolume "pvc-8a01514f-c5dd-420f-aa55-8cd29cd6df65"

	I0904 19:44:01.096850       1 volume_store.go:219] persistentvolume "pvc-8a01514f-c5dd-420f-aa55-8cd29cd6df65" saved

	I0904 19:44:01.097330       1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"myclaim", UID:"8a01514f-c5dd-420f-aa55-8cd29cd6df65", APIVersion:"v1", ResourceVersion:"692", FieldPath:""}): type: 'Normal' reason: 'ProvisioningSucceeded' Successfully provisioned volume pvc-8a01514f-c5dd-420f-aa55-8cd29cd6df65

	==> storage-provisioner [496ee0afa53b] <==

	I0904 19:42:47.731517       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0904 19:42:47.739984       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0904 19:42:47.740000       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I0904 19:43:05.142670       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0904 19:43:05.142752       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_functional-143000_1d203bac-4285-4131-8e46-b5a8987ac85e!

	I0904 19:43:05.142900       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"23410317-2675-49af-9e2f-1144e1fa7087", APIVersion:"v1", ResourceVersion:"528", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' functional-143000_1d203bac-4285-4131-8e46-b5a8987ac85e became leader

	I0904 19:43:05.243488       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_functional-143000_1d203bac-4285-4131-8e46-b5a8987ac85e!

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.APIServer}} -p functional-143000 -n functional-143000

helpers_test.go:261: (dbg) Run:  kubectl --context functional-143000 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:272: non-running pods: busybox-mount dashboard-metrics-scraper-c5db448b4-mqz9p kubernetes-dashboard-695b96c756-vwchb

helpers_test.go:274: ======> post-mortem[TestFunctional/parallel/ServiceCmdConnect]: describe non-running pods <======

helpers_test.go:277: (dbg) Run:  kubectl --context functional-143000 describe pod busybox-mount dashboard-metrics-scraper-c5db448b4-mqz9p kubernetes-dashboard-695b96c756-vwchb

helpers_test.go:277: (dbg) Non-zero exit: kubectl --context functional-143000 describe pod busybox-mount dashboard-metrics-scraper-c5db448b4-mqz9p kubernetes-dashboard-695b96c756-vwchb: exit status 1 (42.549042ms)

-- stdout --

	Name:             busybox-mount

	Namespace:        default

	Priority:         0

	Service Account:  default

	Node:             functional-143000/192.168.105.4

	Start Time:       Wed, 04 Sep 2024 12:44:31 -0700

	Labels:           integration-test=busybox-mount

	Annotations:      <none>

	Status:           Succeeded

	IP:               10.244.0.12

	IPs:

	  IP:  10.244.0.12

	Containers:

	  mount-munger:

	    Container ID:  docker://119055ffc614b5f05bc65da124951ec398ee427044cde90138cfe996c12f9496

	    Image:         gcr.io/k8s-minikube/busybox:1.28.4-glibc

	    Image ID:      docker-pullable://gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e

	    Port:          <none>

	    Host Port:     <none>

	    Command:

	      /bin/sh

	      -c

	      --

	    Args:

	      cat /mount-9p/created-by-test; echo test > /mount-9p/created-by-pod; rm /mount-9p/created-by-test-removed-by-pod; echo test > /mount-9p/created-by-pod-removed-by-test date >> /mount-9p/pod-dates

	    State:          Terminated

	      Reason:       Completed

	      Exit Code:    0

	      Started:      Wed, 04 Sep 2024 12:44:32 -0700

	      Finished:     Wed, 04 Sep 2024 12:44:32 -0700

	    Ready:          False

	    Restart Count:  0

	    Environment:    <none>

	    Mounts:

	      /mount-9p from test-volume (rw)

	      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-c9vqf (ro)

	Conditions:

	  Type                        Status

	  PodReadyToStartContainers   False 

	  Initialized                 True 

	  Ready                       False 

	  ContainersReady             False 

	  PodScheduled                True 

	Volumes:

	  test-volume:

	    Type:          HostPath (bare host directory volume)

	    Path:          /mount-9p

	    HostPathType:  

	  kube-api-access-c9vqf:

	    Type:                    Projected (a volume that contains injected data from multiple sources)

	    TokenExpirationSeconds:  3607

	    ConfigMapName:           kube-root-ca.crt

	    ConfigMapOptional:       <nil>

	    DownwardAPI:             true

	QoS Class:                   BestEffort

	Node-Selectors:              <none>

	Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

	                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

	Events:

	  Type    Reason     Age   From               Message

	  ----    ------     ----  ----               -------

	  Normal  Scheduled  7s    default-scheduler  Successfully assigned default/busybox-mount to functional-143000

	  Normal  Pulling    7s    kubelet            Pulling image "gcr.io/k8s-minikube/busybox:1.28.4-glibc"

	  Normal  Pulled     6s    kubelet            Successfully pulled image "gcr.io/k8s-minikube/busybox:1.28.4-glibc" in 1.341s (1.341s including waiting). Image size: 3547125 bytes.

	  Normal  Created    6s    kubelet            Created container mount-munger

	  Normal  Started    6s    kubelet            Started container mount-munger

-- /stdout --

** stderr ** 

	Error from server (NotFound): pods "dashboard-metrics-scraper-c5db448b4-mqz9p" not found

	Error from server (NotFound): pods "kubernetes-dashboard-695b96c756-vwchb" not found

** /stderr **

helpers_test.go:279: kubectl --context functional-143000 describe pod busybox-mount dashboard-metrics-scraper-c5db448b4-mqz9p kubernetes-dashboard-695b96c756-vwchb: exit status 1

--- FAIL: TestFunctional/parallel/ServiceCmdConnect (31.48s)

=== RUN   TestFunctional/parallel/License

=== PAUSE TestFunctional/parallel/License

=== CONT  TestFunctional/parallel/License

functional_test.go:2288: (dbg) Run:  out/minikube-darwin-arm64 license

functional_test.go:2288: (dbg) Non-zero exit: out/minikube-darwin-arm64 license: exit status 40 (140.016333ms)

-- stdout --

-- /stdout --

** stderr ** 

	X Exiting due to INET_LICENSES: Failed to download licenses: download request did not return a 200, received: 404

	* 

	╭────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                            │

	│    * If the above advice does not help, please let us know:                                                                │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                              │

	│                                                                                                                            │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                   │

	│    * Please also attach the following file to the GitHub issue:                                                            │

	│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_license_42713f820c0ac68901ecf7b12bfdf24c2cafe65d_0.log    │

	│                                                                                                                            │

	╰────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

functional_test.go:2289: command "\n\n" failed: exit status 40

--- FAIL: TestFunctional/parallel/License (0.14s)

=== RUN   TestMultiControlPlane/serial/StopSecondaryNode

ha_test.go:363: (dbg) Run:  out/minikube-darwin-arm64 -p ha-789000 node stop m02 -v=7 --alsologtostderr

E0904 12:48:55.525785    1661 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/addons-970000/client.crt: no such file or directory" logger="UnhandledError"

E0904 12:48:55.880803    1661 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/functional-143000/client.crt: no such file or directory" logger="UnhandledError"

E0904 12:48:55.888384    1661 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/functional-143000/client.crt: no such file or directory" logger="UnhandledError"

E0904 12:48:55.901751    1661 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/functional-143000/client.crt: no such file or directory" logger="UnhandledError"

E0904 12:48:55.925119    1661 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/functional-143000/client.crt: no such file or directory" logger="UnhandledError"

E0904 12:48:55.968476    1661 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/functional-143000/client.crt: no such file or directory" logger="UnhandledError"

E0904 12:48:56.051855    1661 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/functional-143000/client.crt: no such file or directory" logger="UnhandledError"

E0904 12:48:56.215211    1661 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/functional-143000/client.crt: no such file or directory" logger="UnhandledError"

E0904 12:48:56.538579    1661 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/functional-143000/client.crt: no such file or directory" logger="UnhandledError"

E0904 12:48:57.181984    1661 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/functional-143000/client.crt: no such file or directory" logger="UnhandledError"

E0904 12:48:58.465458    1661 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/functional-143000/client.crt: no such file or directory" logger="UnhandledError"

E0904 12:49:01.028909    1661 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/functional-143000/client.crt: no such file or directory" logger="UnhandledError"

E0904 12:49:06.150911    1661 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/functional-143000/client.crt: no such file or directory" logger="UnhandledError"

ha_test.go:363: (dbg) Done: out/minikube-darwin-arm64 -p ha-789000 node stop m02 -v=7 --alsologtostderr: (12.192014958s)

ha_test.go:369: (dbg) Run:  out/minikube-darwin-arm64 -p ha-789000 status -v=7 --alsologtostderr

E0904 12:49:16.394053    1661 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/functional-143000/client.crt: no such file or directory" logger="UnhandledError"

E0904 12:49:36.876684    1661 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/functional-143000/client.crt: no such file or directory" logger="UnhandledError"

E0904 12:50:17.839314    1661 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/functional-143000/client.crt: no such file or directory" logger="UnhandledError"

E0904 12:51:39.761097    1661 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/functional-143000/client.crt: no such file or directory" logger="UnhandledError"

ha_test.go:369: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-789000 status -v=7 --alsologtostderr: exit status 7 (2m56.030865166s)

-- stdout --

	ha-789000

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-789000-m02

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-789000-m03

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-789000-m04

	type: Worker

	host: Error

	kubelet: Nonexistent

-- /stdout --

** stderr ** 

	I0904 12:49:06.212471    3065 out.go:345] Setting OutFile to fd 1 ...

	I0904 12:49:06.212840    3065 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 12:49:06.212844    3065 out.go:358] Setting ErrFile to fd 2...

	I0904 12:49:06.212847    3065 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 12:49:06.213020    3065 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19575-1140/.minikube/bin

	I0904 12:49:06.213176    3065 out.go:352] Setting JSON to false

	I0904 12:49:06.213187    3065 mustload.go:65] Loading cluster: ha-789000

	I0904 12:49:06.213223    3065 notify.go:220] Checking for updates...

	I0904 12:49:06.213440    3065 config.go:182] Loaded profile config "ha-789000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0904 12:49:06.213448    3065 status.go:255] checking status of ha-789000 ...

	I0904 12:49:06.214212    3065 status.go:330] ha-789000 host status = "Running" (err=<nil>)

	I0904 12:49:06.214220    3065 host.go:66] Checking if "ha-789000" exists ...

	I0904 12:49:06.214315    3065 host.go:66] Checking if "ha-789000" exists ...

	I0904 12:49:06.214427    3065 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0904 12:49:06.214436    3065 sshutil.go:53] new ssh client: &{IP:192.168.105.5 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/ha-789000/id_rsa Username:docker}

	W0904 12:49:32.185664    3065 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.5:22: connect: operation timed out

	W0904 12:49:32.185807    3065 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

	E0904 12:49:32.185826    3065 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

	I0904 12:49:32.185839    3065 status.go:257] ha-789000 status: &{Name:ha-789000 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0904 12:49:32.185858    3065 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

	I0904 12:49:32.185871    3065 status.go:255] checking status of ha-789000-m02 ...

	I0904 12:49:32.186269    3065 status.go:330] ha-789000-m02 host status = "Stopped" (err=<nil>)

	I0904 12:49:32.186279    3065 status.go:343] host is not running, skipping remaining checks

	I0904 12:49:32.186284    3065 status.go:257] ha-789000-m02 status: &{Name:ha-789000-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0904 12:49:32.186295    3065 status.go:255] checking status of ha-789000-m03 ...

	I0904 12:49:32.187441    3065 status.go:330] ha-789000-m03 host status = "Running" (err=<nil>)

	I0904 12:49:32.187472    3065 host.go:66] Checking if "ha-789000-m03" exists ...

	I0904 12:49:32.187701    3065 host.go:66] Checking if "ha-789000-m03" exists ...

	I0904 12:49:32.187942    3065 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0904 12:49:32.187956    3065 sshutil.go:53] new ssh client: &{IP:192.168.105.7 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/ha-789000-m03/id_rsa Username:docker}

	W0904 12:50:47.188255    3065 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.7:22: connect: operation timed out

	W0904 12:50:47.188306    3065 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.105.7:22: connect: operation timed out

	E0904 12:50:47.188329    3065 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.7:22: connect: operation timed out

	I0904 12:50:47.188333    3065 status.go:257] ha-789000-m03 status: &{Name:ha-789000-m03 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0904 12:50:47.188343    3065 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.105.7:22: connect: operation timed out

	I0904 12:50:47.188346    3065 status.go:255] checking status of ha-789000-m04 ...

	I0904 12:50:47.189050    3065 status.go:330] ha-789000-m04 host status = "Running" (err=<nil>)

	I0904 12:50:47.189059    3065 host.go:66] Checking if "ha-789000-m04" exists ...

	I0904 12:50:47.189167    3065 host.go:66] Checking if "ha-789000-m04" exists ...

	I0904 12:50:47.189294    3065 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0904 12:50:47.189300    3065 sshutil.go:53] new ssh client: &{IP:192.168.105.8 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/ha-789000-m04/id_rsa Username:docker}

	W0904 12:52:02.190170    3065 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.8:22: connect: operation timed out

	W0904 12:52:02.190232    3065 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.105.8:22: connect: operation timed out

	E0904 12:52:02.190242    3065 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.8:22: connect: operation timed out

	I0904 12:52:02.190247    3065 status.go:257] ha-789000-m04 status: &{Name:ha-789000-m04 Host:Error Kubelet:Nonexistent APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

	E0904 12:52:02.190259    3065 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.105.8:22: connect: operation timed out

** /stderr **

ha_test.go:378: status says not three hosts are running: args "out/minikube-darwin-arm64 -p ha-789000 status -v=7 --alsologtostderr": ha-789000

type: Control Plane

host: Error

kubelet: Nonexistent

apiserver: Nonexistent

kubeconfig: Configured

ha-789000-m02

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-789000-m03

type: Control Plane

host: Error

kubelet: Nonexistent

apiserver: Nonexistent

kubeconfig: Configured

ha-789000-m04

type: Worker

host: Error

kubelet: Nonexistent

ha_test.go:381: status says not three kubelets are running: args "out/minikube-darwin-arm64 -p ha-789000 status -v=7 --alsologtostderr": ha-789000

type: Control Plane

host: Error

kubelet: Nonexistent

apiserver: Nonexistent

kubeconfig: Configured

ha-789000-m02

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-789000-m03

type: Control Plane

host: Error

kubelet: Nonexistent

apiserver: Nonexistent

kubeconfig: Configured

ha-789000-m04

type: Worker

host: Error

kubelet: Nonexistent

ha_test.go:384: status says not two apiservers are running: args "out/minikube-darwin-arm64 -p ha-789000 status -v=7 --alsologtostderr": ha-789000

type: Control Plane

host: Error

kubelet: Nonexistent

apiserver: Nonexistent

kubeconfig: Configured

ha-789000-m02

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-789000-m03

type: Control Plane

host: Error

kubelet: Nonexistent

apiserver: Nonexistent

kubeconfig: Configured

ha-789000-m04

type: Worker

host: Error

kubelet: Nonexistent

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-789000 -n ha-789000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-789000 -n ha-789000: exit status 3 (25.959588125s)

-- stdout --

	Error

-- /stdout --

** stderr ** 

	E0904 12:52:28.149777    3088 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

	E0904 12:52:28.149791    3088 status.go:249] status error: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

** /stderr **

helpers_test.go:239: status error: exit status 3 (may be ok)

helpers_test.go:241: "ha-789000" host is not running, skipping log retrieval (state="Error")

--- FAIL: TestMultiControlPlane/serial/StopSecondaryNode (214.18s)

=== RUN   TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop

ha_test.go:390: (dbg) Run:  out/minikube-darwin-arm64 profile list --output json

E0904 12:53:27.790510    1661 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/addons-970000/client.crt: no such file or directory" logger="UnhandledError"

ha_test.go:390: (dbg) Done: out/minikube-darwin-arm64 profile list --output json: (1m17.534011708s)

ha_test.go:413: expected profile "ha-789000" in json of 'profile list' to have "Degraded" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-789000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-789000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube/iso/minikube-v1.34.0-arm64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"qemu2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\":1,\"APIServerPort\":8443,\"DockerOpt\":null,\"Disable

DriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.31.0\",\"ClusterName\":\"ha-789000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"192.168.105.254\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"192.168.105.5\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"

docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m02\",\"IP\":\"192.168.105.6\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m03\",\"IP\":\"192.168.105.7\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m04\",\"IP\":\"192.168.105.8\",\"Port\":0,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"\",\"ControlPlane\":false,\"Worker\":true}],\"Addons\":{\"ambassador\":false,\"auto-pause\":false,\"cloud-spanner\":false,\"csi-hostpath-driver\":false,\"dashboard\":false,\"default-storageclass\":false,\"efk\":false,\"freshpod\":false,\"gcp-auth\":false,\"gvisor\":false,\"headlamp\":false,\"helm-tiller\":false,\"inaccel\":false,\"ingress\":false,\"ingress-dns\":false,\"inspektor-gadget\":false,\"istio\":false,\"istio-provisioner\":false,\"kong\":false,\"kubeflow\":false,\"kubevirt\":false,\"logviewer\":false,\"metallb\":false,\"metric

s-server\":false,\"nvidia-device-plugin\":false,\"nvidia-driver-installer\":false,\"nvidia-gpu-device-plugin\":false,\"olm\":false,\"pod-security-policy\":false,\"portainer\":false,\"registry\":false,\"registry-aliases\":false,\"registry-creds\":false,\"storage-provisioner\":false,\"storage-provisioner-gluster\":false,\"storage-provisioner-rancher\":false,\"volcano\":false,\"volumesnapshots\":false,\"yakd\":false},\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"socket_vmnet\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOpti

ons\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"/opt/socket_vmnet/bin/socket_vmnet_client\",\"SocketVMnetPath\":\"/var/run/socket_vmnet\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":true}]}"*. args: "out/minikube-darwin-arm64 profile list --output json"

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-789000 -n ha-789000

E0904 12:53:55.875410    1661 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/functional-143000/client.crt: no such file or directory" logger="UnhandledError"

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-789000 -n ha-789000: exit status 3 (25.963632083s)

-- stdout --

	Error

-- /stdout --

** stderr ** 

	E0904 12:54:11.645042    3106 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

	E0904 12:54:11.645068    3106 status.go:249] status error: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

** /stderr **

helpers_test.go:239: status error: exit status 3 (may be ok)

helpers_test.go:241: "ha-789000" host is not running, skipping log retrieval (state="Error")

--- FAIL: TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop (103.50s)

=== RUN   TestMultiControlPlane/serial/RestartSecondaryNode

ha_test.go:420: (dbg) Run:  out/minikube-darwin-arm64 -p ha-789000 node start m02 -v=7 --alsologtostderr

ha_test.go:420: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-789000 node start m02 -v=7 --alsologtostderr: exit status 80 (5.112865042s)

-- stdout --

	* Starting "ha-789000-m02" control-plane node in "ha-789000" cluster

	* Restarting existing qemu2 VM for "ha-789000-m02" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Restarting existing qemu2 VM for "ha-789000-m02" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0904 12:54:11.693620    3109 out.go:345] Setting OutFile to fd 1 ...

	I0904 12:54:11.693885    3109 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 12:54:11.693890    3109 out.go:358] Setting ErrFile to fd 2...

	I0904 12:54:11.693892    3109 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 12:54:11.694054    3109 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19575-1140/.minikube/bin

	I0904 12:54:11.694351    3109 mustload.go:65] Loading cluster: ha-789000

	I0904 12:54:11.694640    3109 config.go:182] Loaded profile config "ha-789000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	W0904 12:54:11.694890    3109 host.go:58] "ha-789000-m02" host status: Stopped

	I0904 12:54:11.699395    3109 out.go:177] * Starting "ha-789000-m02" control-plane node in "ha-789000" cluster

	I0904 12:54:11.704366    3109 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0904 12:54:11.704380    3109 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19575-1140/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4

	I0904 12:54:11.704390    3109 cache.go:56] Caching tarball of preloaded images

	I0904 12:54:11.704494    3109 preload.go:172] Found /Users/jenkins/minikube-integration/19575-1140/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0904 12:54:11.704516    3109 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker

	I0904 12:54:11.704603    3109 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/ha-789000/config.json ...

	I0904 12:54:11.705138    3109 start.go:360] acquireMachinesLock for ha-789000-m02: {Name:mkffea5767ac0f54c70242857234a501d8b5b2f4 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0904 12:54:11.705193    3109 start.go:364] duration metric: took 31.75µs to acquireMachinesLock for "ha-789000-m02"

	I0904 12:54:11.705202    3109 start.go:96] Skipping create...Using existing machine configuration

	I0904 12:54:11.705207    3109 fix.go:54] fixHost starting: m02

	I0904 12:54:11.705357    3109 fix.go:112] recreateIfNeeded on ha-789000-m02: state=Stopped err=<nil>

	W0904 12:54:11.705363    3109 fix.go:138] unexpected machine state, will restart: <nil>

	I0904 12:54:11.709384    3109 out.go:177] * Restarting existing qemu2 VM for "ha-789000-m02" ...

	I0904 12:54:11.713395    3109 qemu.go:418] Using hvf for hardware acceleration

	I0904 12:54:11.713452    3109 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/ha-789000-m02/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/ha-789000-m02/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/ha-789000-m02/qemu.pid -device virtio-net-pci,netdev=net0,mac=7a:0d:d2:31:6b:8c -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/ha-789000-m02/disk.qcow2

	I0904 12:54:11.716504    3109 main.go:141] libmachine: STDOUT: 

	I0904 12:54:11.716526    3109 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0904 12:54:11.716555    3109 fix.go:56] duration metric: took 11.348292ms for fixHost

	I0904 12:54:11.716561    3109 start.go:83] releasing machines lock for "ha-789000-m02", held for 11.364041ms

	W0904 12:54:11.716568    3109 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0904 12:54:11.716607    3109 out.go:270] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0904 12:54:11.716612    3109 start.go:729] Will try again in 5 seconds ...

	I0904 12:54:16.717751    3109 start.go:360] acquireMachinesLock for ha-789000-m02: {Name:mkffea5767ac0f54c70242857234a501d8b5b2f4 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0904 12:54:16.718292    3109 start.go:364] duration metric: took 430.75µs to acquireMachinesLock for "ha-789000-m02"

	I0904 12:54:16.718440    3109 start.go:96] Skipping create...Using existing machine configuration

	I0904 12:54:16.718456    3109 fix.go:54] fixHost starting: m02

	I0904 12:54:16.719052    3109 fix.go:112] recreateIfNeeded on ha-789000-m02: state=Stopped err=<nil>

	W0904 12:54:16.719073    3109 fix.go:138] unexpected machine state, will restart: <nil>

	I0904 12:54:16.723217    3109 out.go:177] * Restarting existing qemu2 VM for "ha-789000-m02" ...

	I0904 12:54:16.727205    3109 qemu.go:418] Using hvf for hardware acceleration

	I0904 12:54:16.727371    3109 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/ha-789000-m02/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/ha-789000-m02/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/ha-789000-m02/qemu.pid -device virtio-net-pci,netdev=net0,mac=7a:0d:d2:31:6b:8c -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/ha-789000-m02/disk.qcow2

	I0904 12:54:16.735053    3109 main.go:141] libmachine: STDOUT: 

	I0904 12:54:16.735115    3109 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0904 12:54:16.735195    3109 fix.go:56] duration metric: took 16.741416ms for fixHost

	I0904 12:54:16.735210    3109 start.go:83] releasing machines lock for "ha-789000-m02", held for 16.900209ms

	W0904 12:54:16.735342    3109 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p ha-789000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p ha-789000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0904 12:54:16.740112    3109 out.go:201] 

	W0904 12:54:16.744210    3109 out.go:270] X Exiting due to GUEST_NODE_PROVISION: provisioning host for node: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_NODE_PROVISION: provisioning host for node: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0904 12:54:16.744228    3109 out.go:270] * 

	* 

	W0904 12:54:16.749963    3109 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                         │

	│    * If the above advice does not help, please let us know:                                                             │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

	│                                                                                                                         │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

	│    * Please also attach the following file to the GitHub issue:                                                         │

	│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │

	│                                                                                                                         │

	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                         │

	│    * If the above advice does not help, please let us know:                                                             │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

	│                                                                                                                         │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

	│    * Please also attach the following file to the GitHub issue:                                                         │

	│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │

	│                                                                                                                         │

	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	I0904 12:54:16.754089    3109 out.go:201] 

** /stderr **

ha_test.go:422: I0904 12:54:11.693620    3109 out.go:345] Setting OutFile to fd 1 ...

I0904 12:54:11.693885    3109 out.go:392] TERM=,COLORTERM=, which probably does not support color

I0904 12:54:11.693890    3109 out.go:358] Setting ErrFile to fd 2...

I0904 12:54:11.693892    3109 out.go:392] TERM=,COLORTERM=, which probably does not support color

I0904 12:54:11.694054    3109 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19575-1140/.minikube/bin

I0904 12:54:11.694351    3109 mustload.go:65] Loading cluster: ha-789000

I0904 12:54:11.694640    3109 config.go:182] Loaded profile config "ha-789000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

W0904 12:54:11.694890    3109 host.go:58] "ha-789000-m02" host status: Stopped

I0904 12:54:11.699395    3109 out.go:177] * Starting "ha-789000-m02" control-plane node in "ha-789000" cluster

I0904 12:54:11.704366    3109 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

I0904 12:54:11.704380    3109 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19575-1140/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4

I0904 12:54:11.704390    3109 cache.go:56] Caching tarball of preloaded images

I0904 12:54:11.704494    3109 preload.go:172] Found /Users/jenkins/minikube-integration/19575-1140/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download

I0904 12:54:11.704516    3109 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker

I0904 12:54:11.704603    3109 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/ha-789000/config.json ...

I0904 12:54:11.705138    3109 start.go:360] acquireMachinesLock for ha-789000-m02: {Name:mkffea5767ac0f54c70242857234a501d8b5b2f4 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

I0904 12:54:11.705193    3109 start.go:364] duration metric: took 31.75µs to acquireMachinesLock for "ha-789000-m02"

I0904 12:54:11.705202    3109 start.go:96] Skipping create...Using existing machine configuration

I0904 12:54:11.705207    3109 fix.go:54] fixHost starting: m02

I0904 12:54:11.705357    3109 fix.go:112] recreateIfNeeded on ha-789000-m02: state=Stopped err=<nil>

W0904 12:54:11.705363    3109 fix.go:138] unexpected machine state, will restart: <nil>

I0904 12:54:11.709384    3109 out.go:177] * Restarting existing qemu2 VM for "ha-789000-m02" ...

I0904 12:54:11.713395    3109 qemu.go:418] Using hvf for hardware acceleration

I0904 12:54:11.713452    3109 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/ha-789000-m02/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/ha-789000-m02/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/ha-789000-m02/qemu.pid -device virtio-net-pci,netdev=net0,mac=7a:0d:d2:31:6b:8c -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/ha-789000-m02/disk.qcow2

I0904 12:54:11.716504    3109 main.go:141] libmachine: STDOUT: 

I0904 12:54:11.716526    3109 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

I0904 12:54:11.716555    3109 fix.go:56] duration metric: took 11.348292ms for fixHost

I0904 12:54:11.716561    3109 start.go:83] releasing machines lock for "ha-789000-m02", held for 11.364041ms

W0904 12:54:11.716568    3109 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

W0904 12:54:11.716607    3109 out.go:270] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

I0904 12:54:11.716612    3109 start.go:729] Will try again in 5 seconds ...

I0904 12:54:16.717751    3109 start.go:360] acquireMachinesLock for ha-789000-m02: {Name:mkffea5767ac0f54c70242857234a501d8b5b2f4 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

I0904 12:54:16.718292    3109 start.go:364] duration metric: took 430.75µs to acquireMachinesLock for "ha-789000-m02"

I0904 12:54:16.718440    3109 start.go:96] Skipping create...Using existing machine configuration

I0904 12:54:16.718456    3109 fix.go:54] fixHost starting: m02

I0904 12:54:16.719052    3109 fix.go:112] recreateIfNeeded on ha-789000-m02: state=Stopped err=<nil>

W0904 12:54:16.719073    3109 fix.go:138] unexpected machine state, will restart: <nil>

I0904 12:54:16.723217    3109 out.go:177] * Restarting existing qemu2 VM for "ha-789000-m02" ...

I0904 12:54:16.727205    3109 qemu.go:418] Using hvf for hardware acceleration

I0904 12:54:16.727371    3109 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/ha-789000-m02/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/ha-789000-m02/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/ha-789000-m02/qemu.pid -device virtio-net-pci,netdev=net0,mac=7a:0d:d2:31:6b:8c -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/ha-789000-m02/disk.qcow2

I0904 12:54:16.735053    3109 main.go:141] libmachine: STDOUT: 

I0904 12:54:16.735115    3109 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

I0904 12:54:16.735195    3109 fix.go:56] duration metric: took 16.741416ms for fixHost

I0904 12:54:16.735210    3109 start.go:83] releasing machines lock for "ha-789000-m02", held for 16.900209ms

W0904 12:54:16.735342    3109 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p ha-789000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

* Failed to start qemu2 VM. Running "minikube delete -p ha-789000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

I0904 12:54:16.740112    3109 out.go:201] 

W0904 12:54:16.744210    3109 out.go:270] X Exiting due to GUEST_NODE_PROVISION: provisioning host for node: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

X Exiting due to GUEST_NODE_PROVISION: provisioning host for node: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

W0904 12:54:16.744228    3109 out.go:270] * 

* 

W0904 12:54:16.749963    3109 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

│                                                                                                                         │

│    * If the above advice does not help, please let us know:                                                             │

│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

│                                                                                                                         │

│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

│    * Please also attach the following file to the GitHub issue:                                                         │

│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │

│                                                                                                                         │

╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

│                                                                                                                         │

│    * If the above advice does not help, please let us know:                                                             │

│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

│                                                                                                                         │

│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

│    * Please also attach the following file to the GitHub issue:                                                         │

│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │

│                                                                                                                         │

╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

I0904 12:54:16.754089    3109 out.go:201] 

ha_test.go:423: secondary control-plane node start returned an error. args "out/minikube-darwin-arm64 -p ha-789000 node start m02 -v=7 --alsologtostderr": exit status 80

ha_test.go:428: (dbg) Run:  out/minikube-darwin-arm64 -p ha-789000 status -v=7 --alsologtostderr

E0904 12:54:23.601456    1661 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/functional-143000/client.crt: no such file or directory" logger="UnhandledError"

ha_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-789000 status -v=7 --alsologtostderr: exit status 7 (2m58.118769083s)

-- stdout --

	ha-789000

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-789000-m02

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-789000-m03

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-789000-m04

	type: Worker

	host: Error

	kubelet: Nonexistent

-- /stdout --

** stderr ** 

	I0904 12:54:16.811179    3113 out.go:345] Setting OutFile to fd 1 ...

	I0904 12:54:16.811385    3113 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 12:54:16.811391    3113 out.go:358] Setting ErrFile to fd 2...

	I0904 12:54:16.811393    3113 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 12:54:16.811549    3113 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19575-1140/.minikube/bin

	I0904 12:54:16.811721    3113 out.go:352] Setting JSON to false

	I0904 12:54:16.811741    3113 mustload.go:65] Loading cluster: ha-789000

	I0904 12:54:16.811805    3113 notify.go:220] Checking for updates...

	I0904 12:54:16.812037    3113 config.go:182] Loaded profile config "ha-789000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0904 12:54:16.812048    3113 status.go:255] checking status of ha-789000 ...

	I0904 12:54:16.812944    3113 status.go:330] ha-789000 host status = "Running" (err=<nil>)

	I0904 12:54:16.812953    3113 host.go:66] Checking if "ha-789000" exists ...

	I0904 12:54:16.813068    3113 host.go:66] Checking if "ha-789000" exists ...

	I0904 12:54:16.813196    3113 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0904 12:54:16.813204    3113 sshutil.go:53] new ssh client: &{IP:192.168.105.5 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/ha-789000/id_rsa Username:docker}

	W0904 12:54:16.813404    3113 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.5:22: connect: host is down

	I0904 12:54:16.813421    3113 retry.go:31] will retry after 190.846621ms: dial tcp 192.168.105.5:22: connect: host is down

	W0904 12:54:17.006621    3113 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.5:22: connect: host is down

	I0904 12:54:17.006672    3113 retry.go:31] will retry after 551.99472ms: dial tcp 192.168.105.5:22: connect: host is down

	W0904 12:54:17.561238    3113 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.5:22: connect: host is down

	I0904 12:54:17.561317    3113 retry.go:31] will retry after 408.134165ms: dial tcp 192.168.105.5:22: connect: host is down

	W0904 12:54:17.971645    3113 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.5:22: connect: host is down

	I0904 12:54:17.971705    3113 retry.go:31] will retry after 308.503761ms: new client: new client: dial tcp 192.168.105.5:22: connect: host is down

	I0904 12:54:18.282017    3113 sshutil.go:53] new ssh client: &{IP:192.168.105.5 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/ha-789000/id_rsa Username:docker}

	W0904 12:54:18.282291    3113 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.5:22: connect: host is down

	I0904 12:54:18.282305    3113 retry.go:31] will retry after 129.786698ms: dial tcp 192.168.105.5:22: connect: host is down

	W0904 12:54:18.414292    3113 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.5:22: connect: host is down

	I0904 12:54:18.414323    3113 retry.go:31] will retry after 529.973088ms: dial tcp 192.168.105.5:22: connect: host is down

	W0904 12:54:44.866717    3113 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.5:22: connect: operation timed out

	W0904 12:54:44.866770    3113 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

	E0904 12:54:44.866777    3113 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

	I0904 12:54:44.866781    3113 status.go:257] ha-789000 status: &{Name:ha-789000 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0904 12:54:44.866792    3113 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

	I0904 12:54:44.866795    3113 status.go:255] checking status of ha-789000-m02 ...

	I0904 12:54:44.867009    3113 status.go:330] ha-789000-m02 host status = "Stopped" (err=<nil>)

	I0904 12:54:44.867016    3113 status.go:343] host is not running, skipping remaining checks

	I0904 12:54:44.867019    3113 status.go:257] ha-789000-m02 status: &{Name:ha-789000-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0904 12:54:44.867023    3113 status.go:255] checking status of ha-789000-m03 ...

	I0904 12:54:44.867722    3113 status.go:330] ha-789000-m03 host status = "Running" (err=<nil>)

	I0904 12:54:44.867730    3113 host.go:66] Checking if "ha-789000-m03" exists ...

	I0904 12:54:44.867842    3113 host.go:66] Checking if "ha-789000-m03" exists ...

	I0904 12:54:44.867977    3113 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0904 12:54:44.867985    3113 sshutil.go:53] new ssh client: &{IP:192.168.105.7 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/ha-789000-m03/id_rsa Username:docker}

	W0904 12:55:59.869641    3113 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.7:22: connect: operation timed out

	W0904 12:55:59.869711    3113 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.105.7:22: connect: operation timed out

	E0904 12:55:59.869721    3113 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.7:22: connect: operation timed out

	I0904 12:55:59.869725    3113 status.go:257] ha-789000-m03 status: &{Name:ha-789000-m03 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0904 12:55:59.869735    3113 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.105.7:22: connect: operation timed out

	I0904 12:55:59.869739    3113 status.go:255] checking status of ha-789000-m04 ...

	I0904 12:55:59.870499    3113 status.go:330] ha-789000-m04 host status = "Running" (err=<nil>)

	I0904 12:55:59.870505    3113 host.go:66] Checking if "ha-789000-m04" exists ...

	I0904 12:55:59.870600    3113 host.go:66] Checking if "ha-789000-m04" exists ...

	I0904 12:55:59.870735    3113 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0904 12:55:59.870740    3113 sshutil.go:53] new ssh client: &{IP:192.168.105.8 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/ha-789000-m04/id_rsa Username:docker}

	W0904 12:57:14.870033    3113 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.8:22: connect: operation timed out

	W0904 12:57:14.870238    3113 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.105.8:22: connect: operation timed out

	E0904 12:57:14.870282    3113 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.8:22: connect: operation timed out

	I0904 12:57:14.870307    3113 status.go:257] ha-789000-m04 status: &{Name:ha-789000-m04 Host:Error Kubelet:Nonexistent APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

	E0904 12:57:14.870349    3113 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.105.8:22: connect: operation timed out

** /stderr **

ha_test.go:432: failed to run minikube status. args "out/minikube-darwin-arm64 -p ha-789000 status -v=7 --alsologtostderr" : exit status 7

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-789000 -n ha-789000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-789000 -n ha-789000: exit status 3 (26.003786083s)

-- stdout --

	Error

-- /stdout --

** stderr ** 

	E0904 12:57:40.875085    3138 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

	E0904 12:57:40.875141    3138 status.go:249] status error: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

** /stderr **

helpers_test.go:239: status error: exit status 3 (may be ok)

helpers_test.go:241: "ha-789000" host is not running, skipping log retrieval (state="Error")

--- FAIL: TestMultiControlPlane/serial/RestartSecondaryNode (209.24s)

=== RUN   TestMultiControlPlane/serial/RestartClusterKeepsNodes

ha_test.go:456: (dbg) Run:  out/minikube-darwin-arm64 node list -p ha-789000 -v=7 --alsologtostderr

ha_test.go:462: (dbg) Run:  out/minikube-darwin-arm64 stop -p ha-789000 -v=7 --alsologtostderr

E0904 12:59:50.886810    1661 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/addons-970000/client.crt: no such file or directory" logger="UnhandledError"

ha_test.go:462: (dbg) Done: out/minikube-darwin-arm64 stop -p ha-789000 -v=7 --alsologtostderr: (3m49.008089958s)

ha_test.go:467: (dbg) Run:  out/minikube-darwin-arm64 start -p ha-789000 --wait=true -v=7 --alsologtostderr

ha_test.go:467: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p ha-789000 --wait=true -v=7 --alsologtostderr: exit status 80 (5.225880125s)

-- stdout --

	* [ha-789000] minikube v1.34.0 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19575

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19575-1140/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19575-1140/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on existing profile

	* Starting "ha-789000" primary control-plane node in "ha-789000" cluster

	* Restarting existing qemu2 VM for "ha-789000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Restarting existing qemu2 VM for "ha-789000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0904 13:02:48.898430    3569 out.go:345] Setting OutFile to fd 1 ...

	I0904 13:02:48.898612    3569 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:02:48.898616    3569 out.go:358] Setting ErrFile to fd 2...

	I0904 13:02:48.898619    3569 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:02:48.898793    3569 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19575-1140/.minikube/bin

	I0904 13:02:48.899964    3569 out.go:352] Setting JSON to false

	I0904 13:02:48.919609    3569 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":3732,"bootTime":1725476436,"procs":471,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0904 13:02:48.919679    3569 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0904 13:02:48.924615    3569 out.go:177] * [ha-789000] minikube v1.34.0 on Darwin 14.5 (arm64)

	I0904 13:02:48.932578    3569 out.go:177]   - MINIKUBE_LOCATION=19575

	I0904 13:02:48.932636    3569 notify.go:220] Checking for updates...

	I0904 13:02:48.940477    3569 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19575-1140/kubeconfig

	I0904 13:02:48.943548    3569 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0904 13:02:48.946565    3569 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0904 13:02:48.949442    3569 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19575-1140/.minikube

	I0904 13:02:48.952529    3569 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0904 13:02:48.955956    3569 config.go:182] Loaded profile config "ha-789000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0904 13:02:48.956008    3569 driver.go:394] Setting default libvirt URI to qemu:///system

	I0904 13:02:48.960503    3569 out.go:177] * Using the qemu2 driver based on existing profile

	I0904 13:02:48.967479    3569 start.go:297] selected driver: qemu2

	I0904 13:02:48.967486    3569 start.go:901] validating driver "qemu2" against &{Name:ha-789000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.34.0-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:ha-789000 Namespace:default

APIServerHAVIP:192.168.105.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.5 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.105.6 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.105.7 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.105.8 Port:0 KubernetesVersion:v1.31.0 ContainerRuntime: ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:f

alse headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSi

ze:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0904 13:02:48.967565    3569 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0904 13:02:48.970217    3569 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0904 13:02:48.970243    3569 cni.go:84] Creating CNI manager for ""

	I0904 13:02:48.970249    3569 cni.go:136] multinode detected (4 nodes found), recommending kindnet

	I0904 13:02:48.970315    3569 start.go:340] cluster config:

	{Name:ha-789000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.34.0-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:ha-789000 Namespace:default APIServerHAVIP:192.168.105.254 APIServerName:minikubeCA APIServerNames:[] APIS

erverIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.5 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.105.6 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.105.7 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.105.8 Port:0 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress

-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker Binary

Mirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0904 13:02:48.974523    3569 iso.go:125] acquiring lock: {Name:mkebc4172c19bd1bff0f54edbc3322d94476263f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0904 13:02:48.983484    3569 out.go:177] * Starting "ha-789000" primary control-plane node in "ha-789000" cluster

	I0904 13:02:48.986378    3569 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0904 13:02:48.986391    3569 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19575-1140/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4

	I0904 13:02:48.986399    3569 cache.go:56] Caching tarball of preloaded images

	I0904 13:02:48.986464    3569 preload.go:172] Found /Users/jenkins/minikube-integration/19575-1140/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0904 13:02:48.986470    3569 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker

	I0904 13:02:48.986536    3569 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/ha-789000/config.json ...

	I0904 13:02:48.987044    3569 start.go:360] acquireMachinesLock for ha-789000: {Name:mkffea5767ac0f54c70242857234a501d8b5b2f4 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0904 13:02:48.987078    3569 start.go:364] duration metric: took 27.584µs to acquireMachinesLock for "ha-789000"

	I0904 13:02:48.987087    3569 start.go:96] Skipping create...Using existing machine configuration

	I0904 13:02:48.987093    3569 fix.go:54] fixHost starting: 

	I0904 13:02:48.987206    3569 fix.go:112] recreateIfNeeded on ha-789000: state=Stopped err=<nil>

	W0904 13:02:48.987215    3569 fix.go:138] unexpected machine state, will restart: <nil>

	I0904 13:02:48.991499    3569 out.go:177] * Restarting existing qemu2 VM for "ha-789000" ...

	I0904 13:02:48.999447    3569 qemu.go:418] Using hvf for hardware acceleration

	I0904 13:02:48.999478    3569 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/ha-789000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/ha-789000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/ha-789000/qemu.pid -device virtio-net-pci,netdev=net0,mac=ca:27:c5:f4:fe:77 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/ha-789000/disk.qcow2

	I0904 13:02:49.001519    3569 main.go:141] libmachine: STDOUT: 

	I0904 13:02:49.001541    3569 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0904 13:02:49.001569    3569 fix.go:56] duration metric: took 14.475542ms for fixHost

	I0904 13:02:49.001574    3569 start.go:83] releasing machines lock for "ha-789000", held for 14.492417ms

	W0904 13:02:49.001580    3569 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0904 13:02:49.001609    3569 out.go:270] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0904 13:02:49.001613    3569 start.go:729] Will try again in 5 seconds ...

	I0904 13:02:54.003749    3569 start.go:360] acquireMachinesLock for ha-789000: {Name:mkffea5767ac0f54c70242857234a501d8b5b2f4 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0904 13:02:54.004265    3569 start.go:364] duration metric: took 338.208µs to acquireMachinesLock for "ha-789000"

	I0904 13:02:54.004404    3569 start.go:96] Skipping create...Using existing machine configuration

	I0904 13:02:54.004424    3569 fix.go:54] fixHost starting: 

	I0904 13:02:54.005171    3569 fix.go:112] recreateIfNeeded on ha-789000: state=Stopped err=<nil>

	W0904 13:02:54.005203    3569 fix.go:138] unexpected machine state, will restart: <nil>

	I0904 13:02:54.008815    3569 out.go:177] * Restarting existing qemu2 VM for "ha-789000" ...

	I0904 13:02:54.013600    3569 qemu.go:418] Using hvf for hardware acceleration

	I0904 13:02:54.013935    3569 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/ha-789000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/ha-789000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/ha-789000/qemu.pid -device virtio-net-pci,netdev=net0,mac=ca:27:c5:f4:fe:77 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/ha-789000/disk.qcow2

	I0904 13:02:54.023453    3569 main.go:141] libmachine: STDOUT: 

	I0904 13:02:54.023518    3569 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0904 13:02:54.023585    3569 fix.go:56] duration metric: took 19.161792ms for fixHost

	I0904 13:02:54.023603    3569 start.go:83] releasing machines lock for "ha-789000", held for 19.314042ms

	W0904 13:02:54.023814    3569 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p ha-789000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p ha-789000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0904 13:02:54.030632    3569 out.go:201] 

	W0904 13:02:54.033728    3569 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0904 13:02:54.033756    3569 out.go:270] * 

	* 

	W0904 13:02:54.036505    3569 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0904 13:02:54.041658    3569 out.go:201] 

** /stderr **

ha_test.go:469: failed to run minikube start. args "out/minikube-darwin-arm64 node list -p ha-789000 -v=7 --alsologtostderr" : exit status 80

ha_test.go:472: (dbg) Run:  out/minikube-darwin-arm64 node list -p ha-789000

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-789000 -n ha-789000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-789000 -n ha-789000: exit status 7 (32.100583ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "ha-789000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiControlPlane/serial/RestartClusterKeepsNodes (234.40s)

=== RUN   TestMultiControlPlane/serial/DeleteSecondaryNode

ha_test.go:487: (dbg) Run:  out/minikube-darwin-arm64 -p ha-789000 node delete m03 -v=7 --alsologtostderr

ha_test.go:487: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-789000 node delete m03 -v=7 --alsologtostderr: exit status 83 (41.367709ms)

-- stdout --

	* The control-plane node ha-789000-m03 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p ha-789000"

-- /stdout --

** stderr ** 

	I0904 13:02:54.187193    3581 out.go:345] Setting OutFile to fd 1 ...

	I0904 13:02:54.187417    3581 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:02:54.187420    3581 out.go:358] Setting ErrFile to fd 2...

	I0904 13:02:54.187422    3581 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:02:54.187577    3581 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19575-1140/.minikube/bin

	I0904 13:02:54.187789    3581 mustload.go:65] Loading cluster: ha-789000

	I0904 13:02:54.188002    3581 config.go:182] Loaded profile config "ha-789000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	W0904 13:02:54.188324    3581 out.go:270] ! The control-plane node ha-789000 host is not running (will try others): state=Stopped

	! The control-plane node ha-789000 host is not running (will try others): state=Stopped

	W0904 13:02:54.188443    3581 out.go:270] ! The control-plane node ha-789000-m02 host is not running (will try others): state=Stopped

	! The control-plane node ha-789000-m02 host is not running (will try others): state=Stopped

	I0904 13:02:54.192599    3581 out.go:177] * The control-plane node ha-789000-m03 host is not running: state=Stopped

	I0904 13:02:54.195490    3581 out.go:177]   To start a cluster, run: "minikube start -p ha-789000"

** /stderr **

ha_test.go:489: node delete returned an error. args "out/minikube-darwin-arm64 -p ha-789000 node delete m03 -v=7 --alsologtostderr": exit status 83

ha_test.go:493: (dbg) Run:  out/minikube-darwin-arm64 -p ha-789000 status -v=7 --alsologtostderr

ha_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-789000 status -v=7 --alsologtostderr: exit status 7 (30.115ms)

-- stdout --

	ha-789000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-789000-m02

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-789000-m03

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-789000-m04

	type: Worker

	host: Stopped

	kubelet: Stopped

-- /stdout --

** stderr ** 

	I0904 13:02:54.227531    3583 out.go:345] Setting OutFile to fd 1 ...

	I0904 13:02:54.227673    3583 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:02:54.227677    3583 out.go:358] Setting ErrFile to fd 2...

	I0904 13:02:54.227679    3583 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:02:54.227804    3583 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19575-1140/.minikube/bin

	I0904 13:02:54.227938    3583 out.go:352] Setting JSON to false

	I0904 13:02:54.227948    3583 mustload.go:65] Loading cluster: ha-789000

	I0904 13:02:54.228021    3583 notify.go:220] Checking for updates...

	I0904 13:02:54.228186    3583 config.go:182] Loaded profile config "ha-789000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0904 13:02:54.228194    3583 status.go:255] checking status of ha-789000 ...

	I0904 13:02:54.228397    3583 status.go:330] ha-789000 host status = "Stopped" (err=<nil>)

	I0904 13:02:54.228400    3583 status.go:343] host is not running, skipping remaining checks

	I0904 13:02:54.228403    3583 status.go:257] ha-789000 status: &{Name:ha-789000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0904 13:02:54.228413    3583 status.go:255] checking status of ha-789000-m02 ...

	I0904 13:02:54.228502    3583 status.go:330] ha-789000-m02 host status = "Stopped" (err=<nil>)

	I0904 13:02:54.228504    3583 status.go:343] host is not running, skipping remaining checks

	I0904 13:02:54.228506    3583 status.go:257] ha-789000-m02 status: &{Name:ha-789000-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0904 13:02:54.228510    3583 status.go:255] checking status of ha-789000-m03 ...

	I0904 13:02:54.228593    3583 status.go:330] ha-789000-m03 host status = "Stopped" (err=<nil>)

	I0904 13:02:54.228596    3583 status.go:343] host is not running, skipping remaining checks

	I0904 13:02:54.228598    3583 status.go:257] ha-789000-m03 status: &{Name:ha-789000-m03 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0904 13:02:54.228601    3583 status.go:255] checking status of ha-789000-m04 ...

	I0904 13:02:54.228695    3583 status.go:330] ha-789000-m04 host status = "Stopped" (err=<nil>)

	I0904 13:02:54.228698    3583 status.go:343] host is not running, skipping remaining checks

	I0904 13:02:54.228700    3583 status.go:257] ha-789000-m04 status: &{Name:ha-789000-m04 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:495: failed to run minikube status. args "out/minikube-darwin-arm64 -p ha-789000 status -v=7 --alsologtostderr" : exit status 7

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-789000 -n ha-789000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-789000 -n ha-789000: exit status 7 (30.810791ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "ha-789000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiControlPlane/serial/DeleteSecondaryNode (0.10s)

=== RUN   TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete

ha_test.go:390: (dbg) Run:  out/minikube-darwin-arm64 profile list --output json

ha_test.go:413: expected profile "ha-789000" in json of 'profile list' to have "Degraded" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-789000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-789000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube/iso/minikube-v1.34.0-arm64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"qemu2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\":1,\"APIServerPort\":8443,\"DockerOpt\":null,\"Disable

DriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.31.0\",\"ClusterName\":\"ha-789000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"192.168.105.254\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"192.168.105.5\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"

docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m02\",\"IP\":\"192.168.105.6\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m03\",\"IP\":\"192.168.105.7\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m04\",\"IP\":\"192.168.105.8\",\"Port\":0,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":false,\"Worker\":true}],\"Addons\":{\"ambassador\":false,\"auto-pause\":false,\"cloud-spanner\":false,\"csi-hostpath-driver\":false,\"dashboard\":false,\"default-storageclass\":false,\"efk\":false,\"freshpod\":false,\"gcp-auth\":false,\"gvisor\":false,\"headlamp\":false,\"helm-tiller\":false,\"inaccel\":false,\"ingress\":false,\"ingress-dns\":false,\"inspektor-gadget\":false,\"istio\":false,\"istio-provisioner\":false,\"kong\":false,\"kubeflow\":false,\"kubevirt\":false,\"logviewer\":false,\"metallb\":false,\"

metrics-server\":false,\"nvidia-device-plugin\":false,\"nvidia-driver-installer\":false,\"nvidia-gpu-device-plugin\":false,\"olm\":false,\"pod-security-policy\":false,\"portainer\":false,\"registry\":false,\"registry-aliases\":false,\"registry-creds\":false,\"storage-provisioner\":false,\"storage-provisioner-gluster\":false,\"storage-provisioner-rancher\":false,\"volcano\":false,\"volumesnapshots\":false,\"yakd\":false},\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"socket_vmnet\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"Mou

ntOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"/opt/socket_vmnet/bin/socket_vmnet_client\",\"SocketVMnetPath\":\"/var/run/socket_vmnet\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":false}]}"*. args: "out/minikube-darwin-arm64 profile list --output json"

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-789000 -n ha-789000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-789000 -n ha-789000: exit status 7 (30.25175ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "ha-789000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete (0.08s)

=== RUN   TestMultiControlPlane/serial/StopCluster

ha_test.go:531: (dbg) Run:  out/minikube-darwin-arm64 -p ha-789000 stop -v=7 --alsologtostderr

E0904 13:03:27.791240    1661 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/addons-970000/client.crt: no such file or directory" logger="UnhandledError"

E0904 13:03:55.875905    1661 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/functional-143000/client.crt: no such file or directory" logger="UnhandledError"

E0904 13:05:18.964985    1661 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/functional-143000/client.crt: no such file or directory" logger="UnhandledError"

ha_test.go:531: (dbg) Done: out/minikube-darwin-arm64 -p ha-789000 stop -v=7 --alsologtostderr: (3m21.978224875s)

ha_test.go:537: (dbg) Run:  out/minikube-darwin-arm64 -p ha-789000 status -v=7 --alsologtostderr

ha_test.go:537: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-789000 status -v=7 --alsologtostderr: exit status 7 (66.448917ms)

-- stdout --

	ha-789000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-789000-m02

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-789000-m03

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-789000-m04

	type: Worker

	host: Stopped

	kubelet: Stopped

-- /stdout --

** stderr ** 

	I0904 13:06:16.377563    3640 out.go:345] Setting OutFile to fd 1 ...

	I0904 13:06:16.377775    3640 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:06:16.377780    3640 out.go:358] Setting ErrFile to fd 2...

	I0904 13:06:16.377783    3640 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:06:16.377947    3640 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19575-1140/.minikube/bin

	I0904 13:06:16.378106    3640 out.go:352] Setting JSON to false

	I0904 13:06:16.378126    3640 mustload.go:65] Loading cluster: ha-789000

	I0904 13:06:16.378166    3640 notify.go:220] Checking for updates...

	I0904 13:06:16.378444    3640 config.go:182] Loaded profile config "ha-789000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0904 13:06:16.378454    3640 status.go:255] checking status of ha-789000 ...

	I0904 13:06:16.378745    3640 status.go:330] ha-789000 host status = "Stopped" (err=<nil>)

	I0904 13:06:16.378750    3640 status.go:343] host is not running, skipping remaining checks

	I0904 13:06:16.378753    3640 status.go:257] ha-789000 status: &{Name:ha-789000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0904 13:06:16.378767    3640 status.go:255] checking status of ha-789000-m02 ...

	I0904 13:06:16.378892    3640 status.go:330] ha-789000-m02 host status = "Stopped" (err=<nil>)

	I0904 13:06:16.378896    3640 status.go:343] host is not running, skipping remaining checks

	I0904 13:06:16.378899    3640 status.go:257] ha-789000-m02 status: &{Name:ha-789000-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0904 13:06:16.378904    3640 status.go:255] checking status of ha-789000-m03 ...

	I0904 13:06:16.379030    3640 status.go:330] ha-789000-m03 host status = "Stopped" (err=<nil>)

	I0904 13:06:16.379034    3640 status.go:343] host is not running, skipping remaining checks

	I0904 13:06:16.379036    3640 status.go:257] ha-789000-m03 status: &{Name:ha-789000-m03 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0904 13:06:16.379040    3640 status.go:255] checking status of ha-789000-m04 ...

	I0904 13:06:16.379153    3640 status.go:330] ha-789000-m04 host status = "Stopped" (err=<nil>)

	I0904 13:06:16.379157    3640 status.go:343] host is not running, skipping remaining checks

	I0904 13:06:16.379159    3640 status.go:257] ha-789000-m04 status: &{Name:ha-789000-m04 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:543: status says not two control-plane nodes are present: args "out/minikube-darwin-arm64 -p ha-789000 status -v=7 --alsologtostderr": ha-789000

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-789000-m02

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-789000-m03

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-789000-m04

type: Worker

host: Stopped

kubelet: Stopped

ha_test.go:549: status says not three kubelets are stopped: args "out/minikube-darwin-arm64 -p ha-789000 status -v=7 --alsologtostderr": ha-789000

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-789000-m02

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-789000-m03

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-789000-m04

type: Worker

host: Stopped

kubelet: Stopped

ha_test.go:552: status says not two apiservers are stopped: args "out/minikube-darwin-arm64 -p ha-789000 status -v=7 --alsologtostderr": ha-789000

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-789000-m02

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-789000-m03

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-789000-m04

type: Worker

host: Stopped

kubelet: Stopped

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-789000 -n ha-789000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-789000 -n ha-789000: exit status 7 (32.810375ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "ha-789000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiControlPlane/serial/StopCluster (202.08s)

=== RUN   TestMultiControlPlane/serial/RestartCluster

ha_test.go:560: (dbg) Run:  out/minikube-darwin-arm64 start -p ha-789000 --wait=true -v=7 --alsologtostderr --driver=qemu2 

ha_test.go:560: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p ha-789000 --wait=true -v=7 --alsologtostderr --driver=qemu2 : exit status 80 (5.182776791s)

-- stdout --

	* [ha-789000] minikube v1.34.0 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19575

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19575-1140/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19575-1140/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on existing profile

	* Starting "ha-789000" primary control-plane node in "ha-789000" cluster

	* Restarting existing qemu2 VM for "ha-789000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Restarting existing qemu2 VM for "ha-789000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0904 13:06:16.441400    3644 out.go:345] Setting OutFile to fd 1 ...

	I0904 13:06:16.441521    3644 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:06:16.441524    3644 out.go:358] Setting ErrFile to fd 2...

	I0904 13:06:16.441526    3644 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:06:16.441657    3644 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19575-1140/.minikube/bin

	I0904 13:06:16.442699    3644 out.go:352] Setting JSON to false

	I0904 13:06:16.459003    3644 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":3940,"bootTime":1725476436,"procs":465,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0904 13:06:16.459085    3644 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0904 13:06:16.463567    3644 out.go:177] * [ha-789000] minikube v1.34.0 on Darwin 14.5 (arm64)

	I0904 13:06:16.470503    3644 out.go:177]   - MINIKUBE_LOCATION=19575

	I0904 13:06:16.470562    3644 notify.go:220] Checking for updates...

	I0904 13:06:16.476550    3644 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19575-1140/kubeconfig

	I0904 13:06:16.479518    3644 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0904 13:06:16.482525    3644 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0904 13:06:16.485424    3644 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19575-1140/.minikube

	I0904 13:06:16.488540    3644 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0904 13:06:16.491856    3644 config.go:182] Loaded profile config "ha-789000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0904 13:06:16.492110    3644 driver.go:394] Setting default libvirt URI to qemu:///system

	I0904 13:06:16.495426    3644 out.go:177] * Using the qemu2 driver based on existing profile

	I0904 13:06:16.502497    3644 start.go:297] selected driver: qemu2

	I0904 13:06:16.502506    3644 start.go:901] validating driver "qemu2" against &{Name:ha-789000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.34.0-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:ha-789000 Namespace:default

APIServerHAVIP:192.168.105.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.5 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.105.6 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.105.7 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.105.8 Port:0 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gv

isor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: Mo

untMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0904 13:06:16.502591    3644 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0904 13:06:16.504960    3644 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0904 13:06:16.505006    3644 cni.go:84] Creating CNI manager for ""

	I0904 13:06:16.505011    3644 cni.go:136] multinode detected (4 nodes found), recommending kindnet

	I0904 13:06:16.505066    3644 start.go:340] cluster config:

	{Name:ha-789000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.34.0-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:ha-789000 Namespace:default APIServerHAVIP:192.168.105.254 APIServerName:minikubeCA APIServerNames:[] APIS

erverIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.5 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.105.6 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.105.7 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.105.8 Port:0 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress

-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker Binary

Mirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0904 13:06:16.508548    3644 iso.go:125] acquiring lock: {Name:mkebc4172c19bd1bff0f54edbc3322d94476263f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0904 13:06:16.517465    3644 out.go:177] * Starting "ha-789000" primary control-plane node in "ha-789000" cluster

	I0904 13:06:16.521502    3644 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0904 13:06:16.521518    3644 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19575-1140/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4

	I0904 13:06:16.521528    3644 cache.go:56] Caching tarball of preloaded images

	I0904 13:06:16.521590    3644 preload.go:172] Found /Users/jenkins/minikube-integration/19575-1140/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0904 13:06:16.521596    3644 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker

	I0904 13:06:16.521677    3644 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/ha-789000/config.json ...

	I0904 13:06:16.522130    3644 start.go:360] acquireMachinesLock for ha-789000: {Name:mkffea5767ac0f54c70242857234a501d8b5b2f4 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0904 13:06:16.522165    3644 start.go:364] duration metric: took 28.625µs to acquireMachinesLock for "ha-789000"

	I0904 13:06:16.522174    3644 start.go:96] Skipping create...Using existing machine configuration

	I0904 13:06:16.522178    3644 fix.go:54] fixHost starting: 

	I0904 13:06:16.522293    3644 fix.go:112] recreateIfNeeded on ha-789000: state=Stopped err=<nil>

	W0904 13:06:16.522302    3644 fix.go:138] unexpected machine state, will restart: <nil>

	I0904 13:06:16.526553    3644 out.go:177] * Restarting existing qemu2 VM for "ha-789000" ...

	I0904 13:06:16.534505    3644 qemu.go:418] Using hvf for hardware acceleration

	I0904 13:06:16.534537    3644 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/ha-789000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/ha-789000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/ha-789000/qemu.pid -device virtio-net-pci,netdev=net0,mac=ca:27:c5:f4:fe:77 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/ha-789000/disk.qcow2

	I0904 13:06:16.536554    3644 main.go:141] libmachine: STDOUT: 

	I0904 13:06:16.536577    3644 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0904 13:06:16.536606    3644 fix.go:56] duration metric: took 14.429041ms for fixHost

	I0904 13:06:16.536610    3644 start.go:83] releasing machines lock for "ha-789000", held for 14.441042ms

	W0904 13:06:16.536616    3644 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0904 13:06:16.536641    3644 out.go:270] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0904 13:06:16.536645    3644 start.go:729] Will try again in 5 seconds ...

	I0904 13:06:21.538779    3644 start.go:360] acquireMachinesLock for ha-789000: {Name:mkffea5767ac0f54c70242857234a501d8b5b2f4 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0904 13:06:21.539225    3644 start.go:364] duration metric: took 319.709µs to acquireMachinesLock for "ha-789000"

	I0904 13:06:21.539348    3644 start.go:96] Skipping create...Using existing machine configuration

	I0904 13:06:21.539366    3644 fix.go:54] fixHost starting: 

	I0904 13:06:21.540079    3644 fix.go:112] recreateIfNeeded on ha-789000: state=Stopped err=<nil>

	W0904 13:06:21.540106    3644 fix.go:138] unexpected machine state, will restart: <nil>

	I0904 13:06:21.543668    3644 out.go:177] * Restarting existing qemu2 VM for "ha-789000" ...

	I0904 13:06:21.551495    3644 qemu.go:418] Using hvf for hardware acceleration

	I0904 13:06:21.551748    3644 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/ha-789000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/ha-789000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/ha-789000/qemu.pid -device virtio-net-pci,netdev=net0,mac=ca:27:c5:f4:fe:77 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/ha-789000/disk.qcow2

	I0904 13:06:21.561002    3644 main.go:141] libmachine: STDOUT: 

	I0904 13:06:21.561064    3644 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0904 13:06:21.561130    3644 fix.go:56] duration metric: took 21.762375ms for fixHost

	I0904 13:06:21.561147    3644 start.go:83] releasing machines lock for "ha-789000", held for 21.901708ms

	W0904 13:06:21.561347    3644 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p ha-789000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p ha-789000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0904 13:06:21.568448    3644 out.go:201] 

	W0904 13:06:21.572518    3644 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0904 13:06:21.572547    3644 out.go:270] * 

	* 

	W0904 13:06:21.574938    3644 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0904 13:06:21.583430    3644 out.go:201] 

** /stderr **

ha_test.go:562: failed to start cluster. args "out/minikube-darwin-arm64 start -p ha-789000 --wait=true -v=7 --alsologtostderr --driver=qemu2 " : exit status 80

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-789000 -n ha-789000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-789000 -n ha-789000: exit status 7 (71.654417ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "ha-789000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiControlPlane/serial/RestartCluster (5.26s)

=== RUN   TestMultiControlPlane/serial/DegradedAfterClusterRestart

ha_test.go:390: (dbg) Run:  out/minikube-darwin-arm64 profile list --output json

ha_test.go:413: expected profile "ha-789000" in json of 'profile list' to have "Degraded" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-789000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-789000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube/iso/minikube-v1.34.0-arm64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"qemu2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\":1,\"APIServerPort\":8443,\"DockerOpt\":null,\"Disable

DriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.31.0\",\"ClusterName\":\"ha-789000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"192.168.105.254\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"192.168.105.5\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"

docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m02\",\"IP\":\"192.168.105.6\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m03\",\"IP\":\"192.168.105.7\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m04\",\"IP\":\"192.168.105.8\",\"Port\":0,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":false,\"Worker\":true}],\"Addons\":{\"ambassador\":false,\"auto-pause\":false,\"cloud-spanner\":false,\"csi-hostpath-driver\":false,\"dashboard\":false,\"default-storageclass\":false,\"efk\":false,\"freshpod\":false,\"gcp-auth\":false,\"gvisor\":false,\"headlamp\":false,\"helm-tiller\":false,\"inaccel\":false,\"ingress\":false,\"ingress-dns\":false,\"inspektor-gadget\":false,\"istio\":false,\"istio-provisioner\":false,\"kong\":false,\"kubeflow\":false,\"kubevirt\":false,\"logviewer\":false,\"metallb\":false,\"

metrics-server\":false,\"nvidia-device-plugin\":false,\"nvidia-driver-installer\":false,\"nvidia-gpu-device-plugin\":false,\"olm\":false,\"pod-security-policy\":false,\"portainer\":false,\"registry\":false,\"registry-aliases\":false,\"registry-creds\":false,\"storage-provisioner\":false,\"storage-provisioner-gluster\":false,\"storage-provisioner-rancher\":false,\"volcano\":false,\"volumesnapshots\":false,\"yakd\":false},\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"socket_vmnet\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"Mou

ntOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"/opt/socket_vmnet/bin/socket_vmnet_client\",\"SocketVMnetPath\":\"/var/run/socket_vmnet\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":false}]}"*. args: "out/minikube-darwin-arm64 profile list --output json"

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-789000 -n ha-789000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-789000 -n ha-789000: exit status 7 (29.612125ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "ha-789000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiControlPlane/serial/DegradedAfterClusterRestart (0.08s)

=== RUN   TestMultiControlPlane/serial/AddSecondaryNode

ha_test.go:605: (dbg) Run:  out/minikube-darwin-arm64 node add -p ha-789000 --control-plane -v=7 --alsologtostderr

ha_test.go:605: (dbg) Non-zero exit: out/minikube-darwin-arm64 node add -p ha-789000 --control-plane -v=7 --alsologtostderr: exit status 83 (43.062709ms)

-- stdout --

	* The control-plane node ha-789000-m03 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p ha-789000"

-- /stdout --

** stderr ** 

	I0904 13:06:21.780489    3659 out.go:345] Setting OutFile to fd 1 ...

	I0904 13:06:21.780876    3659 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:06:21.780880    3659 out.go:358] Setting ErrFile to fd 2...

	I0904 13:06:21.780883    3659 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:06:21.781050    3659 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19575-1140/.minikube/bin

	I0904 13:06:21.781280    3659 mustload.go:65] Loading cluster: ha-789000

	I0904 13:06:21.781490    3659 config.go:182] Loaded profile config "ha-789000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	W0904 13:06:21.781807    3659 out.go:270] ! The control-plane node ha-789000 host is not running (will try others): state=Stopped

	! The control-plane node ha-789000 host is not running (will try others): state=Stopped

	W0904 13:06:21.781907    3659 out.go:270] ! The control-plane node ha-789000-m02 host is not running (will try others): state=Stopped

	! The control-plane node ha-789000-m02 host is not running (will try others): state=Stopped

	I0904 13:06:21.786243    3659 out.go:177] * The control-plane node ha-789000-m03 host is not running: state=Stopped

	I0904 13:06:21.790195    3659 out.go:177]   To start a cluster, run: "minikube start -p ha-789000"

** /stderr **

ha_test.go:607: failed to add control-plane node to current ha (multi-control plane) cluster. args "out/minikube-darwin-arm64 node add -p ha-789000 --control-plane -v=7 --alsologtostderr" : exit status 83

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-789000 -n ha-789000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-789000 -n ha-789000: exit status 7 (31.175917ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "ha-789000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiControlPlane/serial/AddSecondaryNode (0.07s)

=== RUN   TestImageBuild/serial/Setup

image_test.go:69: (dbg) Run:  out/minikube-darwin-arm64 start -p image-591000 --driver=qemu2 

image_test.go:69: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p image-591000 --driver=qemu2 : exit status 80 (9.941881792s)

-- stdout --

	* [image-591000] minikube v1.34.0 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19575

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19575-1140/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19575-1140/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "image-591000" primary control-plane node in "image-591000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "image-591000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p image-591000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

image_test.go:70: failed to start minikube with args: "out/minikube-darwin-arm64 start -p image-591000 --driver=qemu2 " : exit status 80

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p image-591000 -n image-591000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p image-591000 -n image-591000: exit status 7 (67.37275ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "image-591000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestImageBuild/serial/Setup (10.01s)

=== RUN   TestJSONOutput/start/Command

json_output_test.go:63: (dbg) Run:  out/minikube-darwin-arm64 start -p json-output-470000 --output=json --user=testUser --memory=2200 --wait=true --driver=qemu2 

json_output_test.go:63: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p json-output-470000 --output=json --user=testUser --memory=2200 --wait=true --driver=qemu2 : exit status 80 (9.869608125s)

-- stdout --

	{"specversion":"1.0","id":"5d1fd64d-151c-4eb8-8539-7114508c514d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-470000] minikube v1.34.0 on Darwin 14.5 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}

	{"specversion":"1.0","id":"26a703ee-a1a3-435d-9d6f-4f14a6fb634f","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=19575"}}

	{"specversion":"1.0","id":"f5de8dad-8109-4c4d-9533-e3655a3fbad6","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/Users/jenkins/minikube-integration/19575-1140/kubeconfig"}}

	{"specversion":"1.0","id":"b48bd542-1d5f-4f5c-801b-b8668d29d4b8","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-darwin-arm64"}}

	{"specversion":"1.0","id":"d104d64b-c69a-4cb7-917e-cde89ba7d28c","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}

	{"specversion":"1.0","id":"1ebc9c13-c5df-4a5d-ae15-71af37a78232","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/Users/jenkins/minikube-integration/19575-1140/.minikube"}}

	{"specversion":"1.0","id":"1a5c4bc2-ee73-480b-9e3d-667cc76b2550","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}

	{"specversion":"1.0","id":"175a4b75-a3b1-4c77-8e71-53e30a26bfd6","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the qemu2 driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}

	{"specversion":"1.0","id":"5e4dc755-3302-4729-b569-1179a23bcf4c","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Automatically selected the socket_vmnet network"}}

	{"specversion":"1.0","id":"2c06078b-0bf6-4c48-b924-543683627c5f","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting \"json-output-470000\" primary control-plane node in \"json-output-470000\" cluster","name":"Starting Node","totalsteps":"19"}}

	{"specversion":"1.0","id":"409c7b0e-f7b8-4697-ba5d-f128f56e0ced","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"9","message":"Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...","name":"Creating VM","totalsteps":"19"}}

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	{"specversion":"1.0","id":"21247845-deb1-4614-a7db-61a6c7a9ceaf","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"9","message":"Deleting \"json-output-470000\" in qemu2 ...","name":"Creating VM","totalsteps":"19"}}

	{"specversion":"1.0","id":"6ce68387-6bdd-4db7-9355-efc4269f514c","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"StartHost failed, but will try again: creating host: create: creating: Failed to connect to \"/var/run/socket_vmnet\": Connection refused: exit status 1"}}

	{"specversion":"1.0","id":"0e9c6aef-1333-42c2-b503-543cfe572c6f","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"9","message":"Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...","name":"Creating VM","totalsteps":"19"}}

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	{"specversion":"1.0","id":"6b7f646c-4319-4742-9b41-1413393c92db","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"Failed to start qemu2 VM. Running \"minikube delete -p json-output-470000\" may fix it: creating host: create: creating: Failed to connect to \"/var/run/socket_vmnet\": Connection refused: exit status 1"}}

	{"specversion":"1.0","id":"82ff6c4a-dbd2-4320-800e-91023c73c6f6","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"80","issues":"","message":"error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to \"/var/run/socket_vmnet\": Connection refused: exit status 1","name":"GUEST_PROVISION","url":""}}

	{"specversion":"1.0","id":"da791493-7432-4b2e-bf40-84a623b59561","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"╭───────────────────────────────────────────────────────────────────────────────────────────╮\n│                                                                                           │\n│    If the above advice does not help, please let us know:                                 │\n│    https://github.com/kubernetes/minikube/issues/new/choose                               │\n│                                                                                           │\n│    Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │\n│

│\n╰───────────────────────────────────────────────────────────────────────────────────────────╯"}}

-- /stdout --

json_output_test.go:65: failed to clean up: args "out/minikube-darwin-arm64 start -p json-output-470000 --output=json --user=testUser --memory=2200 --wait=true --driver=qemu2 ": exit status 80

json_output_test.go:213: unable to marshal output: OUTPUT: 

json_output_test.go:70: converting to cloud events: invalid character 'O' looking for beginning of value

--- FAIL: TestJSONOutput/start/Command (9.87s)

=== RUN   TestJSONOutput/pause/Command

json_output_test.go:63: (dbg) Run:  out/minikube-darwin-arm64 pause -p json-output-470000 --output=json --user=testUser

json_output_test.go:63: (dbg) Non-zero exit: out/minikube-darwin-arm64 pause -p json-output-470000 --output=json --user=testUser: exit status 83 (76.255083ms)

-- stdout --

	{"specversion":"1.0","id":"515af991-43a0-4a69-8bc7-753a7e57d0c7","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"The control-plane node json-output-470000 host is not running: state=Stopped"}}

	{"specversion":"1.0","id":"ef0f208a-874f-4545-bb8a-b432b4ecc16f","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"To start a cluster, run: \"minikube start -p json-output-470000\""}}

-- /stdout --

json_output_test.go:65: failed to clean up: args "out/minikube-darwin-arm64 pause -p json-output-470000 --output=json --user=testUser": exit status 83

--- FAIL: TestJSONOutput/pause/Command (0.08s)

=== RUN   TestJSONOutput/unpause/Command

json_output_test.go:63: (dbg) Run:  out/minikube-darwin-arm64 unpause -p json-output-470000 --output=json --user=testUser

json_output_test.go:63: (dbg) Non-zero exit: out/minikube-darwin-arm64 unpause -p json-output-470000 --output=json --user=testUser: exit status 83 (45.241917ms)

-- stdout --

	* The control-plane node json-output-470000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p json-output-470000"

-- /stdout --

json_output_test.go:65: failed to clean up: args "out/minikube-darwin-arm64 unpause -p json-output-470000 --output=json --user=testUser": exit status 83

json_output_test.go:213: unable to marshal output: * The control-plane node json-output-470000 host is not running: state=Stopped

json_output_test.go:70: converting to cloud events: invalid character '*' looking for beginning of value

--- FAIL: TestJSONOutput/unpause/Command (0.05s)

=== RUN   TestMinikubeProfile

minikube_profile_test.go:44: (dbg) Run:  out/minikube-darwin-arm64 start -p first-706000 --driver=qemu2 

minikube_profile_test.go:44: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p first-706000 --driver=qemu2 : exit status 80 (9.968997125s)

-- stdout --

	* [first-706000] minikube v1.34.0 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19575

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19575-1140/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19575-1140/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "first-706000" primary control-plane node in "first-706000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "first-706000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p first-706000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

minikube_profile_test.go:46: test pre-condition failed. args "out/minikube-darwin-arm64 start -p first-706000 --driver=qemu2 ": exit status 80

panic.go:626: *** TestMinikubeProfile FAILED at 2024-09-04 13:06:54.818102 -0700 PDT m=+2531.872331501

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p second-707000 -n second-707000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p second-707000 -n second-707000: exit status 85 (85.566416ms)

-- stdout --

	* Profile "second-707000" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p second-707000"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "second-707000" host is not running, skipping log retrieval (state="* Profile \"second-707000\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p second-707000\"")

helpers_test.go:175: Cleaning up "second-707000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p second-707000

panic.go:626: *** TestMinikubeProfile FAILED at 2024-09-04 13:06:55.006725 -0700 PDT m=+2532.060956959

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p first-706000 -n first-706000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p first-706000 -n first-706000: exit status 7 (30.489708ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "first-706000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "first-706000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p first-706000

--- FAIL: TestMinikubeProfile (10.27s)

=== RUN   TestMountStart/serial/StartWithMountFirst

mount_start_test.go:98: (dbg) Run:  out/minikube-darwin-arm64 start -p mount-start-1-647000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=qemu2 

mount_start_test.go:98: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p mount-start-1-647000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=qemu2 : exit status 80 (9.82979725s)

-- stdout --

	* [mount-start-1-647000] minikube v1.34.0 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19575

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19575-1140/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19575-1140/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting minikube without Kubernetes in cluster mount-start-1-647000

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "mount-start-1-647000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p mount-start-1-647000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

mount_start_test.go:100: failed to start minikube with args: "out/minikube-darwin-arm64 start -p mount-start-1-647000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=qemu2 " : exit status 80

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p mount-start-1-647000 -n mount-start-1-647000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p mount-start-1-647000 -n mount-start-1-647000: exit status 7 (68.596917ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "mount-start-1-647000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMountStart/serial/StartWithMountFirst (9.90s)

=== RUN   TestMultiNode/serial/FreshStart2Nodes

multinode_test.go:96: (dbg) Run:  out/minikube-darwin-arm64 start -p multinode-452000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=qemu2 

multinode_test.go:96: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p multinode-452000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=qemu2 : exit status 80 (9.800560167s)

-- stdout --

	* [multinode-452000] minikube v1.34.0 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19575

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19575-1140/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19575-1140/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "multinode-452000" primary control-plane node in "multinode-452000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "multinode-452000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0904 13:07:05.225649    3810 out.go:345] Setting OutFile to fd 1 ...

	I0904 13:07:05.225766    3810 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:07:05.225768    3810 out.go:358] Setting ErrFile to fd 2...

	I0904 13:07:05.225771    3810 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:07:05.225916    3810 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19575-1140/.minikube/bin

	I0904 13:07:05.227000    3810 out.go:352] Setting JSON to false

	I0904 13:07:05.243031    3810 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":3989,"bootTime":1725476436,"procs":467,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0904 13:07:05.243098    3810 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0904 13:07:05.250625    3810 out.go:177] * [multinode-452000] minikube v1.34.0 on Darwin 14.5 (arm64)

	I0904 13:07:05.258625    3810 out.go:177]   - MINIKUBE_LOCATION=19575

	I0904 13:07:05.258670    3810 notify.go:220] Checking for updates...

	I0904 13:07:05.265575    3810 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19575-1140/kubeconfig

	I0904 13:07:05.268641    3810 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0904 13:07:05.271660    3810 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0904 13:07:05.274657    3810 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19575-1140/.minikube

	I0904 13:07:05.282715    3810 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0904 13:07:05.285791    3810 driver.go:394] Setting default libvirt URI to qemu:///system

	I0904 13:07:05.289579    3810 out.go:177] * Using the qemu2 driver based on user configuration

	I0904 13:07:05.296599    3810 start.go:297] selected driver: qemu2

	I0904 13:07:05.296605    3810 start.go:901] validating driver "qemu2" against <nil>

	I0904 13:07:05.296616    3810 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0904 13:07:05.298877    3810 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0904 13:07:05.302527    3810 out.go:177] * Automatically selected the socket_vmnet network

	I0904 13:07:05.305684    3810 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0904 13:07:05.305715    3810 cni.go:84] Creating CNI manager for ""

	I0904 13:07:05.305721    3810 cni.go:136] multinode detected (0 nodes found), recommending kindnet

	I0904 13:07:05.305725    3810 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni

	I0904 13:07:05.305758    3810 start.go:340] cluster config:

	{Name:multinode-452000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:multinode-452000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket:

NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPa

th:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0904 13:07:05.309655    3810 iso.go:125] acquiring lock: {Name:mkebc4172c19bd1bff0f54edbc3322d94476263f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0904 13:07:05.318548    3810 out.go:177] * Starting "multinode-452000" primary control-plane node in "multinode-452000" cluster

	I0904 13:07:05.322605    3810 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker

	I0904 13:07:05.322620    3810 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19575-1140/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4

	I0904 13:07:05.322628    3810 cache.go:56] Caching tarball of preloaded images

	I0904 13:07:05.322684    3810 preload.go:172] Found /Users/jenkins/minikube-integration/19575-1140/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0904 13:07:05.322690    3810 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker

	I0904 13:07:05.322906    3810 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/multinode-452000/config.json ...

	I0904 13:07:05.322919    3810 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/multinode-452000/config.json: {Name:mkf697efc4e95cd16dece08c315f84a934caa31d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0904 13:07:05.323540    3810 start.go:360] acquireMachinesLock for multinode-452000: {Name:mkffea5767ac0f54c70242857234a501d8b5b2f4 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0904 13:07:05.323578    3810 start.go:364] duration metric: took 31.791µs to acquireMachinesLock for "multinode-452000"

	I0904 13:07:05.323591    3810 start.go:93] Provisioning new machine with config: &{Name:multinode-452000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.34.0-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:multinode-452000

Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirro

r: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0904 13:07:05.323620    3810 start.go:125] createHost starting for "" (driver="qemu2")

	I0904 13:07:05.332553    3810 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0904 13:07:05.351413    3810 start.go:159] libmachine.API.Create for "multinode-452000" (driver="qemu2")

	I0904 13:07:05.351439    3810 client.go:168] LocalClient.Create starting

	I0904 13:07:05.351494    3810 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19575-1140/.minikube/certs/ca.pem

	I0904 13:07:05.351529    3810 main.go:141] libmachine: Decoding PEM data...

	I0904 13:07:05.351538    3810 main.go:141] libmachine: Parsing certificate...

	I0904 13:07:05.351575    3810 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19575-1140/.minikube/certs/cert.pem

	I0904 13:07:05.351598    3810 main.go:141] libmachine: Decoding PEM data...

	I0904 13:07:05.351607    3810 main.go:141] libmachine: Parsing certificate...

	I0904 13:07:05.352042    3810 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19575-1140/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19575-1140/.minikube/cache/iso/arm64/minikube-v1.34.0-arm64.iso...

	I0904 13:07:05.499777    3810 main.go:141] libmachine: Creating SSH key...

	I0904 13:07:05.598480    3810 main.go:141] libmachine: Creating Disk image...

	I0904 13:07:05.598485    3810 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0904 13:07:05.598685    3810 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/multinode-452000/disk.qcow2.raw /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/multinode-452000/disk.qcow2

	I0904 13:07:05.608001    3810 main.go:141] libmachine: STDOUT: 

	I0904 13:07:05.608024    3810 main.go:141] libmachine: STDERR: 

	I0904 13:07:05.608068    3810 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/multinode-452000/disk.qcow2 +20000M

	I0904 13:07:05.615979    3810 main.go:141] libmachine: STDOUT: Image resized.

	I0904 13:07:05.615994    3810 main.go:141] libmachine: STDERR: 

	I0904 13:07:05.616015    3810 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/multinode-452000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/multinode-452000/disk.qcow2

	I0904 13:07:05.616020    3810 main.go:141] libmachine: Starting QEMU VM...

	I0904 13:07:05.616039    3810 qemu.go:418] Using hvf for hardware acceleration

	I0904 13:07:05.616063    3810 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/multinode-452000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/multinode-452000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/multinode-452000/qemu.pid -device virtio-net-pci,netdev=net0,mac=5a:e1:f7:99:bd:f6 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/multinode-452000/disk.qcow2

	I0904 13:07:05.617644    3810 main.go:141] libmachine: STDOUT: 

	I0904 13:07:05.617659    3810 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0904 13:07:05.617676    3810 client.go:171] duration metric: took 266.236708ms to LocalClient.Create

	I0904 13:07:07.619810    3810 start.go:128] duration metric: took 2.296207875s to createHost

	I0904 13:07:07.619865    3810 start.go:83] releasing machines lock for "multinode-452000", held for 2.296317459s

	W0904 13:07:07.619904    3810 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0904 13:07:07.635416    3810 out.go:177] * Deleting "multinode-452000" in qemu2 ...

	W0904 13:07:07.664193    3810 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0904 13:07:07.664227    3810 start.go:729] Will try again in 5 seconds ...

	I0904 13:07:12.664941    3810 start.go:360] acquireMachinesLock for multinode-452000: {Name:mkffea5767ac0f54c70242857234a501d8b5b2f4 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0904 13:07:12.665422    3810 start.go:364] duration metric: took 376.75µs to acquireMachinesLock for "multinode-452000"

	I0904 13:07:12.665565    3810 start.go:93] Provisioning new machine with config: &{Name:multinode-452000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.34.0-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:multinode-452000

Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirro

r: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0904 13:07:12.665907    3810 start.go:125] createHost starting for "" (driver="qemu2")

	I0904 13:07:12.677406    3810 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0904 13:07:12.729331    3810 start.go:159] libmachine.API.Create for "multinode-452000" (driver="qemu2")

	I0904 13:07:12.729382    3810 client.go:168] LocalClient.Create starting

	I0904 13:07:12.729488    3810 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19575-1140/.minikube/certs/ca.pem

	I0904 13:07:12.729542    3810 main.go:141] libmachine: Decoding PEM data...

	I0904 13:07:12.729556    3810 main.go:141] libmachine: Parsing certificate...

	I0904 13:07:12.729629    3810 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19575-1140/.minikube/certs/cert.pem

	I0904 13:07:12.729672    3810 main.go:141] libmachine: Decoding PEM data...

	I0904 13:07:12.729692    3810 main.go:141] libmachine: Parsing certificate...

	I0904 13:07:12.730222    3810 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19575-1140/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19575-1140/.minikube/cache/iso/arm64/minikube-v1.34.0-arm64.iso...

	I0904 13:07:12.891147    3810 main.go:141] libmachine: Creating SSH key...

	I0904 13:07:12.926573    3810 main.go:141] libmachine: Creating Disk image...

	I0904 13:07:12.926581    3810 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0904 13:07:12.926792    3810 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/multinode-452000/disk.qcow2.raw /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/multinode-452000/disk.qcow2

	I0904 13:07:12.935913    3810 main.go:141] libmachine: STDOUT: 

	I0904 13:07:12.935932    3810 main.go:141] libmachine: STDERR: 

	I0904 13:07:12.935974    3810 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/multinode-452000/disk.qcow2 +20000M

	I0904 13:07:12.943937    3810 main.go:141] libmachine: STDOUT: Image resized.

	I0904 13:07:12.943951    3810 main.go:141] libmachine: STDERR: 

	I0904 13:07:12.943961    3810 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/multinode-452000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/multinode-452000/disk.qcow2

	I0904 13:07:12.943966    3810 main.go:141] libmachine: Starting QEMU VM...

	I0904 13:07:12.943975    3810 qemu.go:418] Using hvf for hardware acceleration

	I0904 13:07:12.944018    3810 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/multinode-452000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19575-1140/.minikube/machines/multinode-452000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/multinode-452000/qemu.pid -device virtio-net-pci,netdev=net0,mac=5a:a5:f4:80:86:9a -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19575-1140/.minikube/machines/multinode-452000/disk.qcow2

	I0904 13:07:12.945604    3810 main.go:141] libmachine: STDOUT: 

	I0904 13:07:12.945620    3810 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0904 13:07:12.945630    3810 client.go:171] duration metric: took 216.248042ms to LocalClient.Create

	I0904 13:07:14.947769    3810 start.go:128] duration metric: took 2.281872667s to createHost

	I0904 13:07:14.947871    3810 start.go:83] releasing machines lock for "multinode-452000", held for 2.282434s

	W0904 13:07:14.948161    3810 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p multinode-452000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p multinode-452000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0904 13:07:14.962821    3810 out.go:201] 

	W0904 13:07:14.966018    3810 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0904 13:07:14.966042    3810 out.go:270] * 

	* 

	W0904 13:07:14.968734    3810 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0904 13:07:14.983648    3810 out.go:201] 

** /stderr **

multinode_test.go:98: failed to start cluster. args "out/minikube-darwin-arm64 start -p multinode-452000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=qemu2 " : exit status 80

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-452000 -n multinode-452000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-452000 -n multinode-452000: exit status 7 (66.894833ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-452000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/FreshStart2Nodes (9.87s)

=== RUN   TestMultiNode/serial/DeployApp2Nodes

multinode_test.go:493: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-452000 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml

multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-452000 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml: exit status 1 (130.384125ms)

** stderr ** 

	error: cluster "multinode-452000" does not exist

** /stderr **

multinode_test.go:495: failed to create busybox deployment to multinode cluster

multinode_test.go:498: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-452000 -- rollout status deployment/busybox

multinode_test.go:498: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-452000 -- rollout status deployment/busybox: exit status 1 (58.136417ms)

** stderr ** 

	error: no server found for cluster "multinode-452000"

** /stderr **

multinode_test.go:500: failed to deploy busybox to multinode cluster

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-452000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-452000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (56.820541ms)

** stderr ** 

	error: no server found for cluster "multinode-452000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-452000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-452000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (103.894375ms)

** stderr ** 

	error: no server found for cluster "multinode-452000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-452000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-452000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (105.78675ms)

** stderr ** 

	error: no server found for cluster "multinode-452000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-452000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-452000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (104.482916ms)

** stderr ** 

	error: no server found for cluster "multinode-452000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-452000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-452000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (102.745417ms)

** stderr ** 

	error: no server found for cluster "multinode-452000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-452000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-452000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (102.53175ms)

** stderr ** 

	error: no server found for cluster "multinode-452000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-452000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-452000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (100.687292ms)

** stderr ** 

	error: no server found for cluster "multinode-452000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-452000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-452000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (102.465333ms)

** stderr ** 

	error: no server found for cluster "multinode-452000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-452000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-452000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (103.48225ms)

** stderr ** 

	error: no server found for cluster "multinode-452000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

E0904 13:08:27.784594    1661 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/addons-970000/client.crt: no such file or directory" logger="UnhandledError"

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-452000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-452000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (104.703209ms)

** stderr ** 

	error: no server found for cluster "multinode-452000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:524: failed to resolve pod IPs: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:528: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-452000 -- get pods -o jsonpath='{.items[*].metadata.name}'

multinode_test.go:528: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-452000 -- get pods -o jsonpath='{.items[*].metadata.name}': exit status 1 (57.259958ms)

** stderr ** 

	error: no server found for cluster "multinode-452000"

** /stderr **

multinode_test.go:530: failed get Pod names

multinode_test.go:536: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-452000 -- exec  -- nslookup kubernetes.io

multinode_test.go:536: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-452000 -- exec  -- nslookup kubernetes.io: exit status 1 (57.227042ms)

** stderr ** 

	error: no server found for cluster "multinode-452000"

** /stderr **

multinode_test.go:538: Pod  could not resolve 'kubernetes.io': exit status 1

multinode_test.go:546: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-452000 -- exec  -- nslookup kubernetes.default

multinode_test.go:546: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-452000 -- exec  -- nslookup kubernetes.default: exit status 1 (56.159625ms)

** stderr ** 

	error: no server found for cluster "multinode-452000"

** /stderr **

multinode_test.go:548: Pod  could not resolve 'kubernetes.default': exit status 1

multinode_test.go:554: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-452000 -- exec  -- nslookup kubernetes.default.svc.cluster.local

multinode_test.go:554: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-452000 -- exec  -- nslookup kubernetes.default.svc.cluster.local: exit status 1 (57.325541ms)

** stderr ** 

	error: no server found for cluster "multinode-452000"

** /stderr **

multinode_test.go:556: Pod  could not resolve local service (kubernetes.default.svc.cluster.local): exit status 1

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-452000 -n multinode-452000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-452000 -n multinode-452000: exit status 7 (30.171709ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-452000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/DeployApp2Nodes (77.48s)

=== RUN   TestMultiNode/serial/PingHostFrom2Pods

multinode_test.go:564: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-452000 -- get pods -o jsonpath='{.items[*].metadata.name}'

multinode_test.go:564: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-452000 -- get pods -o jsonpath='{.items[*].metadata.name}': exit status 1 (56.037166ms)

** stderr ** 

	error: no server found for cluster "multinode-452000"

** /stderr **

multinode_test.go:566: failed to get Pod names: exit status 1

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-452000 -n multinode-452000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-452000 -n multinode-452000: exit status 7 (30.526208ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-452000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/PingHostFrom2Pods (0.09s)

=== RUN   TestMultiNode/serial/AddNode

multinode_test.go:121: (dbg) Run:  out/minikube-darwin-arm64 node add -p multinode-452000 -v 3 --alsologtostderr

multinode_test.go:121: (dbg) Non-zero exit: out/minikube-darwin-arm64 node add -p multinode-452000 -v 3 --alsologtostderr: exit status 83 (42.648792ms)

-- stdout --

	* The control-plane node multinode-452000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p multinode-452000"

-- /stdout --

** stderr ** 

	I0904 13:08:32.661296    3900 out.go:345] Setting OutFile to fd 1 ...

	I0904 13:08:32.661457    3900 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:08:32.661460    3900 out.go:358] Setting ErrFile to fd 2...

	I0904 13:08:32.661462    3900 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:08:32.661586    3900 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19575-1140/.minikube/bin

	I0904 13:08:32.661798    3900 mustload.go:65] Loading cluster: multinode-452000

	I0904 13:08:32.661978    3900 config.go:182] Loaded profile config "multinode-452000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0904 13:08:32.666970    3900 out.go:177] * The control-plane node multinode-452000 host is not running: state=Stopped

	I0904 13:08:32.670980    3900 out.go:177]   To start a cluster, run: "minikube start -p multinode-452000"

** /stderr **

multinode_test.go:123: failed to add node to current cluster. args "out/minikube-darwin-arm64 node add -p multinode-452000 -v 3 --alsologtostderr" : exit status 83

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-452000 -n multinode-452000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-452000 -n multinode-452000: exit status 7 (30.470416ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-452000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/AddNode (0.07s)

=== RUN   TestMultiNode/serial/MultiNodeLabels

multinode_test.go:221: (dbg) Run:  kubectl --context multinode-452000 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]"

multinode_test.go:221: (dbg) Non-zero exit: kubectl --context multinode-452000 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]": exit status 1 (29.735209ms)

** stderr ** 

	Error in configuration: context was not found for specified context: multinode-452000

** /stderr **

multinode_test.go:223: failed to 'kubectl get nodes' with args "kubectl --context multinode-452000 get nodes -o \"jsonpath=[{range .items[*]}{.metadata.labels},{end}]\"": exit status 1

multinode_test.go:230: failed to decode json from label list: args "kubectl --context multinode-452000 get nodes -o \"jsonpath=[{range .items[*]}{.metadata.labels},{end}]\"": unexpected end of JSON input

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-452000 -n multinode-452000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-452000 -n multinode-452000: exit status 7 (29.827917ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-452000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/MultiNodeLabels (0.06s)

=== RUN   TestMultiNode/serial/ProfileList

multinode_test.go:143: (dbg) Run:  out/minikube-darwin-arm64 profile list --output json

multinode_test.go:166: expected profile "multinode-452000" in json of 'profile list' include 3 nodes but have 1 nodes. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"multinode-452000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"multinode-452000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube/iso/minikube-v1.34.0-arm64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"qemu2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\":1,\"APIServerPort\":8443,\"DockerOpt\":null,

\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.31.0\",\"ClusterName\":\"multinode-452000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.0\",\"ContainerRuntime\":\"docker\",\"C

ontrolPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"socket_vmnet\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"/opt/socket_vmnet/bin/socket_vmnet_client\",\"SocketVMnetPath\":\"/var/run/socket_vmnet\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\

"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":false}]}"*. args: "out/minikube-darwin-arm64 profile list --output json"

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-452000 -n multinode-452000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-452000 -n multinode-452000: exit status 7 (30.446667ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-452000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/ProfileList (0.08s)

=== RUN   TestMultiNode/serial/CopyFile

multinode_test.go:184: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-452000 status --output json --alsologtostderr

multinode_test.go:184: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-452000 status --output json --alsologtostderr: exit status 7 (29.899375ms)

-- stdout --

	{"Name":"multinode-452000","Host":"Stopped","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Stopped","Worker":false}

-- /stdout --

** stderr ** 

	I0904 13:08:32.871980    3912 out.go:345] Setting OutFile to fd 1 ...

	I0904 13:08:32.872110    3912 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:08:32.872113    3912 out.go:358] Setting ErrFile to fd 2...

	I0904 13:08:32.872116    3912 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:08:32.872234    3912 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19575-1140/.minikube/bin

	I0904 13:08:32.872343    3912 out.go:352] Setting JSON to true

	I0904 13:08:32.872353    3912 mustload.go:65] Loading cluster: multinode-452000

	I0904 13:08:32.872411    3912 notify.go:220] Checking for updates...

	I0904 13:08:32.872550    3912 config.go:182] Loaded profile config "multinode-452000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0904 13:08:32.872562    3912 status.go:255] checking status of multinode-452000 ...

	I0904 13:08:32.872779    3912 status.go:330] multinode-452000 host status = "Stopped" (err=<nil>)

	I0904 13:08:32.872783    3912 status.go:343] host is not running, skipping remaining checks

	I0904 13:08:32.872785    3912 status.go:257] multinode-452000 status: &{Name:multinode-452000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

multinode_test.go:191: failed to decode json from status: args "out/minikube-darwin-arm64 -p multinode-452000 status --output json --alsologtostderr": json: cannot unmarshal object into Go value of type []cmd.Status

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-452000 -n multinode-452000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-452000 -n multinode-452000: exit status 7 (30.009542ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-452000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/CopyFile (0.06s)

=== RUN   TestMultiNode/serial/StopNode

multinode_test.go:248: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-452000 node stop m03

multinode_test.go:248: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-452000 node stop m03: exit status 85 (46.502167ms)

-- stdout --

-- /stdout --

** stderr ** 

	X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                         │

	│    * If the above advice does not help, please let us know:                                                             │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

	│                                                                                                                         │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

	│    * Please also attach the following file to the GitHub issue:                                                         │

	│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_295f67d8757edd996fe5c1e7ccde72c355ccf4dc_0.log    │

	│                                                                                                                         │

	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

multinode_test.go:250: node stop returned an error. args "out/minikube-darwin-arm64 -p multinode-452000 node stop m03": exit status 85

multinode_test.go:254: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-452000 status

multinode_test.go:254: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-452000 status: exit status 7 (29.354166ms)

-- stdout --

	multinode-452000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

multinode_test.go:261: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-452000 status --alsologtostderr

multinode_test.go:261: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-452000 status --alsologtostderr: exit status 7 (29.71425ms)

-- stdout --

	multinode-452000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I0904 13:08:33.008427    3920 out.go:345] Setting OutFile to fd 1 ...

	I0904 13:08:33.008580    3920 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:08:33.008583    3920 out.go:358] Setting ErrFile to fd 2...

	I0904 13:08:33.008585    3920 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:08:33.008712    3920 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19575-1140/.minikube/bin

	I0904 13:08:33.008825    3920 out.go:352] Setting JSON to false

	I0904 13:08:33.008835    3920 mustload.go:65] Loading cluster: multinode-452000

	I0904 13:08:33.008892    3920 notify.go:220] Checking for updates...

	I0904 13:08:33.009029    3920 config.go:182] Loaded profile config "multinode-452000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0904 13:08:33.009036    3920 status.go:255] checking status of multinode-452000 ...

	I0904 13:08:33.009276    3920 status.go:330] multinode-452000 host status = "Stopped" (err=<nil>)

	I0904 13:08:33.009280    3920 status.go:343] host is not running, skipping remaining checks

	I0904 13:08:33.009282    3920 status.go:257] multinode-452000 status: &{Name:multinode-452000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

multinode_test.go:267: incorrect number of running kubelets: args "out/minikube-darwin-arm64 -p multinode-452000 status --alsologtostderr": multinode-452000

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-452000 -n multinode-452000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-452000 -n multinode-452000: exit status 7 (29.552ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-452000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/StopNode (0.14s)

=== RUN   TestMultiNode/serial/StartAfterStop

multinode_test.go:282: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-452000 node start m03 -v=7 --alsologtostderr

multinode_test.go:282: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-452000 node start m03 -v=7 --alsologtostderr: exit status 85 (46.761166ms)

-- stdout --

-- /stdout --

** stderr ** 

	I0904 13:08:33.069061    3924 out.go:345] Setting OutFile to fd 1 ...

	I0904 13:08:33.069293    3924 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:08:33.069296    3924 out.go:358] Setting ErrFile to fd 2...

	I0904 13:08:33.069299    3924 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:08:33.069438    3924 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19575-1140/.minikube/bin

	I0904 13:08:33.069654    3924 mustload.go:65] Loading cluster: multinode-452000

	I0904 13:08:33.069859    3924 config.go:182] Loaded profile config "multinode-452000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0904 13:08:33.073944    3924 out.go:201] 

	W0904 13:08:33.077009    3924 out.go:270] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03

	X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03

	W0904 13:08:33.077014    3924 out.go:270] * 

	* 

	W0904 13:08:33.078706    3924 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                         │

	│    * If the above advice does not help, please let us know:                                                             │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

	│                                                                                                                         │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

	│    * Please also attach the following file to the GitHub issue:                                                         │

	│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │

	│                                                                                                                         │

	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                         │

	│    * If the above advice does not help, please let us know:                                                             │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

	│                                                                                                                         │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

	│    * Please also attach the following file to the GitHub issue:                                                         │

	│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │

	│                                                                                                                         │

	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	I0904 13:08:33.081999    3924 out.go:201] 

** /stderr **

multinode_test.go:284: I0904 13:08:33.069061    3924 out.go:345] Setting OutFile to fd 1 ...

I0904 13:08:33.069293    3924 out.go:392] TERM=,COLORTERM=, which probably does not support color

I0904 13:08:33.069296    3924 out.go:358] Setting ErrFile to fd 2...

I0904 13:08:33.069299    3924 out.go:392] TERM=,COLORTERM=, which probably does not support color

I0904 13:08:33.069438    3924 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19575-1140/.minikube/bin

I0904 13:08:33.069654    3924 mustload.go:65] Loading cluster: multinode-452000

I0904 13:08:33.069859    3924 config.go:182] Loaded profile config "multinode-452000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

I0904 13:08:33.073944    3924 out.go:201] 

W0904 13:08:33.077009    3924 out.go:270] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03

X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03

W0904 13:08:33.077014    3924 out.go:270] * 

* 

W0904 13:08:33.078706    3924 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

│                                                                                                                         │

│    * If the above advice does not help, please let us know:                                                             │

│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

│                                                                                                                         │

│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

│    * Please also attach the following file to the GitHub issue:                                                         │

│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │

│                                                                                                                         │

╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

│                                                                                                                         │

│    * If the above advice does not help, please let us know:                                                             │

│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

│                                                                                                                         │

│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

│    * Please also attach the following file to the GitHub issue:                                                         │

│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │

│                                                                                                                         │

╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

I0904 13:08:33.081999    3924 out.go:201] 

multinode_test.go:285: node start returned an error. args "out/minikube-darwin-arm64 -p multinode-452000 node start m03 -v=7 --alsologtostderr": exit status 85

multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-452000 status -v=7 --alsologtostderr

multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-452000 status -v=7 --alsologtostderr: exit status 7 (30.560958ms)

-- stdout --

	multinode-452000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I0904 13:08:33.115742    3926 out.go:345] Setting OutFile to fd 1 ...

	I0904 13:08:33.115896    3926 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:08:33.115899    3926 out.go:358] Setting ErrFile to fd 2...

	I0904 13:08:33.115901    3926 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:08:33.116030    3926 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19575-1140/.minikube/bin

	I0904 13:08:33.116145    3926 out.go:352] Setting JSON to false

	I0904 13:08:33.116156    3926 mustload.go:65] Loading cluster: multinode-452000

	I0904 13:08:33.116211    3926 notify.go:220] Checking for updates...

	I0904 13:08:33.116375    3926 config.go:182] Loaded profile config "multinode-452000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0904 13:08:33.116383    3926 status.go:255] checking status of multinode-452000 ...

	I0904 13:08:33.116601    3926 status.go:330] multinode-452000 host status = "Stopped" (err=<nil>)

	I0904 13:08:33.116605    3926 status.go:343] host is not running, skipping remaining checks

	I0904 13:08:33.116609    3926 status.go:257] multinode-452000 status: &{Name:multinode-452000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-452000 status -v=7 --alsologtostderr

multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-452000 status -v=7 --alsologtostderr: exit status 7 (74.407333ms)

-- stdout --

	multinode-452000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I0904 13:08:34.136757    3928 out.go:345] Setting OutFile to fd 1 ...

	I0904 13:08:34.136934    3928 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:08:34.136938    3928 out.go:358] Setting ErrFile to fd 2...

	I0904 13:08:34.136941    3928 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:08:34.137109    3928 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19575-1140/.minikube/bin

	I0904 13:08:34.137268    3928 out.go:352] Setting JSON to false

	I0904 13:08:34.137280    3928 mustload.go:65] Loading cluster: multinode-452000

	I0904 13:08:34.137317    3928 notify.go:220] Checking for updates...

	I0904 13:08:34.137540    3928 config.go:182] Loaded profile config "multinode-452000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0904 13:08:34.137550    3928 status.go:255] checking status of multinode-452000 ...

	I0904 13:08:34.137825    3928 status.go:330] multinode-452000 host status = "Stopped" (err=<nil>)

	I0904 13:08:34.137830    3928 status.go:343] host is not running, skipping remaining checks

	I0904 13:08:34.137833    3928 status.go:257] multinode-452000 status: &{Name:multinode-452000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-452000 status -v=7 --alsologtostderr

multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-452000 status -v=7 --alsologtostderr: exit status 7 (73.232625ms)

-- stdout --

	multinode-452000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I0904 13:08:35.182916    3930 out.go:345] Setting OutFile to fd 1 ...

	I0904 13:08:35.183101    3930 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:08:35.183105    3930 out.go:358] Setting ErrFile to fd 2...

	I0904 13:08:35.183108    3930 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:08:35.183296    3930 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19575-1140/.minikube/bin

	I0904 13:08:35.183468    3930 out.go:352] Setting JSON to false

	I0904 13:08:35.183482    3930 mustload.go:65] Loading cluster: multinode-452000

	I0904 13:08:35.183526    3930 notify.go:220] Checking for updates...

	I0904 13:08:35.183738    3930 config.go:182] Loaded profile config "multinode-452000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0904 13:08:35.183754    3930 status.go:255] checking status of multinode-452000 ...

	I0904 13:08:35.184047    3930 status.go:330] multinode-452000 host status = "Stopped" (err=<nil>)

	I0904 13:08:35.184052    3930 status.go:343] host is not running, skipping remaining checks

	I0904 13:08:35.184055    3930 status.go:257] multinode-452000 status: &{Name:multinode-452000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-452000 status -v=7 --alsologtostderr

multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-452000 status -v=7 --alsologtostderr: exit status 7 (75.081625ms)

-- stdout --

	multinode-452000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I0904 13:08:37.972385    3932 out.go:345] Setting OutFile to fd 1 ...

	I0904 13:08:37.972602    3932 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:08:37.972611    3932 out.go:358] Setting ErrFile to fd 2...

	I0904 13:08:37.972615    3932 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:08:37.972810    3932 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19575-1140/.minikube/bin

	I0904 13:08:37.972970    3932 out.go:352] Setting JSON to false

	I0904 13:08:37.972984    3932 mustload.go:65] Loading cluster: multinode-452000

	I0904 13:08:37.973025    3932 notify.go:220] Checking for updates...

	I0904 13:08:37.973246    3932 config.go:182] Loaded profile config "multinode-452000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0904 13:08:37.973256    3932 status.go:255] checking status of multinode-452000 ...

	I0904 13:08:37.973517    3932 status.go:330] multinode-452000 host status = "Stopped" (err=<nil>)

	I0904 13:08:37.973522    3932 status.go:343] host is not running, skipping remaining checks

	I0904 13:08:37.973525    3932 status.go:257] multinode-452000 status: &{Name:multinode-452000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-452000 status -v=7 --alsologtostderr

multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-452000 status -v=7 --alsologtostderr: exit status 7 (72.427292ms)

-- stdout --

	multinode-452000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I0904 13:08:42.702127    3934 out.go:345] Setting OutFile to fd 1 ...

	I0904 13:08:42.702319    3934 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:08:42.702324    3934 out.go:358] Setting ErrFile to fd 2...

	I0904 13:08:42.702328    3934 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:08:42.702495    3934 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19575-1140/.minikube/bin

	I0904 13:08:42.702644    3934 out.go:352] Setting JSON to false

	I0904 13:08:42.702657    3934 mustload.go:65] Loading cluster: multinode-452000

	I0904 13:08:42.702691    3934 notify.go:220] Checking for updates...

	I0904 13:08:42.702917    3934 config.go:182] Loaded profile config "multinode-452000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0904 13:08:42.702927    3934 status.go:255] checking status of multinode-452000 ...

	I0904 13:08:42.703203    3934 status.go:330] multinode-452000 host status = "Stopped" (err=<nil>)

	I0904 13:08:42.703209    3934 status.go:343] host is not running, skipping remaining checks

	I0904 13:08:42.703212    3934 status.go:257] multinode-452000 status: &{Name:multinode-452000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-452000 status -v=7 --alsologtostderr

multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-452000 status -v=7 --alsologtostderr: exit status 7 (70.791292ms)

-- stdout --

	multinode-452000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I0904 13:08:49.177608    3941 out.go:345] Setting OutFile to fd 1 ...

	I0904 13:08:49.177822    3941 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:08:49.177827    3941 out.go:358] Setting ErrFile to fd 2...

	I0904 13:08:49.177831    3941 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:08:49.178012    3941 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19575-1140/.minikube/bin

	I0904 13:08:49.178194    3941 out.go:352] Setting JSON to false

	I0904 13:08:49.178209    3941 mustload.go:65] Loading cluster: multinode-452000

	I0904 13:08:49.178255    3941 notify.go:220] Checking for updates...

	I0904 13:08:49.178512    3941 config.go:182] Loaded profile config "multinode-452000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0904 13:08:49.178523    3941 status.go:255] checking status of multinode-452000 ...

	I0904 13:08:49.178844    3941 status.go:330] multinode-452000 host status = "Stopped" (err=<nil>)

	I0904 13:08:49.178850    3941 status.go:343] host is not running, skipping remaining checks

	I0904 13:08:49.178853    3941 status.go:257] multinode-452000 status: &{Name:multinode-452000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

E0904 13:08:55.870622    1661 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19575-1140/.minikube/profiles/functional-143000/client.crt: no such file or directory" logger="UnhandledError"

multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-452000 status -v=7 --alsologtostderr

multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-452000 status -v=7 --alsologtostderr: exit status 7 (74.018041ms)

-- stdout --

	multinode-452000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I0904 13:08:57.483323    3946 out.go:345] Setting OutFile to fd 1 ...

	I0904 13:08:57.483570    3946 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:08:57.483574    3946 out.go:358] Setting ErrFile to fd 2...

	I0904 13:08:57.483578    3946 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:08:57.483729    3946 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19575-1140/.minikube/bin

	I0904 13:08:57.483896    3946 out.go:352] Setting JSON to false

	I0904 13:08:57.483912    3946 mustload.go:65] Loading cluster: multinode-452000

	I0904 13:08:57.483950    3946 notify.go:220] Checking for updates...

	I0904 13:08:57.484194    3946 config.go:182] Loaded profile config "multinode-452000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0904 13:08:57.484205    3946 status.go:255] checking status of multinode-452000 ...

	I0904 13:08:57.484509    3946 status.go:330] multinode-452000 host status = "Stopped" (err=<nil>)

	I0904 13:08:57.484515    3946 status.go:343] host is not running, skipping remaining checks

	I0904 13:08:57.484518    3946 status.go:257] multinode-452000 status: &{Name:multinode-452000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-452000 status -v=7 --alsologtostderr

multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-452000 status -v=7 --alsologtostderr: exit status 7 (73.37125ms)

-- stdout --

	multinode-452000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I0904 13:09:06.465669    3948 out.go:345] Setting OutFile to fd 1 ...

	I0904 13:09:06.465853    3948 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:09:06.465857    3948 out.go:358] Setting ErrFile to fd 2...

	I0904 13:09:06.465861    3948 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:09:06.466053    3948 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19575-1140/.minikube/bin

	I0904 13:09:06.466199    3948 out.go:352] Setting JSON to false

	I0904 13:09:06.466213    3948 mustload.go:65] Loading cluster: multinode-452000

	I0904 13:09:06.466256    3948 notify.go:220] Checking for updates...

	I0904 13:09:06.466501    3948 config.go:182] Loaded profile config "multinode-452000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0904 13:09:06.466513    3948 status.go:255] checking status of multinode-452000 ...

	I0904 13:09:06.466834    3948 status.go:330] multinode-452000 host status = "Stopped" (err=<nil>)

	I0904 13:09:06.466839    3948 status.go:343] host is not running, skipping remaining checks

	I0904 13:09:06.466842    3948 status.go:257] multinode-452000 status: &{Name:multinode-452000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-452000 status -v=7 --alsologtostderr

multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-452000 status -v=7 --alsologtostderr: exit status 7 (71.120375ms)

-- stdout --

	multinode-452000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I0904 13:09:17.714844    3952 out.go:345] Setting OutFile to fd 1 ...

	I0904 13:09:17.715033    3952 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:09:17.715037    3952 out.go:358] Setting ErrFile to fd 2...

	I0904 13:09:17.715040    3952 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0904 13:09:17.715198    3952 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19575-1140/.minikube/bin

	I0904 13:09:17.715374    3952 out.go:352] Setting JSON to false

	I0904 13:09:17.715387    3952 mustload.go:65] Loading cluster: multinode-452000

	I0904 13:09:17.715426    3952 notify.go:220] Checking for updates...

	I0904 13:09:17.715671    3952 config.go:182] Loaded profile config "multinode-452000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0

	I0904 13:09:17.715683    3952 status.go:255] checking status of multinode-452000 ...

	I0904 13:09:17.715964    3952 status.go:330] multinode-452000 host status = "Stopped" (err=<nil>)

	I0904 13:09:17.715970    3952 status.go:343] host is not running, skipping remaining checks

	I0904 13:09:17.715973    3952 status.go:257] multinode-452000 status: &{Name:multinode-452000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

multinode_test.go:294: failed to run minikube status. args "out/minikube-darwin-arm64 -p multinode-452000 status -v=7 --alsologtostderr" : exit status 7

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-452000 -n multinode-452000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-452000 -n multinode-452000: exit status 7 (34.271ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-452000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/StartAfterStop (44.71s)