=== RUN   TestDownloadOnly/v1.20.0/json-events

aaa_download_only_test.go:81: (dbg) Run:  out/minikube-darwin-arm64 start -o=json --download-only -p download-only-639000 --force --alsologtostderr --kubernetes-version=v1.20.0 --container-runtime=docker --driver=qemu2 

aaa_download_only_test.go:81: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -o=json --download-only -p download-only-639000 --force --alsologtostderr --kubernetes-version=v1.20.0 --container-runtime=docker --driver=qemu2 : exit status 40 (29.023294209s)

-- stdout --

	{"specversion":"1.0","id":"7bbe6aed-c8af-4656-8b91-01ec1cc958e7","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[download-only-639000] minikube v1.34.0 on Darwin 14.5 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}

	{"specversion":"1.0","id":"e925a130-2846-4b2a-b952-413c80d2df25","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=19616"}}

	{"specversion":"1.0","id":"b484cfba-a11e-4374-8715-31989548ec87","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/Users/jenkins/minikube-integration/19616-1259/kubeconfig"}}

	{"specversion":"1.0","id":"c2daa682-0f7e-499f-8b17-588eaee6877e","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-darwin-arm64"}}

	{"specversion":"1.0","id":"ff094065-355e-42e9-9c24-234308c3ae09","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}

	{"specversion":"1.0","id":"8bc54184-4d3d-4ee2-8f41-d000735d5df7","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/Users/jenkins/minikube-integration/19616-1259/.minikube"}}

	{"specversion":"1.0","id":"31a68e26-c298-4a6b-88db-8300f9ed56a5","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.warning","datacontenttype":"application/json","data":{"message":"minikube skips various validations when --force is supplied; this may lead to unexpected behavior"}}

	{"specversion":"1.0","id":"23b35593-7f2e-49ba-8a7b-ee641936072b","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the qemu2 driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}

	{"specversion":"1.0","id":"c5f903df-af66-4437-b5e2-ca7ce0d7fa15","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Automatically selected the socket_vmnet network"}}

	{"specversion":"1.0","id":"4ba0172b-bdfe-49e7-afbe-e876a0729549","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Downloading VM boot image ...","name":"Selecting Driver","totalsteps":"19"}}

	{"specversion":"1.0","id":"f6348c0a-0cfe-435f-b8fd-0644d546380b","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting \"download-only-639000\" primary control-plane node in \"download-only-639000\" cluster","name":"Starting Node","totalsteps":"19"}}

	{"specversion":"1.0","id":"78e8b4a9-9d65-4ad5-94e4-c460612997cb","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Downloading Kubernetes v1.20.0 preload ...","name":"Starting Node","totalsteps":"19"}}

	{"specversion":"1.0","id":"d4a300c2-d131-4744-9b52-76a708d925a8","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"40","issues":"","message":"Failed to cache kubectl: download failed: https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256: getter: \u0026{Ctx:context.Background Src:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256 Dst:/Users/jenkins/minikube-integration/19616-1259/.minikube/cache/darwin/arm64/v1.20.0/kubectl.download Pwd: Mode:2 Umask:---------- Detectors:[0x106d07e80 0x106d07e80 0x106d07e80 0x106d07e80 0x106d07e80 0x106d07e80 0x106d07e80] Decompressors:map[bz2:0x140007d3440 gz:0x140007d3448 tar:0x140007d33f0 tar.bz2:0x140007d3400 tar.gz:0x140007d3410 tar.xz:0x140007d3420 tar.zst:0x140007d3430 tbz2:0x140007d3400 tgz:0x14

0007d3410 txz:0x140007d3420 tzst:0x140007d3430 xz:0x140007d3450 zip:0x140007d3460 zst:0x140007d3458] Getters:map[file:0x140004a2fb0 http:0x140000b4fa0 https:0x140000b4ff0] Dir:false ProgressListener:\u003cnil\u003e Insecure:false DisableSymlinks:false Options:[]}: invalid checksum: Error downloading checksum file: bad response code: 404","name":"INET_CACHE_KUBECTL","url":""}}

	{"specversion":"1.0","id":"a830b10d-6c0b-44e1-b0b3-48ffab9ebdd5","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"╭───────────────────────────────────────────────────────────────────────────────────────────╮\n│                                                                                           │\n│    If the above advice does not help, please let us know:                                 │\n│    https://github.com/kubernetes/minikube/issues/new/choose                               │\n│                                                                                           │\n│    Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │\n│

│\n╰───────────────────────────────────────────────────────────────────────────────────────────╯"}}

-- /stdout --

** stderr ** 

	I0912 14:27:59.692886    1786 out.go:345] Setting OutFile to fd 1 ...

	I0912 14:27:59.693031    1786 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 14:27:59.693034    1786 out.go:358] Setting ErrFile to fd 2...

	I0912 14:27:59.693037    1786 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 14:27:59.693201    1786 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19616-1259/.minikube/bin

	W0912 14:27:59.693280    1786 root.go:314] Error reading config file at /Users/jenkins/minikube-integration/19616-1259/.minikube/config/config.json: open /Users/jenkins/minikube-integration/19616-1259/.minikube/config/config.json: no such file or directory

	I0912 14:27:59.694596    1786 out.go:352] Setting JSON to true

	I0912 14:27:59.712051    1786 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":1643,"bootTime":1726174836,"procs":477,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0912 14:27:59.712119    1786 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0912 14:27:59.718593    1786 out.go:97] [download-only-639000] minikube v1.34.0 on Darwin 14.5 (arm64)

	I0912 14:27:59.718721    1786 notify.go:220] Checking for updates...

	W0912 14:27:59.718752    1786 preload.go:293] Failed to list preload files: open /Users/jenkins/minikube-integration/19616-1259/.minikube/cache/preloaded-tarball: no such file or directory

	I0912 14:27:59.720008    1786 out.go:169] MINIKUBE_LOCATION=19616

	I0912 14:27:59.722483    1786 out.go:169] KUBECONFIG=/Users/jenkins/minikube-integration/19616-1259/kubeconfig

	I0912 14:27:59.727525    1786 out.go:169] MINIKUBE_BIN=out/minikube-darwin-arm64

	I0912 14:27:59.729166    1786 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0912 14:27:59.732519    1786 out.go:169] MINIKUBE_HOME=/Users/jenkins/minikube-integration/19616-1259/.minikube

	W0912 14:27:59.738534    1786 out.go:321] minikube skips various validations when --force is supplied; this may lead to unexpected behavior

	I0912 14:27:59.738790    1786 driver.go:394] Setting default libvirt URI to qemu:///system

	I0912 14:27:59.743467    1786 out.go:97] Using the qemu2 driver based on user configuration

	I0912 14:27:59.743485    1786 start.go:297] selected driver: qemu2

	I0912 14:27:59.743500    1786 start.go:901] validating driver "qemu2" against <nil>

	I0912 14:27:59.743585    1786 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0912 14:27:59.746471    1786 out.go:169] Automatically selected the socket_vmnet network

	I0912 14:27:59.752084    1786 start_flags.go:393] Using suggested 4000MB memory alloc based on sys=16384MB, container=0MB

	I0912 14:27:59.752174    1786 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]

	I0912 14:27:59.752236    1786 cni.go:84] Creating CNI manager for ""

	I0912 14:27:59.752252    1786 cni.go:162] CNI unnecessary in this configuration, recommending no CNI

	I0912 14:27:59.752298    1786 start.go:340] cluster config:

	{Name:download-only-639000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726156396-19616@sha256:66b06a42534e914a5c8ad765d7508a93a34031939ec9a6b3a818ef0a444ff889 Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:download-only-639000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Con

tainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSo

ck: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0912 14:27:59.757396    1786 iso.go:125] acquiring lock: {Name:mk3fa9c1c2a2731193a2e63235bbe8976497103e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0912 14:27:59.761522    1786 out.go:97] Downloading VM boot image ...

	I0912 14:27:59.761546    1786 download.go:107] Downloading: https://storage.googleapis.com/minikube-builds/iso/19616/minikube-v1.34.0-1726156389-19616-arm64.iso?checksum=file:https://storage.googleapis.com/minikube-builds/iso/19616/minikube-v1.34.0-1726156389-19616-arm64.iso.sha256 -> /Users/jenkins/minikube-integration/19616-1259/.minikube/cache/iso/arm64/minikube-v1.34.0-1726156389-19616-arm64.iso

	I0912 14:28:17.053394    1786 out.go:97] Starting "download-only-639000" primary control-plane node in "download-only-639000" cluster

	I0912 14:28:17.053423    1786 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker

	I0912 14:28:17.123500    1786 preload.go:118] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4

	I0912 14:28:17.123534    1786 cache.go:56] Caching tarball of preloaded images

	I0912 14:28:17.123708    1786 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker

	I0912 14:28:17.128705    1786 out.go:97] Downloading Kubernetes v1.20.0 preload ...

	I0912 14:28:17.128714    1786 preload.go:236] getting checksum for preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4 ...

	I0912 14:28:17.215666    1786 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4?checksum=md5:1a3e8f9b29e6affec63d76d0d3000942 -> /Users/jenkins/minikube-integration/19616-1259/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4

	I0912 14:28:27.388393    1786 preload.go:247] saving checksum for preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4 ...

	I0912 14:28:27.388571    1786 preload.go:254] verifying checksum of /Users/jenkins/minikube-integration/19616-1259/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-arm64.tar.lz4 ...

	I0912 14:28:28.084022    1786 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on docker

	I0912 14:28:28.084209    1786 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/download-only-639000/config.json ...

	I0912 14:28:28.084227    1786 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/download-only-639000/config.json: {Name:mk21f07567c0099c45babb8851d4182d9e947dc8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0912 14:28:28.084460    1786 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime docker

	I0912 14:28:28.084655    1786 download.go:107] Downloading: https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256 -> /Users/jenkins/minikube-integration/19616-1259/.minikube/cache/darwin/arm64/v1.20.0/kubectl

	I0912 14:28:28.636305    1786 out.go:193] 

	W0912 14:28:28.644235    1786 out_reason.go:110] Failed to cache kubectl: download failed: https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256: getter: &{Ctx:context.Background Src:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/arm64/kubectl.sha256 Dst:/Users/jenkins/minikube-integration/19616-1259/.minikube/cache/darwin/arm64/v1.20.0/kubectl.download Pwd: Mode:2 Umask:---------- Detectors:[0x106d07e80 0x106d07e80 0x106d07e80 0x106d07e80 0x106d07e80 0x106d07e80 0x106d07e80] Decompressors:map[bz2:0x140007d3440 gz:0x140007d3448 tar:0x140007d33f0 tar.bz2:0x140007d3400 tar.gz:0x140007d3410 tar.xz:0x140007d3420 tar.zst:0x140007d3430 tbz2:0x140007d3400 tgz:0x140007d3410 txz:0x140007d3420 tzst:0x140007d3430 xz:0x140007d3450 zip:0x140007d3460 zst:0x140007d3458] Getters:map[file:0x140004a2fb0 http:0x140000b4fa0 https:0x140000b4ff0] Dir:false ProgressList

ener:<nil> Insecure:false DisableSymlinks:false Options:[]}: invalid checksum: Error downloading checksum file: bad response code: 404

	W0912 14:28:28.644260    1786 out_reason.go:110] 

	W0912 14:28:28.654212    1786 out.go:283] ╭───────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                           │

	│    If the above advice does not help, please let us know:                                 │

	│    https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                           │

	│    Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                           │

	╰───────────────────────────────────────────────────────────────────────────────────────────╯

	I0912 14:28:28.658126    1786 out.go:193] 

** /stderr **

aaa_download_only_test.go:83: failed to download only. args: ["start" "-o=json" "--download-only" "-p" "download-only-639000" "--force" "--alsologtostderr" "--kubernetes-version=v1.20.0" "--container-runtime=docker" "--driver=qemu2" ""] exit status 40

--- FAIL: TestDownloadOnly/v1.20.0/json-events (29.02s)

=== RUN   TestDownloadOnly/v1.20.0/kubectl

aaa_download_only_test.go:175: expected the file for binary exist at "/Users/jenkins/minikube-integration/19616-1259/.minikube/cache/darwin/arm64/v1.20.0/kubectl" but got error stat /Users/jenkins/minikube-integration/19616-1259/.minikube/cache/darwin/arm64/v1.20.0/kubectl: no such file or directory

--- FAIL: TestDownloadOnly/v1.20.0/kubectl (0.00s)

=== RUN   TestOffline

=== PAUSE TestOffline

=== CONT  TestOffline

aab_offline_test.go:55: (dbg) Run:  out/minikube-darwin-arm64 start -p offline-docker-315000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=qemu2 

aab_offline_test.go:55: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p offline-docker-315000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=qemu2 : exit status 80 (9.774180333s)

-- stdout --

	* [offline-docker-315000] minikube v1.34.0 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19616

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19616-1259/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19616-1259/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "offline-docker-315000" primary control-plane node in "offline-docker-315000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "offline-docker-315000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0912 15:14:02.972582    4413 out.go:345] Setting OutFile to fd 1 ...

	I0912 15:14:02.972716    4413 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:14:02.972720    4413 out.go:358] Setting ErrFile to fd 2...

	I0912 15:14:02.972722    4413 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:14:02.972840    4413 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19616-1259/.minikube/bin

	I0912 15:14:02.974390    4413 out.go:352] Setting JSON to false

	I0912 15:14:02.992061    4413 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":4406,"bootTime":1726174836,"procs":471,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0912 15:14:02.992129    4413 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0912 15:14:02.997478    4413 out.go:177] * [offline-docker-315000] minikube v1.34.0 on Darwin 14.5 (arm64)

	I0912 15:14:03.005318    4413 out.go:177]   - MINIKUBE_LOCATION=19616

	I0912 15:14:03.005345    4413 notify.go:220] Checking for updates...

	I0912 15:14:03.011225    4413 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19616-1259/kubeconfig

	I0912 15:14:03.014313    4413 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0912 15:14:03.017327    4413 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0912 15:14:03.018912    4413 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19616-1259/.minikube

	I0912 15:14:03.021221    4413 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0912 15:14:03.024726    4413 config.go:182] Loaded profile config "multinode-323000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I0912 15:14:03.024784    4413 driver.go:394] Setting default libvirt URI to qemu:///system

	I0912 15:14:03.029115    4413 out.go:177] * Using the qemu2 driver based on user configuration

	I0912 15:14:03.036265    4413 start.go:297] selected driver: qemu2

	I0912 15:14:03.036274    4413 start.go:901] validating driver "qemu2" against <nil>

	I0912 15:14:03.036281    4413 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0912 15:14:03.038010    4413 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0912 15:14:03.041262    4413 out.go:177] * Automatically selected the socket_vmnet network

	I0912 15:14:03.044305    4413 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0912 15:14:03.044326    4413 cni.go:84] Creating CNI manager for ""

	I0912 15:14:03.044334    4413 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0912 15:14:03.044339    4413 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0912 15:14:03.044378    4413 start.go:340] cluster config:

	{Name:offline-docker-315000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726156396-19616@sha256:66b06a42534e914a5c8ad765d7508a93a34031939ec9a6b3a818ef0a444ff889 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:offline-docker-315000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C

ontainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bi

n/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0912 15:14:03.048023    4413 iso.go:125] acquiring lock: {Name:mk3fa9c1c2a2731193a2e63235bbe8976497103e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0912 15:14:03.052304    4413 out.go:177] * Starting "offline-docker-315000" primary control-plane node in "offline-docker-315000" cluster

	I0912 15:14:03.060238    4413 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime docker

	I0912 15:14:03.060261    4413 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19616-1259/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4

	I0912 15:14:03.060271    4413 cache.go:56] Caching tarball of preloaded images

	I0912 15:14:03.060329    4413 preload.go:172] Found /Users/jenkins/minikube-integration/19616-1259/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0912 15:14:03.060339    4413 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on docker

	I0912 15:14:03.060404    4413 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/offline-docker-315000/config.json ...

	I0912 15:14:03.060414    4413 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/offline-docker-315000/config.json: {Name:mk28123986edfac284c1165112a28c69250693ff Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0912 15:14:03.060724    4413 start.go:360] acquireMachinesLock for offline-docker-315000: {Name:mk18104440c14407e7206cb5d92d4872e7d20daa Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0912 15:14:03.060759    4413 start.go:364] duration metric: took 26µs to acquireMachinesLock for "offline-docker-315000"

	I0912 15:14:03.060775    4413 start.go:93] Provisioning new machine with config: &{Name:offline-docker-315000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19616/minikube-v1.34.0-1726156389-19616-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726156396-19616@sha256:66b06a42534e914a5c8ad765d7508a93a34031939ec9a6b3a818ef0a444ff889 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf

ig:{KubernetesVersion:v1.31.1 ClusterName:offline-docker-315000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 Mou

ntOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0912 15:14:03.060799    4413 start.go:125] createHost starting for "" (driver="qemu2")

	I0912 15:14:03.068272    4413 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0912 15:14:03.084036    4413 start.go:159] libmachine.API.Create for "offline-docker-315000" (driver="qemu2")

	I0912 15:14:03.084076    4413 client.go:168] LocalClient.Create starting

	I0912 15:14:03.084161    4413 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19616-1259/.minikube/certs/ca.pem

	I0912 15:14:03.084191    4413 main.go:141] libmachine: Decoding PEM data...

	I0912 15:14:03.084204    4413 main.go:141] libmachine: Parsing certificate...

	I0912 15:14:03.084246    4413 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19616-1259/.minikube/certs/cert.pem

	I0912 15:14:03.084269    4413 main.go:141] libmachine: Decoding PEM data...

	I0912 15:14:03.084278    4413 main.go:141] libmachine: Parsing certificate...

	I0912 15:14:03.084669    4413 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19616-1259/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19616-1259/.minikube/cache/iso/arm64/minikube-v1.34.0-1726156389-19616-arm64.iso...

	I0912 15:14:03.244474    4413 main.go:141] libmachine: Creating SSH key...

	I0912 15:14:03.279443    4413 main.go:141] libmachine: Creating Disk image...

	I0912 15:14:03.279454    4413 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0912 15:14:03.279703    4413 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/offline-docker-315000/disk.qcow2.raw /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/offline-docker-315000/disk.qcow2

	I0912 15:14:03.293508    4413 main.go:141] libmachine: STDOUT: 

	I0912 15:14:03.293532    4413 main.go:141] libmachine: STDERR: 

	I0912 15:14:03.293581    4413 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/offline-docker-315000/disk.qcow2 +20000M

	I0912 15:14:03.310880    4413 main.go:141] libmachine: STDOUT: Image resized.

	I0912 15:14:03.310898    4413 main.go:141] libmachine: STDERR: 

	I0912 15:14:03.310909    4413 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/offline-docker-315000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/offline-docker-315000/disk.qcow2

	I0912 15:14:03.310913    4413 main.go:141] libmachine: Starting QEMU VM...

	I0912 15:14:03.310928    4413 qemu.go:418] Using hvf for hardware acceleration

	I0912 15:14:03.310958    4413 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/offline-docker-315000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/offline-docker-315000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/offline-docker-315000/qemu.pid -device virtio-net-pci,netdev=net0,mac=2a:e4:7e:f6:76:60 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/offline-docker-315000/disk.qcow2

	I0912 15:14:03.312515    4413 main.go:141] libmachine: STDOUT: 

	I0912 15:14:03.312537    4413 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0912 15:14:03.312555    4413 client.go:171] duration metric: took 228.482167ms to LocalClient.Create

	I0912 15:14:05.314614    4413 start.go:128] duration metric: took 2.253867625s to createHost

	I0912 15:14:05.314656    4413 start.go:83] releasing machines lock for "offline-docker-315000", held for 2.253955417s

	W0912 15:14:05.314681    4413 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0912 15:14:05.329994    4413 out.go:177] * Deleting "offline-docker-315000" in qemu2 ...

	W0912 15:14:05.348312    4413 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0912 15:14:05.348322    4413 start.go:729] Will try again in 5 seconds ...

	I0912 15:14:10.350458    4413 start.go:360] acquireMachinesLock for offline-docker-315000: {Name:mk18104440c14407e7206cb5d92d4872e7d20daa Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0912 15:14:10.350936    4413 start.go:364] duration metric: took 340.875µs to acquireMachinesLock for "offline-docker-315000"

	I0912 15:14:10.351068    4413 start.go:93] Provisioning new machine with config: &{Name:offline-docker-315000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19616/minikube-v1.34.0-1726156389-19616-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726156396-19616@sha256:66b06a42534e914a5c8ad765d7508a93a34031939ec9a6b3a818ef0a444ff889 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf

ig:{KubernetesVersion:v1.31.1 ClusterName:offline-docker-315000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 Mou

ntOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0912 15:14:10.351456    4413 start.go:125] createHost starting for "" (driver="qemu2")

	I0912 15:14:10.361057    4413 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0912 15:14:10.412118    4413 start.go:159] libmachine.API.Create for "offline-docker-315000" (driver="qemu2")

	I0912 15:14:10.412171    4413 client.go:168] LocalClient.Create starting

	I0912 15:14:10.412281    4413 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19616-1259/.minikube/certs/ca.pem

	I0912 15:14:10.412339    4413 main.go:141] libmachine: Decoding PEM data...

	I0912 15:14:10.412359    4413 main.go:141] libmachine: Parsing certificate...

	I0912 15:14:10.412433    4413 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19616-1259/.minikube/certs/cert.pem

	I0912 15:14:10.412476    4413 main.go:141] libmachine: Decoding PEM data...

	I0912 15:14:10.412486    4413 main.go:141] libmachine: Parsing certificate...

	I0912 15:14:10.412988    4413 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19616-1259/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19616-1259/.minikube/cache/iso/arm64/minikube-v1.34.0-1726156389-19616-arm64.iso...

	I0912 15:14:10.580993    4413 main.go:141] libmachine: Creating SSH key...

	I0912 15:14:10.650092    4413 main.go:141] libmachine: Creating Disk image...

	I0912 15:14:10.650097    4413 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0912 15:14:10.650326    4413 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/offline-docker-315000/disk.qcow2.raw /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/offline-docker-315000/disk.qcow2

	I0912 15:14:10.659563    4413 main.go:141] libmachine: STDOUT: 

	I0912 15:14:10.659647    4413 main.go:141] libmachine: STDERR: 

	I0912 15:14:10.659695    4413 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/offline-docker-315000/disk.qcow2 +20000M

	I0912 15:14:10.667370    4413 main.go:141] libmachine: STDOUT: Image resized.

	I0912 15:14:10.667431    4413 main.go:141] libmachine: STDERR: 

	I0912 15:14:10.667443    4413 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/offline-docker-315000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/offline-docker-315000/disk.qcow2

	I0912 15:14:10.667448    4413 main.go:141] libmachine: Starting QEMU VM...

	I0912 15:14:10.667459    4413 qemu.go:418] Using hvf for hardware acceleration

	I0912 15:14:10.667500    4413 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/offline-docker-315000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/offline-docker-315000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/offline-docker-315000/qemu.pid -device virtio-net-pci,netdev=net0,mac=16:6b:31:07:bf:36 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/offline-docker-315000/disk.qcow2

	I0912 15:14:10.669001    4413 main.go:141] libmachine: STDOUT: 

	I0912 15:14:10.669017    4413 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0912 15:14:10.669029    4413 client.go:171] duration metric: took 256.859875ms to LocalClient.Create

	I0912 15:14:12.671155    4413 start.go:128] duration metric: took 2.319710416s to createHost

	I0912 15:14:12.671211    4413 start.go:83] releasing machines lock for "offline-docker-315000", held for 2.320316125s

	W0912 15:14:12.671541    4413 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p offline-docker-315000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p offline-docker-315000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0912 15:14:12.688268    4413 out.go:201] 

	W0912 15:14:12.692316    4413 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0912 15:14:12.692360    4413 out.go:270] * 

	* 

	W0912 15:14:12.694975    4413 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0912 15:14:12.706121    4413 out.go:201] 

** /stderr **

aab_offline_test.go:58: out/minikube-darwin-arm64 start -p offline-docker-315000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=qemu2  failed: exit status 80

panic.go:626: *** TestOffline FAILED at 2024-09-12 15:14:12.718488 -0700 PDT m=+2773.179790501

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p offline-docker-315000 -n offline-docker-315000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p offline-docker-315000 -n offline-docker-315000: exit status 7 (68.77675ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "offline-docker-315000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "offline-docker-315000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p offline-docker-315000

--- FAIL: TestOffline (9.93s)

=== RUN   TestAddons/parallel/Registry

=== PAUSE TestAddons/parallel/Registry

=== CONT  TestAddons/parallel/Registry

addons_test.go:332: registry stabilized in 1.221666ms

addons_test.go:334: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...

helpers_test.go:344: "registry-66c9cd494c-p5f26" [d42d83d3-de78-4a99-ab0d-4539040c1a33] Running

addons_test.go:334: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 5.006457833s

addons_test.go:337: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...

helpers_test.go:344: "registry-proxy-zh429" [21dafca9-6625-404e-9961-8c638a8f1694] Running

addons_test.go:337: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 5.009831s

addons_test.go:342: (dbg) Run:  kubectl --context addons-094000 delete po -l run=registry-test --now

addons_test.go:347: (dbg) Run:  kubectl --context addons-094000 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"

addons_test.go:347: (dbg) Non-zero exit: kubectl --context addons-094000 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": exit status 1 (1m0.065153916s)

-- stdout --

	pod "registry-test" deleted

-- /stdout --

** stderr ** 

	error: timed out waiting for the condition

** /stderr **

addons_test.go:349: failed to hit registry.kube-system.svc.cluster.local. args "kubectl --context addons-094000 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c \"wget --spider -S http://registry.kube-system.svc.cluster.local\"" failed: exit status 1

addons_test.go:353: expected curl response be "HTTP/1.1 200", but got *pod "registry-test" deleted

*

addons_test.go:361: (dbg) Run:  out/minikube-darwin-arm64 -p addons-094000 ip

2024/09/12 14:41:58 [DEBUG] GET http://192.168.105.2:5000

addons_test.go:390: (dbg) Run:  out/minikube-darwin-arm64 -p addons-094000 addons disable registry --alsologtostderr -v=1

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p addons-094000 -n addons-094000

helpers_test.go:244: <<< TestAddons/parallel/Registry FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestAddons/parallel/Registry]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-darwin-arm64 -p addons-094000 logs -n 25

helpers_test.go:252: TestAddons/parallel/Registry logs: 

-- stdout --

	==> Audit <==

	|---------|--------------------------------------|----------------------|---------|---------|---------------------|---------------------|

	| Command |                 Args                 |       Profile        |  User   | Version |     Start Time      |      End Time       |

	|---------|--------------------------------------|----------------------|---------|---------|---------------------|---------------------|

	| start   | -o=json --download-only              | download-only-639000 | jenkins | v1.34.0 | 12 Sep 24 14:27 PDT |                     |

	|         | -p download-only-639000              |                      |         |         |                     |                     |

	|         | --force --alsologtostderr            |                      |         |         |                     |                     |

	|         | --kubernetes-version=v1.20.0         |                      |         |         |                     |                     |

	|         | --container-runtime=docker           |                      |         |         |                     |                     |

	|         | --driver=qemu2                       |                      |         |         |                     |                     |

	| delete  | --all                                | minikube             | jenkins | v1.34.0 | 12 Sep 24 14:28 PDT | 12 Sep 24 14:28 PDT |

	| delete  | -p download-only-639000              | download-only-639000 | jenkins | v1.34.0 | 12 Sep 24 14:28 PDT | 12 Sep 24 14:28 PDT |

	| start   | -o=json --download-only              | download-only-057000 | jenkins | v1.34.0 | 12 Sep 24 14:28 PDT |                     |

	|         | -p download-only-057000              |                      |         |         |                     |                     |

	|         | --force --alsologtostderr            |                      |         |         |                     |                     |

	|         | --kubernetes-version=v1.31.1         |                      |         |         |                     |                     |

	|         | --container-runtime=docker           |                      |         |         |                     |                     |

	|         | --driver=qemu2                       |                      |         |         |                     |                     |

	| delete  | --all                                | minikube             | jenkins | v1.34.0 | 12 Sep 24 14:28 PDT | 12 Sep 24 14:28 PDT |

	| delete  | -p download-only-057000              | download-only-057000 | jenkins | v1.34.0 | 12 Sep 24 14:28 PDT | 12 Sep 24 14:28 PDT |

	| delete  | -p download-only-639000              | download-only-639000 | jenkins | v1.34.0 | 12 Sep 24 14:28 PDT | 12 Sep 24 14:28 PDT |

	| delete  | -p download-only-057000              | download-only-057000 | jenkins | v1.34.0 | 12 Sep 24 14:28 PDT | 12 Sep 24 14:28 PDT |

	| start   | --download-only -p                   | binary-mirror-484000 | jenkins | v1.34.0 | 12 Sep 24 14:28 PDT |                     |

	|         | binary-mirror-484000                 |                      |         |         |                     |                     |

	|         | --alsologtostderr                    |                      |         |         |                     |                     |

	|         | --binary-mirror                      |                      |         |         |                     |                     |

	|         | http://127.0.0.1:49312               |                      |         |         |                     |                     |

	|         | --driver=qemu2                       |                      |         |         |                     |                     |

	| delete  | -p binary-mirror-484000              | binary-mirror-484000 | jenkins | v1.34.0 | 12 Sep 24 14:28 PDT | 12 Sep 24 14:28 PDT |

	| addons  | disable dashboard -p                 | addons-094000        | jenkins | v1.34.0 | 12 Sep 24 14:28 PDT |                     |

	|         | addons-094000                        |                      |         |         |                     |                     |

	| addons  | enable dashboard -p                  | addons-094000        | jenkins | v1.34.0 | 12 Sep 24 14:28 PDT |                     |

	|         | addons-094000                        |                      |         |         |                     |                     |

	| start   | -p addons-094000 --wait=true         | addons-094000        | jenkins | v1.34.0 | 12 Sep 24 14:28 PDT | 12 Sep 24 14:32 PDT |

	|         | --memory=4000 --alsologtostderr      |                      |         |         |                     |                     |

	|         | --addons=registry                    |                      |         |         |                     |                     |

	|         | --addons=metrics-server              |                      |         |         |                     |                     |

	|         | --addons=volumesnapshots             |                      |         |         |                     |                     |

	|         | --addons=csi-hostpath-driver         |                      |         |         |                     |                     |

	|         | --addons=gcp-auth                    |                      |         |         |                     |                     |

	|         | --addons=cloud-spanner               |                      |         |         |                     |                     |

	|         | --addons=inspektor-gadget            |                      |         |         |                     |                     |

	|         | --addons=storage-provisioner-rancher |                      |         |         |                     |                     |

	|         | --addons=nvidia-device-plugin        |                      |         |         |                     |                     |

	|         | --addons=yakd --addons=volcano       |                      |         |         |                     |                     |

	|         | --driver=qemu2  --addons=ingress     |                      |         |         |                     |                     |

	|         | --addons=ingress-dns                 |                      |         |         |                     |                     |

	| addons  | addons-094000 addons disable         | addons-094000        | jenkins | v1.34.0 | 12 Sep 24 14:32 PDT | 12 Sep 24 14:32 PDT |

	|         | volcano --alsologtostderr -v=1       |                      |         |         |                     |                     |

	| addons  | addons-094000 addons                 | addons-094000        | jenkins | v1.34.0 | 12 Sep 24 14:41 PDT | 12 Sep 24 14:41 PDT |

	|         | disable csi-hostpath-driver          |                      |         |         |                     |                     |

	|         | --alsologtostderr -v=1               |                      |         |         |                     |                     |

	| addons  | addons-094000 addons                 | addons-094000        | jenkins | v1.34.0 | 12 Sep 24 14:41 PDT | 12 Sep 24 14:41 PDT |

	|         | disable volumesnapshots              |                      |         |         |                     |                     |

	|         | --alsologtostderr -v=1               |                      |         |         |                     |                     |

	| addons  | addons-094000 addons disable         | addons-094000        | jenkins | v1.34.0 | 12 Sep 24 14:41 PDT | 12 Sep 24 14:41 PDT |

	|         | yakd --alsologtostderr -v=1          |                      |         |         |                     |                     |

	| addons  | disable nvidia-device-plugin         | addons-094000        | jenkins | v1.34.0 | 12 Sep 24 14:41 PDT | 12 Sep 24 14:41 PDT |

	|         | -p addons-094000                     |                      |         |         |                     |                     |

	| ip      | addons-094000 ip                     | addons-094000        | jenkins | v1.34.0 | 12 Sep 24 14:41 PDT | 12 Sep 24 14:41 PDT |

	| addons  | addons-094000 addons disable         | addons-094000        | jenkins | v1.34.0 | 12 Sep 24 14:41 PDT | 12 Sep 24 14:41 PDT |

	|         | registry --alsologtostderr           |                      |         |         |                     |                     |

	|         | -v=1                                 |                      |         |         |                     |                     |

	|---------|--------------------------------------|----------------------|---------|---------|---------------------|---------------------|

	==> Last Start <==

	Log file created at: 2024/09/12 14:28:41

	Running on machine: MacOS-M1-Agent-2

	Binary: Built with gc go1.22.5 for darwin/arm64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0912 14:28:41.951014    1865 out.go:345] Setting OutFile to fd 1 ...

	I0912 14:28:41.951148    1865 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 14:28:41.951151    1865 out.go:358] Setting ErrFile to fd 2...

	I0912 14:28:41.951154    1865 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 14:28:41.951299    1865 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19616-1259/.minikube/bin

	I0912 14:28:41.952441    1865 out.go:352] Setting JSON to false

	I0912 14:28:41.968636    1865 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":1685,"bootTime":1726174836,"procs":459,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0912 14:28:41.968705    1865 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0912 14:28:41.973566    1865 out.go:177] * [addons-094000] minikube v1.34.0 on Darwin 14.5 (arm64)

	I0912 14:28:41.980541    1865 out.go:177]   - MINIKUBE_LOCATION=19616

	I0912 14:28:41.980578    1865 notify.go:220] Checking for updates...

	I0912 14:28:41.987602    1865 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19616-1259/kubeconfig

	I0912 14:28:41.990582    1865 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0912 14:28:41.993546    1865 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0912 14:28:41.996578    1865 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19616-1259/.minikube

	I0912 14:28:41.999520    1865 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0912 14:28:42.002734    1865 driver.go:394] Setting default libvirt URI to qemu:///system

	I0912 14:28:42.006595    1865 out.go:177] * Using the qemu2 driver based on user configuration

	I0912 14:28:42.013556    1865 start.go:297] selected driver: qemu2

	I0912 14:28:42.013561    1865 start.go:901] validating driver "qemu2" against <nil>

	I0912 14:28:42.013568    1865 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0912 14:28:42.015786    1865 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0912 14:28:42.018634    1865 out.go:177] * Automatically selected the socket_vmnet network

	I0912 14:28:42.021674    1865 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0912 14:28:42.021708    1865 cni.go:84] Creating CNI manager for ""

	I0912 14:28:42.021717    1865 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0912 14:28:42.021726    1865 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0912 14:28:42.021755    1865 start.go:340] cluster config:

	{Name:addons-094000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726156396-19616@sha256:66b06a42534e914a5c8ad765d7508a93a34031939ec9a6b3a818ef0a444ff889 Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-094000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:

docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_c

lient SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0912 14:28:42.025460    1865 iso.go:125] acquiring lock: {Name:mk3fa9c1c2a2731193a2e63235bbe8976497103e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0912 14:28:42.034612    1865 out.go:177] * Starting "addons-094000" primary control-plane node in "addons-094000" cluster

	I0912 14:28:42.038550    1865 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime docker

	I0912 14:28:42.038566    1865 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19616-1259/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4

	I0912 14:28:42.038577    1865 cache.go:56] Caching tarball of preloaded images

	I0912 14:28:42.038642    1865 preload.go:172] Found /Users/jenkins/minikube-integration/19616-1259/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0912 14:28:42.038653    1865 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on docker

	I0912 14:28:42.038893    1865 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/addons-094000/config.json ...

	I0912 14:28:42.038905    1865 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/addons-094000/config.json: {Name:mkc01a783ec489d0fcd9886914f67f3011b51814 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0912 14:28:42.039322    1865 start.go:360] acquireMachinesLock for addons-094000: {Name:mk18104440c14407e7206cb5d92d4872e7d20daa Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0912 14:28:42.039398    1865 start.go:364] duration metric: took 69.334µs to acquireMachinesLock for "addons-094000"

	I0912 14:28:42.039413    1865 start.go:93] Provisioning new machine with config: &{Name:addons-094000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19616/minikube-v1.34.0-1726156389-19616-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726156396-19616@sha256:66b06a42534e914a5c8ad765d7508a93a34031939ec9a6b3a818ef0a444ff889 Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kube

rnetesVersion:v1.31.1 ClusterName:addons-094000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mou

ntPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0912 14:28:42.039446    1865 start.go:125] createHost starting for "" (driver="qemu2")

	I0912 14:28:42.044607    1865 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	I0912 14:28:42.285005    1865 start.go:159] libmachine.API.Create for "addons-094000" (driver="qemu2")

	I0912 14:28:42.285039    1865 client.go:168] LocalClient.Create starting

	I0912 14:28:42.285230    1865 main.go:141] libmachine: Creating CA: /Users/jenkins/minikube-integration/19616-1259/.minikube/certs/ca.pem

	I0912 14:28:42.339175    1865 main.go:141] libmachine: Creating client certificate: /Users/jenkins/minikube-integration/19616-1259/.minikube/certs/cert.pem

	I0912 14:28:42.480044    1865 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19616-1259/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19616-1259/.minikube/cache/iso/arm64/minikube-v1.34.0-1726156389-19616-arm64.iso...

	I0912 14:28:43.238654    1865 main.go:141] libmachine: Creating SSH key...

	I0912 14:28:43.650138    1865 main.go:141] libmachine: Creating Disk image...

	I0912 14:28:43.650151    1865 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0912 14:28:43.650494    1865 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/addons-094000/disk.qcow2.raw /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/addons-094000/disk.qcow2

	I0912 14:28:43.669101    1865 main.go:141] libmachine: STDOUT: 

	I0912 14:28:43.669130    1865 main.go:141] libmachine: STDERR: 

	I0912 14:28:43.669193    1865 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/addons-094000/disk.qcow2 +20000M

	I0912 14:28:43.677665    1865 main.go:141] libmachine: STDOUT: Image resized.

	I0912 14:28:43.677679    1865 main.go:141] libmachine: STDERR: 

	I0912 14:28:43.677693    1865 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/addons-094000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/addons-094000/disk.qcow2

	I0912 14:28:43.677701    1865 main.go:141] libmachine: Starting QEMU VM...

	I0912 14:28:43.677741    1865 qemu.go:418] Using hvf for hardware acceleration

	I0912 14:28:43.677766    1865 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 4000 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/addons-094000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/addons-094000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/addons-094000/qemu.pid -device virtio-net-pci,netdev=net0,mac=76:98:84:b4:ed:b8 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/addons-094000/disk.qcow2

	I0912 14:28:43.739801    1865 main.go:141] libmachine: STDOUT: 

	I0912 14:28:43.739836    1865 main.go:141] libmachine: STDERR: 

	I0912 14:28:43.739840    1865 main.go:141] libmachine: Attempt 0

	I0912 14:28:43.739855    1865 main.go:141] libmachine: Searching for 76:98:84:b4:ed:b8 in /var/db/dhcpd_leases ...

	I0912 14:28:43.739910    1865 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I0912 14:28:43.739929    1865 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:aa:65:72:3a:1b:9b ID:1,aa:65:72:3a:1b:9b Lease:0x66e4ae52}

	I0912 14:28:45.742027    1865 main.go:141] libmachine: Attempt 1

	I0912 14:28:45.742101    1865 main.go:141] libmachine: Searching for 76:98:84:b4:ed:b8 in /var/db/dhcpd_leases ...

	I0912 14:28:45.742424    1865 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I0912 14:28:45.742475    1865 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:aa:65:72:3a:1b:9b ID:1,aa:65:72:3a:1b:9b Lease:0x66e4ae52}

	I0912 14:28:47.744820    1865 main.go:141] libmachine: Attempt 2

	I0912 14:28:47.744907    1865 main.go:141] libmachine: Searching for 76:98:84:b4:ed:b8 in /var/db/dhcpd_leases ...

	I0912 14:28:47.745138    1865 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I0912 14:28:47.745196    1865 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:aa:65:72:3a:1b:9b ID:1,aa:65:72:3a:1b:9b Lease:0x66e4ae52}

	I0912 14:28:49.746204    1865 main.go:141] libmachine: Attempt 3

	I0912 14:28:49.746227    1865 main.go:141] libmachine: Searching for 76:98:84:b4:ed:b8 in /var/db/dhcpd_leases ...

	I0912 14:28:49.746290    1865 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I0912 14:28:49.746303    1865 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:aa:65:72:3a:1b:9b ID:1,aa:65:72:3a:1b:9b Lease:0x66e4ae52}

	I0912 14:28:51.748304    1865 main.go:141] libmachine: Attempt 4

	I0912 14:28:51.748322    1865 main.go:141] libmachine: Searching for 76:98:84:b4:ed:b8 in /var/db/dhcpd_leases ...

	I0912 14:28:51.748405    1865 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I0912 14:28:51.748414    1865 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:aa:65:72:3a:1b:9b ID:1,aa:65:72:3a:1b:9b Lease:0x66e4ae52}

	I0912 14:28:53.750409    1865 main.go:141] libmachine: Attempt 5

	I0912 14:28:53.750417    1865 main.go:141] libmachine: Searching for 76:98:84:b4:ed:b8 in /var/db/dhcpd_leases ...

	I0912 14:28:53.750449    1865 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I0912 14:28:53.750456    1865 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:aa:65:72:3a:1b:9b ID:1,aa:65:72:3a:1b:9b Lease:0x66e4ae52}

	I0912 14:28:55.752486    1865 main.go:141] libmachine: Attempt 6

	I0912 14:28:55.752511    1865 main.go:141] libmachine: Searching for 76:98:84:b4:ed:b8 in /var/db/dhcpd_leases ...

	I0912 14:28:55.752591    1865 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I0912 14:28:55.752600    1865 main.go:141] libmachine: dhcp entry: {Name: IPAddress:192.168.106.2 HWAddress:aa:65:72:3a:1b:9b ID:1,aa:65:72:3a:1b:9b Lease:0x66e4ae52}

	I0912 14:28:57.754696    1865 main.go:141] libmachine: Attempt 7

	I0912 14:28:57.754768    1865 main.go:141] libmachine: Searching for 76:98:84:b4:ed:b8 in /var/db/dhcpd_leases ...

	I0912 14:28:57.755160    1865 main.go:141] libmachine: Found 2 entries in /var/db/dhcpd_leases!

	I0912 14:28:57.755212    1865 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:76:98:84:b4:ed:b8 ID:1,76:98:84:b4:ed:b8 Lease:0x66e4ae98}

	I0912 14:28:57.755228    1865 main.go:141] libmachine: Found match: 76:98:84:b4:ed:b8

	I0912 14:28:57.755262    1865 main.go:141] libmachine: IP: 192.168.105.2

	I0912 14:28:57.755285    1865 main.go:141] libmachine: Waiting for VM to start (ssh -p 22 docker@192.168.105.2)...

	I0912 14:29:00.777090    1865 machine.go:93] provisionDockerMachine start ...

	I0912 14:29:00.778450    1865 main.go:141] libmachine: Using SSH client type: native

	I0912 14:29:00.778922    1865 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1051ebba0] 0x1051ee400 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0912 14:29:00.778938    1865 main.go:141] libmachine: About to run SSH command:

	hostname

	I0912 14:29:00.849327    1865 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube

	I0912 14:29:00.849357    1865 buildroot.go:166] provisioning hostname "addons-094000"

	I0912 14:29:00.849479    1865 main.go:141] libmachine: Using SSH client type: native

	I0912 14:29:00.849715    1865 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1051ebba0] 0x1051ee400 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0912 14:29:00.849724    1865 main.go:141] libmachine: About to run SSH command:

	sudo hostname addons-094000 && echo "addons-094000" | sudo tee /etc/hostname

	I0912 14:29:00.908091    1865 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-094000

	I0912 14:29:00.908141    1865 main.go:141] libmachine: Using SSH client type: native

	I0912 14:29:00.908279    1865 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1051ebba0] 0x1051ee400 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0912 14:29:00.908288    1865 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\saddons-094000' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-094000/g' /etc/hosts;

				else 

					echo '127.0.1.1 addons-094000' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0912 14:29:00.958652    1865 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0912 14:29:00.958671    1865 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/19616-1259/.minikube CaCertPath:/Users/jenkins/minikube-integration/19616-1259/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/19616-1259/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/19616-1259/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/19616-1259/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/19616-1259/.minikube}

	I0912 14:29:00.958679    1865 buildroot.go:174] setting up certificates

	I0912 14:29:00.958683    1865 provision.go:84] configureAuth start

	I0912 14:29:00.958687    1865 provision.go:143] copyHostCerts

	I0912 14:29:00.958789    1865 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19616-1259/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/19616-1259/.minikube/ca.pem (1078 bytes)

	I0912 14:29:00.959039    1865 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19616-1259/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/19616-1259/.minikube/cert.pem (1123 bytes)

	I0912 14:29:00.959156    1865 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19616-1259/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/19616-1259/.minikube/key.pem (1675 bytes)

	I0912 14:29:00.959246    1865 provision.go:117] generating server cert: /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/19616-1259/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/19616-1259/.minikube/certs/ca-key.pem org=jenkins.addons-094000 san=[127.0.0.1 192.168.105.2 addons-094000 localhost minikube]

	I0912 14:29:01.040363    1865 provision.go:177] copyRemoteCerts

	I0912 14:29:01.040418    1865 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0912 14:29:01.040437    1865 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/addons-094000/id_rsa Username:docker}

	I0912 14:29:01.067422    1865 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19616-1259/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0912 14:29:01.075839    1865 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0912 14:29:01.083906    1865 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0912 14:29:01.092110    1865 provision.go:87] duration metric: took 133.419375ms to configureAuth

	I0912 14:29:01.092117    1865 buildroot.go:189] setting minikube options for container-runtime

	I0912 14:29:01.092218    1865 config.go:182] Loaded profile config "addons-094000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I0912 14:29:01.092252    1865 main.go:141] libmachine: Using SSH client type: native

	I0912 14:29:01.092336    1865 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1051ebba0] 0x1051ee400 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0912 14:29:01.092341    1865 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0912 14:29:01.141484    1865 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I0912 14:29:01.141492    1865 buildroot.go:70] root file system type: tmpfs

	I0912 14:29:01.141553    1865 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...

	I0912 14:29:01.141601    1865 main.go:141] libmachine: Using SSH client type: native

	I0912 14:29:01.141706    1865 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1051ebba0] 0x1051ee400 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0912 14:29:01.141739    1865 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %s "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0912 14:29:01.193048    1865 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0912 14:29:01.193098    1865 main.go:141] libmachine: Using SSH client type: native

	I0912 14:29:01.193213    1865 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1051ebba0] 0x1051ee400 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0912 14:29:01.193221    1865 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0912 14:29:02.560988    1865 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory

	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.

	I0912 14:29:02.561001    1865 machine.go:96] duration metric: took 1.783935708s to provisionDockerMachine

	I0912 14:29:02.561008    1865 client.go:171] duration metric: took 20.276556708s to LocalClient.Create

	I0912 14:29:02.561024    1865 start.go:167] duration metric: took 20.2766145s to libmachine.API.Create "addons-094000"

	I0912 14:29:02.561029    1865 start.go:293] postStartSetup for "addons-094000" (driver="qemu2")

	I0912 14:29:02.561037    1865 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0912 14:29:02.561118    1865 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0912 14:29:02.561128    1865 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/addons-094000/id_rsa Username:docker}

	I0912 14:29:02.587405    1865 ssh_runner.go:195] Run: cat /etc/os-release

	I0912 14:29:02.589186    1865 info.go:137] Remote host: Buildroot 2023.02.9

	I0912 14:29:02.589200    1865 filesync.go:126] Scanning /Users/jenkins/minikube-integration/19616-1259/.minikube/addons for local assets ...

	I0912 14:29:02.589297    1865 filesync.go:126] Scanning /Users/jenkins/minikube-integration/19616-1259/.minikube/files for local assets ...

	I0912 14:29:02.589328    1865 start.go:296] duration metric: took 28.296833ms for postStartSetup

	I0912 14:29:02.589721    1865 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/addons-094000/config.json ...

	I0912 14:29:02.589911    1865 start.go:128] duration metric: took 20.5510595s to createHost

	I0912 14:29:02.589937    1865 main.go:141] libmachine: Using SSH client type: native

	I0912 14:29:02.590027    1865 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1051ebba0] 0x1051ee400 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0912 14:29:02.590035    1865 main.go:141] libmachine: About to run SSH command:

	date +%s.%N

	I0912 14:29:02.637136    1865 main.go:141] libmachine: SSH cmd err, output: <nil>: 1726176542.977563086

	I0912 14:29:02.637147    1865 fix.go:216] guest clock: 1726176542.977563086

	I0912 14:29:02.637151    1865 fix.go:229] Guest: 2024-09-12 14:29:02.977563086 -0700 PDT Remote: 2024-09-12 14:29:02.589915 -0700 PDT m=+20.658409626 (delta=387.648086ms)

	I0912 14:29:02.637171    1865 fix.go:200] guest clock delta is within tolerance: 387.648086ms

	I0912 14:29:02.637174    1865 start.go:83] releasing machines lock for "addons-094000", held for 20.598371292s

	I0912 14:29:02.637457    1865 ssh_runner.go:195] Run: cat /version.json

	I0912 14:29:02.637459    1865 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0912 14:29:02.637466    1865 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/addons-094000/id_rsa Username:docker}

	I0912 14:29:02.637480    1865 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/addons-094000/id_rsa Username:docker}

	I0912 14:29:02.706237    1865 ssh_runner.go:195] Run: systemctl --version

	I0912 14:29:02.708694    1865 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0912 14:29:02.710880    1865 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0912 14:29:02.710913    1865 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0912 14:29:02.717414    1865 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0912 14:29:02.717423    1865 start.go:495] detecting cgroup driver to use...

	I0912 14:29:02.717537    1865 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0912 14:29:02.724025    1865 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"

	I0912 14:29:02.727787    1865 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I0912 14:29:02.731582    1865 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...

	I0912 14:29:02.731608    1865 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I0912 14:29:02.735462    1865 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0912 14:29:02.739510    1865 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I0912 14:29:02.743217    1865 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0912 14:29:02.747099    1865 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0912 14:29:02.750936    1865 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I0912 14:29:02.754713    1865 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"

	I0912 14:29:02.758248    1865 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1  enable_unprivileged_ports = true|' /etc/containerd/config.toml"

	I0912 14:29:02.761807    1865 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0912 14:29:02.764989    1865 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0912 14:29:02.768315    1865 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0912 14:29:02.841583    1865 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I0912 14:29:02.848242    1865 start.go:495] detecting cgroup driver to use...

	I0912 14:29:02.848290    1865 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0912 14:29:02.856022    1865 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0912 14:29:02.861503    1865 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0912 14:29:02.869138    1865 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0912 14:29:02.874317    1865 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0912 14:29:02.879453    1865 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I0912 14:29:02.923137    1865 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0912 14:29:02.929134    1865 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0912 14:29:02.935509    1865 ssh_runner.go:195] Run: which cri-dockerd

	I0912 14:29:02.936774    1865 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I0912 14:29:02.940223    1865 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (190 bytes)

	I0912 14:29:02.946214    1865 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I0912 14:29:03.013736    1865 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I0912 14:29:03.106718    1865 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...

	I0912 14:29:03.106788    1865 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)

	I0912 14:29:03.112716    1865 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0912 14:29:03.181665    1865 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0912 14:29:05.378744    1865 ssh_runner.go:235] Completed: sudo systemctl restart docker: (2.197126583s)

	I0912 14:29:05.378818    1865 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket

	I0912 14:29:05.384381    1865 ssh_runner.go:195] Run: sudo systemctl stop cri-docker.socket

	I0912 14:29:05.391493    1865 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service

	I0912 14:29:05.397003    1865 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I0912 14:29:05.465790    1865 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I0912 14:29:05.543960    1865 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0912 14:29:05.626618    1865 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I0912 14:29:05.633128    1865 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service

	I0912 14:29:05.638274    1865 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0912 14:29:05.706147    1865 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service

	I0912 14:29:05.731381    1865 start.go:542] Will wait 60s for socket path /var/run/cri-dockerd.sock

	I0912 14:29:05.731468    1865 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0912 14:29:05.734365    1865 start.go:563] Will wait 60s for crictl version

	I0912 14:29:05.734411    1865 ssh_runner.go:195] Run: which crictl

	I0912 14:29:05.736352    1865 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0912 14:29:05.756278    1865 start.go:579] Version:  0.1.0

	RuntimeName:  docker

	RuntimeVersion:  27.2.1

	RuntimeApiVersion:  v1

	I0912 14:29:05.756350    1865 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0912 14:29:05.767854    1865 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0912 14:29:05.782706    1865 out.go:235] * Preparing Kubernetes v1.31.1 on Docker 27.2.1 ...

	I0912 14:29:05.782859    1865 ssh_runner.go:195] Run: grep 192.168.105.1	host.minikube.internal$ /etc/hosts

	I0912 14:29:05.784209    1865 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.105.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0912 14:29:05.788398    1865 kubeadm.go:883] updating cluster {Name:addons-094000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19616/minikube-v1.34.0-1726156389-19616-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726156396-19616@sha256:66b06a42534e914a5c8ad765d7508a93a34031939ec9a6b3a818ef0a444ff889 Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31

.1 ClusterName:addons-094000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort

:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I0912 14:29:05.788450    1865 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime docker

	I0912 14:29:05.788493    1865 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0912 14:29:05.793793    1865 docker.go:685] Got preloaded images: 

	I0912 14:29:05.793800    1865 docker.go:691] registry.k8s.io/kube-apiserver:v1.31.1 wasn't preloaded

	I0912 14:29:05.793847    1865 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I0912 14:29:05.797256    1865 ssh_runner.go:195] Run: which lz4

	I0912 14:29:05.798605    1865 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4

	I0912 14:29:05.800231    1865 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I0912 14:29:05.800242    1865 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19616-1259/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4 --> /preloaded.tar.lz4 (322160019 bytes)

	I0912 14:29:07.043723    1865 docker.go:649] duration metric: took 1.245184084s to copy over tarball

	I0912 14:29:07.043780    1865 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4

	I0912 14:29:07.989067    1865 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I0912 14:29:08.003678    1865 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I0912 14:29:08.007700    1865 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2631 bytes)

	I0912 14:29:08.013770    1865 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0912 14:29:08.098335    1865 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0912 14:29:10.856729    1865 ssh_runner.go:235] Completed: sudo systemctl restart docker: (2.758457375s)

	I0912 14:29:10.856828    1865 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0912 14:29:10.863021    1865 docker.go:685] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.31.1

	registry.k8s.io/kube-scheduler:v1.31.1

	registry.k8s.io/kube-controller-manager:v1.31.1

	registry.k8s.io/kube-proxy:v1.31.1

	registry.k8s.io/coredns/coredns:v1.11.3

	registry.k8s.io/etcd:3.5.15-0

	registry.k8s.io/pause:3.10

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I0912 14:29:10.863040    1865 cache_images.go:84] Images are preloaded, skipping loading

	I0912 14:29:10.863045    1865 kubeadm.go:934] updating node { 192.168.105.2 8443 v1.31.1 docker true true} ...

	I0912 14:29:10.863109    1865 kubeadm.go:946] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.31.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=addons-094000 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.105.2

	[Install]

	 config:

	{KubernetesVersion:v1.31.1 ClusterName:addons-094000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0912 14:29:10.863181    1865 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I0912 14:29:10.884828    1865 cni.go:84] Creating CNI manager for ""

	I0912 14:29:10.884841    1865 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0912 14:29:10.884849    1865 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16

	I0912 14:29:10.884858    1865 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.105.2 APIServerPort:8443 KubernetesVersion:v1.31.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-094000 NodeName:addons-094000 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.105.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.105.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/ku

bernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/cri-dockerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I0912 14:29:10.884914    1865 kubeadm.go:187] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.105.2

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/cri-dockerd.sock

	  name: "addons-094000"

	  kubeletExtraArgs:

	    node-ip: 192.168.105.2

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.105.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.31.1

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/cri-dockerd.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%"

	  nodefs.inodesFree: "0%"

	  imagefs.available: "0%"

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0912 14:29:10.884963    1865 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.1

	I0912 14:29:10.888629    1865 binaries.go:44] Found k8s binaries, skipping transfer

	I0912 14:29:10.888659    1865 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0912 14:29:10.892102    1865 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (313 bytes)

	I0912 14:29:10.897811    1865 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0912 14:29:10.903649    1865 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2158 bytes)

	I0912 14:29:10.910848    1865 ssh_runner.go:195] Run: grep 192.168.105.2	control-plane.minikube.internal$ /etc/hosts

	I0912 14:29:10.912091    1865 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.105.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0912 14:29:10.916189    1865 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0912 14:29:10.986682    1865 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0912 14:29:10.993518    1865 certs.go:68] Setting up /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/addons-094000 for IP: 192.168.105.2

	I0912 14:29:10.993527    1865 certs.go:194] generating shared ca certs ...

	I0912 14:29:10.993549    1865 certs.go:226] acquiring lock for ca certs: {Name:mkbb0c3f29ef431420fb2bc7ce1073854ddb346b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0912 14:29:10.993734    1865 certs.go:240] generating "minikubeCA" ca cert: /Users/jenkins/minikube-integration/19616-1259/.minikube/ca.key

	I0912 14:29:11.048755    1865 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/19616-1259/.minikube/ca.crt ...

	I0912 14:29:11.048765    1865 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19616-1259/.minikube/ca.crt: {Name:mkaed199b4d59b979240a0906f967519ceb76f24 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0912 14:29:11.049069    1865 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/19616-1259/.minikube/ca.key ...

	I0912 14:29:11.049073    1865 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19616-1259/.minikube/ca.key: {Name:mk6feac05879b259cfe898af73a36e26bd5df1ea Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0912 14:29:11.049201    1865 certs.go:240] generating "proxyClientCA" ca cert: /Users/jenkins/minikube-integration/19616-1259/.minikube/proxy-client-ca.key

	I0912 14:29:11.261671    1865 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/19616-1259/.minikube/proxy-client-ca.crt ...

	I0912 14:29:11.261686    1865 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19616-1259/.minikube/proxy-client-ca.crt: {Name:mk9cf18e475be95ea270df31e7aaf1d39d38763c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0912 14:29:11.261991    1865 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/19616-1259/.minikube/proxy-client-ca.key ...

	I0912 14:29:11.261997    1865 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19616-1259/.minikube/proxy-client-ca.key: {Name:mke2c489038728660521db042e68ac84a99598dd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0912 14:29:11.262123    1865 certs.go:256] generating profile certs ...

	I0912 14:29:11.262164    1865 certs.go:363] generating signed profile cert for "minikube-user": /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/addons-094000/client.key

	I0912 14:29:11.262172    1865 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/addons-094000/client.crt with IP's: []

	I0912 14:29:11.314311    1865 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/addons-094000/client.crt ...

	I0912 14:29:11.314315    1865 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/addons-094000/client.crt: {Name:mka32657a69ed02d5ae8c19d6e1418a0cfee4064 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0912 14:29:11.314450    1865 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/addons-094000/client.key ...

	I0912 14:29:11.314454    1865 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/addons-094000/client.key: {Name:mk6e7534f08996607bace12e064d9140988786b8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0912 14:29:11.314563    1865 certs.go:363] generating signed profile cert for "minikube": /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/addons-094000/apiserver.key.17c4c0d1

	I0912 14:29:11.314575    1865 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/addons-094000/apiserver.crt.17c4c0d1 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.105.2]

	I0912 14:29:11.424468    1865 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/addons-094000/apiserver.crt.17c4c0d1 ...

	I0912 14:29:11.424472    1865 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/addons-094000/apiserver.crt.17c4c0d1: {Name:mk3ed0cb2455d450cd6548f6587957855db72a73 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0912 14:29:11.424627    1865 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/addons-094000/apiserver.key.17c4c0d1 ...

	I0912 14:29:11.424630    1865 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/addons-094000/apiserver.key.17c4c0d1: {Name:mk88c1c6aaf9a2029def1314e15a68f769bc6405 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0912 14:29:11.424742    1865 certs.go:381] copying /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/addons-094000/apiserver.crt.17c4c0d1 -> /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/addons-094000/apiserver.crt

	I0912 14:29:11.424939    1865 certs.go:385] copying /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/addons-094000/apiserver.key.17c4c0d1 -> /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/addons-094000/apiserver.key

	I0912 14:29:11.425084    1865 certs.go:363] generating signed profile cert for "aggregator": /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/addons-094000/proxy-client.key

	I0912 14:29:11.425096    1865 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/addons-094000/proxy-client.crt with IP's: []

	I0912 14:29:11.657489    1865 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/addons-094000/proxy-client.crt ...

	I0912 14:29:11.657496    1865 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/addons-094000/proxy-client.crt: {Name:mk7da494d1c2654c07b88649e2779734c54eb17b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0912 14:29:11.657686    1865 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/addons-094000/proxy-client.key ...

	I0912 14:29:11.657689    1865 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/addons-094000/proxy-client.key: {Name:mka87d438b66e0aa8b9a971f4f4a41007550d8cb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0912 14:29:11.657949    1865 certs.go:484] found cert: /Users/jenkins/minikube-integration/19616-1259/.minikube/certs/ca-key.pem (1679 bytes)

	I0912 14:29:11.657989    1865 certs.go:484] found cert: /Users/jenkins/minikube-integration/19616-1259/.minikube/certs/ca.pem (1078 bytes)

	I0912 14:29:11.658020    1865 certs.go:484] found cert: /Users/jenkins/minikube-integration/19616-1259/.minikube/certs/cert.pem (1123 bytes)

	I0912 14:29:11.658046    1865 certs.go:484] found cert: /Users/jenkins/minikube-integration/19616-1259/.minikube/certs/key.pem (1675 bytes)

	I0912 14:29:11.658563    1865 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19616-1259/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0912 14:29:11.669167    1865 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19616-1259/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I0912 14:29:11.681514    1865 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19616-1259/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0912 14:29:11.690407    1865 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19616-1259/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I0912 14:29:11.698741    1865 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/addons-094000/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)

	I0912 14:29:11.707058    1865 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/addons-094000/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I0912 14:29:11.715302    1865 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/addons-094000/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0912 14:29:11.723436    1865 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/addons-094000/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I0912 14:29:11.731738    1865 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19616-1259/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0912 14:29:11.739966    1865 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0912 14:29:11.746603    1865 ssh_runner.go:195] Run: openssl version

	I0912 14:29:11.749193    1865 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0912 14:29:11.753239    1865 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0912 14:29:11.754674    1865 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 12 21:29 /usr/share/ca-certificates/minikubeCA.pem

	I0912 14:29:11.754700    1865 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0912 14:29:11.756826    1865 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0912 14:29:11.760586    1865 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0912 14:29:11.761984    1865 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0912 14:29:11.762026    1865 kubeadm.go:392] StartCluster: {Name:addons-094000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19616/minikube-v1.34.0-1726156389-19616-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726156396-19616@sha256:66b06a42534e914a5c8ad765d7508a93a34031939ec9a6b3a818ef0a444ff889 Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1

ClusterName:addons-094000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0

MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0912 14:29:11.762091    1865 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0912 14:29:11.767749    1865 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0912 14:29:11.771710    1865 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0912 14:29:11.775256    1865 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0912 14:29:11.778877    1865 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0912 14:29:11.778884    1865 kubeadm.go:157] found existing configuration files:

	I0912 14:29:11.778906    1865 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf

	I0912 14:29:11.782370    1865 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/admin.conf: No such file or directory

	I0912 14:29:11.782400    1865 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf

	I0912 14:29:11.785705    1865 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf

	I0912 14:29:11.788680    1865 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/kubelet.conf: No such file or directory

	I0912 14:29:11.788700    1865 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf

	I0912 14:29:11.792021    1865 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf

	I0912 14:29:11.795465    1865 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/controller-manager.conf: No such file or directory

	I0912 14:29:11.795484    1865 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I0912 14:29:11.799343    1865 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf

	I0912 14:29:11.802839    1865 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/scheduler.conf: No such file or directory

	I0912 14:29:11.802864    1865 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I0912 14:29:11.806538    1865 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"

	I0912 14:29:11.829076    1865 kubeadm.go:310] [init] Using Kubernetes version: v1.31.1

	I0912 14:29:11.829106    1865 kubeadm.go:310] [preflight] Running pre-flight checks

	I0912 14:29:11.870537    1865 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster

	I0912 14:29:11.870610    1865 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I0912 14:29:11.870687    1865 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'

	I0912 14:29:11.874829    1865 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I0912 14:29:11.883032    1865 out.go:235]   - Generating certificates and keys ...

	I0912 14:29:11.883067    1865 kubeadm.go:310] [certs] Using existing ca certificate authority

	I0912 14:29:11.883097    1865 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk

	I0912 14:29:12.084609    1865 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key

	I0912 14:29:12.272051    1865 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key

	I0912 14:29:12.312762    1865 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key

	I0912 14:29:12.394544    1865 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key

	I0912 14:29:12.490562    1865 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key

	I0912 14:29:12.490640    1865 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-094000 localhost] and IPs [192.168.105.2 127.0.0.1 ::1]

	I0912 14:29:12.678128    1865 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key

	I0912 14:29:12.678198    1865 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-094000 localhost] and IPs [192.168.105.2 127.0.0.1 ::1]

	I0912 14:29:12.918638    1865 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key

	I0912 14:29:12.974095    1865 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key

	I0912 14:29:13.026907    1865 kubeadm.go:310] [certs] Generating "sa" key and public key

	I0912 14:29:13.026942    1865 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I0912 14:29:13.127768    1865 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file

	I0912 14:29:13.164687    1865 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file

	I0912 14:29:13.292972    1865 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I0912 14:29:13.363155    1865 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I0912 14:29:13.529103    1865 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I0912 14:29:13.529259    1865 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I0912 14:29:13.530496    1865 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I0912 14:29:13.533836    1865 out.go:235]   - Booting up control plane ...

	I0912 14:29:13.533884    1865 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I0912 14:29:13.533936    1865 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I0912 14:29:13.533970    1865 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I0912 14:29:13.538478    1865 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I0912 14:29:13.542323    1865 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I0912 14:29:13.542349    1865 kubeadm.go:310] [kubelet-start] Starting the kubelet

	I0912 14:29:13.627129    1865 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"

	I0912 14:29:13.627191    1865 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s

	I0912 14:29:14.137243    1865 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 509.952709ms

	I0912 14:29:14.137312    1865 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s

	I0912 14:29:17.640849    1865 kubeadm.go:310] [api-check] The API server is healthy after 3.503448544s

	I0912 14:29:17.666264    1865 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I0912 14:29:17.677201    1865 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I0912 14:29:17.693293    1865 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs

	I0912 14:29:17.693502    1865 kubeadm.go:310] [mark-control-plane] Marking the node addons-094000 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I0912 14:29:17.699742    1865 kubeadm.go:310] [bootstrap-token] Using token: xgnzgx.wk74o5l5ix4zgsac

	I0912 14:29:17.705987    1865 out.go:235]   - Configuring RBAC rules ...

	I0912 14:29:17.706078    1865 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I0912 14:29:17.707186    1865 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I0912 14:29:17.714282    1865 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I0912 14:29:17.715685    1865 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I0912 14:29:17.716974    1865 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I0912 14:29:17.718542    1865 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I0912 14:29:18.047024    1865 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I0912 14:29:18.455163    1865 kubeadm.go:310] [addons] Applied essential addon: CoreDNS

	I0912 14:29:19.052171    1865 kubeadm.go:310] [addons] Applied essential addon: kube-proxy

	I0912 14:29:19.052547    1865 kubeadm.go:310] 

	I0912 14:29:19.052574    1865 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!

	I0912 14:29:19.052578    1865 kubeadm.go:310] 

	I0912 14:29:19.052622    1865 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:

	I0912 14:29:19.052626    1865 kubeadm.go:310] 

	I0912 14:29:19.052637    1865 kubeadm.go:310]   mkdir -p $HOME/.kube

	I0912 14:29:19.052666    1865 kubeadm.go:310]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I0912 14:29:19.052692    1865 kubeadm.go:310]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I0912 14:29:19.052694    1865 kubeadm.go:310] 

	I0912 14:29:19.052718    1865 kubeadm.go:310] Alternatively, if you are the root user, you can run:

	I0912 14:29:19.052722    1865 kubeadm.go:310] 

	I0912 14:29:19.052744    1865 kubeadm.go:310]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I0912 14:29:19.052747    1865 kubeadm.go:310] 

	I0912 14:29:19.052771    1865 kubeadm.go:310] You should now deploy a pod network to the cluster.

	I0912 14:29:19.052820    1865 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I0912 14:29:19.052854    1865 kubeadm.go:310]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I0912 14:29:19.052857    1865 kubeadm.go:310] 

	I0912 14:29:19.052895    1865 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities

	I0912 14:29:19.052936    1865 kubeadm.go:310] and service account keys on each node and then running the following as root:

	I0912 14:29:19.052941    1865 kubeadm.go:310] 

	I0912 14:29:19.052983    1865 kubeadm.go:310]   kubeadm join control-plane.minikube.internal:8443 --token xgnzgx.wk74o5l5ix4zgsac \

	I0912 14:29:19.053048    1865 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:927739ba46076d32ef09500def7ebaf4576e192a933c1b27a78721d37c8894ab \

	I0912 14:29:19.053059    1865 kubeadm.go:310] 	--control-plane 

	I0912 14:29:19.053063    1865 kubeadm.go:310] 

	I0912 14:29:19.053105    1865 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:

	I0912 14:29:19.053108    1865 kubeadm.go:310] 

	I0912 14:29:19.053145    1865 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token xgnzgx.wk74o5l5ix4zgsac \

	I0912 14:29:19.053218    1865 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:927739ba46076d32ef09500def7ebaf4576e192a933c1b27a78721d37c8894ab 

	I0912 14:29:19.053348    1865 kubeadm.go:310] W0912 21:29:12.168534    1597 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "ClusterConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.

	I0912 14:29:19.053505    1865 kubeadm.go:310] W0912 21:29:12.168945    1597 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "InitConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.

	I0912 14:29:19.053566    1865 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I0912 14:29:19.053575    1865 cni.go:84] Creating CNI manager for ""

	I0912 14:29:19.053583    1865 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0912 14:29:19.060985    1865 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...

	I0912 14:29:19.065185    1865 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d

	I0912 14:29:19.069075    1865 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (496 bytes)

	I0912 14:29:19.075301    1865 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0912 14:29:19.075352    1865 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0912 14:29:19.075413    1865 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-094000 minikube.k8s.io/updated_at=2024_09_12T14_29_19_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=f6bc674a17941874d4e5b792b09c1791d30622b8 minikube.k8s.io/name=addons-094000 minikube.k8s.io/primary=true

	I0912 14:29:19.079239    1865 ops.go:34] apiserver oom_adj: -16

	I0912 14:29:19.136788    1865 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0912 14:29:19.638936    1865 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0912 14:29:20.138866    1865 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0912 14:29:20.638865    1865 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0912 14:29:21.138453    1865 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0912 14:29:21.639015    1865 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0912 14:29:22.138850    1865 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0912 14:29:22.636868    1865 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0912 14:29:23.138910    1865 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0912 14:29:23.638729    1865 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0912 14:29:23.679559    1865 kubeadm.go:1113] duration metric: took 4.604382167s to wait for elevateKubeSystemPrivileges

	I0912 14:29:23.679576    1865 kubeadm.go:394] duration metric: took 11.917897833s to StartCluster

	I0912 14:29:23.679585    1865 settings.go:142] acquiring lock: {Name:mk5a46170b8bd524e48b63472100abbce9e9531f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0912 14:29:23.679753    1865 settings.go:150] Updating kubeconfig:  /Users/jenkins/minikube-integration/19616-1259/kubeconfig

	I0912 14:29:23.679979    1865 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19616-1259/kubeconfig: {Name:mk048c749582c7be36b3ac030be68b87cf483b70 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0912 14:29:23.680210    1865 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0912 14:29:23.680231    1865 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.105.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0912 14:29:23.680276    1865 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]

	I0912 14:29:23.680321    1865 addons.go:69] Setting yakd=true in profile "addons-094000"

	I0912 14:29:23.680328    1865 config.go:182] Loaded profile config "addons-094000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I0912 14:29:23.680333    1865 addons.go:234] Setting addon yakd=true in "addons-094000"

	I0912 14:29:23.680346    1865 host.go:66] Checking if "addons-094000" exists ...

	I0912 14:29:23.680359    1865 addons.go:69] Setting storage-provisioner=true in profile "addons-094000"

	I0912 14:29:23.680367    1865 addons.go:234] Setting addon storage-provisioner=true in "addons-094000"

	I0912 14:29:23.680377    1865 host.go:66] Checking if "addons-094000" exists ...

	I0912 14:29:23.680391    1865 addons.go:69] Setting inspektor-gadget=true in profile "addons-094000"

	I0912 14:29:23.680404    1865 addons.go:234] Setting addon inspektor-gadget=true in "addons-094000"

	I0912 14:29:23.680417    1865 host.go:66] Checking if "addons-094000" exists ...

	I0912 14:29:23.680427    1865 addons.go:69] Setting volumesnapshots=true in profile "addons-094000"

	I0912 14:29:23.680433    1865 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-094000"

	I0912 14:29:23.680464    1865 addons.go:234] Setting addon volumesnapshots=true in "addons-094000"

	I0912 14:29:23.680472    1865 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-094000"

	I0912 14:29:23.680497    1865 host.go:66] Checking if "addons-094000" exists ...

	I0912 14:29:23.680506    1865 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-094000"

	I0912 14:29:23.680466    1865 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-094000"

	I0912 14:29:23.680554    1865 host.go:66] Checking if "addons-094000" exists ...

	I0912 14:29:23.680653    1865 addons.go:69] Setting registry=true in profile "addons-094000"

	I0912 14:29:23.680662    1865 addons.go:234] Setting addon registry=true in "addons-094000"

	I0912 14:29:23.680685    1865 addons.go:69] Setting default-storageclass=true in profile "addons-094000"

	I0912 14:29:23.680687    1865 host.go:66] Checking if "addons-094000" exists ...

	I0912 14:29:23.680689    1865 addons.go:69] Setting gcp-auth=true in profile "addons-094000"

	I0912 14:29:23.680692    1865 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-094000"

	I0912 14:29:23.680700    1865 mustload.go:65] Loading cluster: addons-094000

	I0912 14:29:23.680711    1865 retry.go:31] will retry after 564.195435ms: connect: dial unix /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/addons-094000/monitor: connect: connection refused

	I0912 14:29:23.680734    1865 retry.go:31] will retry after 781.719587ms: connect: dial unix /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/addons-094000/monitor: connect: connection refused

	I0912 14:29:23.680746    1865 retry.go:31] will retry after 752.499812ms: connect: dial unix /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/addons-094000/monitor: connect: connection refused

	I0912 14:29:23.680755    1865 addons.go:69] Setting cloud-spanner=true in profile "addons-094000"

	I0912 14:29:23.680759    1865 config.go:182] Loaded profile config "addons-094000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I0912 14:29:23.680770    1865 addons.go:234] Setting addon cloud-spanner=true in "addons-094000"

	I0912 14:29:23.680789    1865 host.go:66] Checking if "addons-094000" exists ...

	I0912 14:29:23.680826    1865 retry.go:31] will retry after 1.476367645s: connect: dial unix /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/addons-094000/monitor: connect: connection refused

	I0912 14:29:23.680832    1865 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-094000"

	I0912 14:29:23.680844    1865 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-094000"

	I0912 14:29:23.680864    1865 host.go:66] Checking if "addons-094000" exists ...

	I0912 14:29:23.680904    1865 retry.go:31] will retry after 1.316333876s: connect: dial unix /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/addons-094000/monitor: connect: connection refused

	I0912 14:29:23.680910    1865 addons.go:69] Setting metrics-server=true in profile "addons-094000"

	I0912 14:29:23.680916    1865 addons.go:234] Setting addon metrics-server=true in "addons-094000"

	I0912 14:29:23.680922    1865 host.go:66] Checking if "addons-094000" exists ...

	I0912 14:29:23.680989    1865 retry.go:31] will retry after 534.593184ms: connect: dial unix /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/addons-094000/monitor: connect: connection refused

	I0912 14:29:23.680992    1865 addons.go:69] Setting ingress=true in profile "addons-094000"

	I0912 14:29:23.681013    1865 addons.go:69] Setting ingress-dns=true in profile "addons-094000"

	I0912 14:29:23.681021    1865 addons.go:234] Setting addon ingress-dns=true in "addons-094000"

	I0912 14:29:23.681028    1865 addons.go:234] Setting addon ingress=true in "addons-094000"

	I0912 14:29:23.681063    1865 retry.go:31] will retry after 569.222915ms: connect: dial unix /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/addons-094000/monitor: connect: connection refused

	I0912 14:29:23.680448    1865 addons.go:69] Setting volcano=true in profile "addons-094000"

	I0912 14:29:23.681076    1865 addons.go:234] Setting addon volcano=true in "addons-094000"

	I0912 14:29:23.681084    1865 host.go:66] Checking if "addons-094000" exists ...

	I0912 14:29:23.681090    1865 retry.go:31] will retry after 918.9339ms: connect: dial unix /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/addons-094000/monitor: connect: connection refused

	I0912 14:29:23.681095    1865 host.go:66] Checking if "addons-094000" exists ...

	I0912 14:29:23.681031    1865 host.go:66] Checking if "addons-094000" exists ...

	I0912 14:29:23.681112    1865 retry.go:31] will retry after 758.865566ms: connect: dial unix /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/addons-094000/monitor: connect: connection refused

	I0912 14:29:23.681230    1865 retry.go:31] will retry after 523.501094ms: connect: dial unix /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/addons-094000/monitor: connect: connection refused

	I0912 14:29:23.681276    1865 retry.go:31] will retry after 516.708131ms: connect: dial unix /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/addons-094000/monitor: connect: connection refused

	I0912 14:29:23.681343    1865 retry.go:31] will retry after 1.152800392s: connect: dial unix /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/addons-094000/monitor: connect: connection refused

	I0912 14:29:23.681349    1865 retry.go:31] will retry after 841.283324ms: connect: dial unix /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/addons-094000/monitor: connect: connection refused

	I0912 14:29:23.683550    1865 out.go:177] * Verifying Kubernetes components...

	I0912 14:29:23.683950    1865 host.go:66] Checking if "addons-094000" exists ...

	I0912 14:29:23.688698    1865 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0912 14:29:23.692606    1865 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0912 14:29:23.696602    1865 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0912 14:29:23.696610    1865 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0912 14:29:23.696619    1865 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/addons-094000/id_rsa Username:docker}

	I0912 14:29:23.739375    1865 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.105.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0912 14:29:23.784075    1865 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0912 14:29:23.858930    1865 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0912 14:29:23.921866    1865 start.go:971] {"host.minikube.internal": 192.168.105.1} host record injected into CoreDNS's ConfigMap

	I0912 14:29:23.922336    1865 node_ready.go:35] waiting up to 6m0s for node "addons-094000" to be "Ready" ...

	I0912 14:29:23.923918    1865 node_ready.go:49] node "addons-094000" has status "Ready":"True"

	I0912 14:29:23.923926    1865 node_ready.go:38] duration metric: took 1.580458ms for node "addons-094000" to be "Ready" ...

	I0912 14:29:23.923930    1865 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0912 14:29:23.929292    1865 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-jzjzs" in "kube-system" namespace to be "Ready" ...

	I0912 14:29:24.233103    1865 out.go:177]   - Using image docker.io/volcanosh/vc-webhook-manager:v1.9.0

	I0912 14:29:24.239881    1865 out.go:177]   - Using image docker.io/volcanosh/vc-controller-manager:v1.9.0

	I0912 14:29:24.239885    1865 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0

	I0912 14:29:24.242980    1865 out.go:177]   - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0

	I0912 14:29:24.246246    1865 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-094000"

	I0912 14:29:24.246263    1865 host.go:66] Checking if "addons-094000" exists ...

	I0912 14:29:24.246997    1865 out.go:177]   - Using image docker.io/volcanosh/vc-scheduler:v1.9.0

	I0912 14:29:24.246998    1865 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0

	I0912 14:29:24.247000    1865 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml

	I0912 14:29:24.251208    1865 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)

	I0912 14:29:24.251218    1865 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/addons-094000/id_rsa Username:docker}

	I0912 14:29:24.250930    1865 out.go:177]   - Using image docker.io/rancher/local-path-provisioner:v0.0.22

	I0912 14:29:24.255411    1865 addons.go:431] installing /etc/kubernetes/addons/volcano-deployment.yaml

	I0912 14:29:24.255419    1865 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volcano-deployment.yaml (434001 bytes)

	I0912 14:29:24.255427    1865 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/addons-094000/id_rsa Username:docker}

	I0912 14:29:24.262986    1865 out.go:177]   - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.2

	I0912 14:29:24.266064    1865 out.go:177]   - Using image docker.io/busybox:stable

	I0912 14:29:24.266095    1865 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0

	I0912 14:29:24.269025    1865 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml

	I0912 14:29:24.269162    1865 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)

	I0912 14:29:24.269179    1865 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/addons-094000/id_rsa Username:docker}

	I0912 14:29:24.273033    1865 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml

	I0912 14:29:24.273041    1865 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)

	I0912 14:29:24.273047    1865 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/addons-094000/id_rsa Username:docker}

	I0912 14:29:24.281020    1865 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0

	I0912 14:29:24.287929    1865 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0

	I0912 14:29:24.294952    1865 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0

	I0912 14:29:24.300820    1865 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml

	I0912 14:29:24.301841    1865 out.go:177]   - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0

	I0912 14:29:24.308182    1865 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml

	I0912 14:29:24.308193    1865 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)

	I0912 14:29:24.310029    1865 out.go:177]   - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0

	I0912 14:29:24.312987    1865 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml

	I0912 14:29:24.312996    1865 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)

	I0912 14:29:24.313007    1865 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/addons-094000/id_rsa Username:docker}

	I0912 14:29:24.321406    1865 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml

	I0912 14:29:24.356717    1865 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml

	I0912 14:29:24.356731    1865 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)

	I0912 14:29:24.369224    1865 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml

	I0912 14:29:24.429730    1865 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-094000" context rescaled to 1 replicas

	I0912 14:29:24.443975    1865 out.go:177]   - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0

	I0912 14:29:24.448046    1865 addons.go:431] installing /etc/kubernetes/addons/ig-namespace.yaml

	I0912 14:29:24.448056    1865 ssh_runner.go:362] scp inspektor-gadget/ig-namespace.yaml --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)

	I0912 14:29:24.448068    1865 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/addons-094000/id_rsa Username:docker}

	I0912 14:29:24.448352    1865 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml

	I0912 14:29:24.448359    1865 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)

	I0912 14:29:24.453010    1865 out.go:177]   - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.2

	I0912 14:29:24.457045    1865 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml

	I0912 14:29:24.457056    1865 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)

	I0912 14:29:24.457067    1865 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/addons-094000/id_rsa Username:docker}

	I0912 14:29:24.467993    1865 out.go:177]   - Using image docker.io/marcnuri/yakd:0.0.5

	I0912 14:29:24.471984    1865 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml

	I0912 14:29:24.471992    1865 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)

	I0912 14:29:24.472002    1865 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/addons-094000/id_rsa Username:docker}

	I0912 14:29:24.472961    1865 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml

	I0912 14:29:24.472966    1865 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)

	I0912 14:29:24.495134    1865 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml

	I0912 14:29:24.495145    1865 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)

	I0912 14:29:24.529024    1865 out.go:177]   - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3

	I0912 14:29:24.533024    1865 addons.go:431] installing /etc/kubernetes/addons/ingress-dns-pod.yaml

	I0912 14:29:24.533032    1865 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)

	I0912 14:29:24.533042    1865 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/addons-094000/id_rsa Username:docker}

	I0912 14:29:24.540319    1865 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml

	I0912 14:29:24.540331    1865 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)

	I0912 14:29:24.550579    1865 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml

	I0912 14:29:24.550590    1865 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)

	I0912 14:29:24.603991    1865 out.go:177]   - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.23

	I0912 14:29:24.607005    1865 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml

	I0912 14:29:24.607013    1865 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)

	I0912 14:29:24.607024    1865 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/addons-094000/id_rsa Username:docker}

	I0912 14:29:24.607273    1865 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml

	I0912 14:29:24.607282    1865 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)

	I0912 14:29:24.609179    1865 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0912 14:29:24.609186    1865 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)

	I0912 14:29:24.617076    1865 addons.go:431] installing /etc/kubernetes/addons/ig-serviceaccount.yaml

	I0912 14:29:24.617091    1865 ssh_runner.go:362] scp inspektor-gadget/ig-serviceaccount.yaml --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)

	I0912 14:29:24.627724    1865 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml

	I0912 14:29:24.627733    1865 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)

	I0912 14:29:24.645719    1865 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml

	I0912 14:29:24.645733    1865 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)

	I0912 14:29:24.648250    1865 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml

	I0912 14:29:24.648263    1865 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)

	I0912 14:29:24.655036    1865 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml

	I0912 14:29:24.655045    1865 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)

	I0912 14:29:24.655151    1865 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0912 14:29:24.665819    1865 addons.go:431] installing /etc/kubernetes/addons/ig-role.yaml

	I0912 14:29:24.665834    1865 ssh_runner.go:362] scp inspektor-gadget/ig-role.yaml --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)

	I0912 14:29:24.697049    1865 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml

	I0912 14:29:24.697062    1865 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)

	I0912 14:29:24.708082    1865 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	I0912 14:29:24.712509    1865 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml

	I0912 14:29:24.712519    1865 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)

	I0912 14:29:24.715836    1865 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml

	I0912 14:29:24.715842    1865 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)

	I0912 14:29:24.719039    1865 addons.go:431] installing /etc/kubernetes/addons/ig-rolebinding.yaml

	I0912 14:29:24.719047    1865 ssh_runner.go:362] scp inspektor-gadget/ig-rolebinding.yaml --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)

	I0912 14:29:24.740862    1865 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml

	I0912 14:29:24.740878    1865 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)

	I0912 14:29:24.743723    1865 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml

	I0912 14:29:24.747601    1865 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/deployment.yaml

	I0912 14:29:24.755684    1865 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml

	I0912 14:29:24.755695    1865 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)

	I0912 14:29:24.760869    1865 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrole.yaml

	I0912 14:29:24.760880    1865 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrole.yaml --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)

	I0912 14:29:24.784395    1865 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml

	I0912 14:29:24.784405    1865 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)

	I0912 14:29:24.788352    1865 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml

	I0912 14:29:24.788360    1865 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrolebinding.yaml --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)

	I0912 14:29:24.788568    1865 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml

	I0912 14:29:24.788575    1865 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)

	I0912 14:29:24.840788    1865 out.go:177]   - Using image registry.k8s.io/ingress-nginx/controller:v1.11.2

	I0912 14:29:24.844888    1865 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3

	I0912 14:29:24.848863    1865 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3

	I0912 14:29:24.851878    1865 addons.go:431] installing /etc/kubernetes/addons/ingress-deploy.yaml

	I0912 14:29:24.851886    1865 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)

	I0912 14:29:24.851896    1865 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/addons-094000/id_rsa Username:docker}

	I0912 14:29:24.871946    1865 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml

	I0912 14:29:24.872035    1865 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml

	I0912 14:29:24.872044    1865 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)

	I0912 14:29:24.874913    1865 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml

	I0912 14:29:24.874920    1865 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)

	I0912 14:29:24.938339    1865 addons.go:431] installing /etc/kubernetes/addons/ig-daemonset.yaml

	I0912 14:29:24.938349    1865 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)

	I0912 14:29:25.003205    1865 out.go:177]   - Using image docker.io/registry:2.8.3

	I0912 14:29:25.010088    1865 out.go:177]   - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6

	I0912 14:29:25.014136    1865 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml

	I0912 14:29:25.014145    1865 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)

	I0912 14:29:25.014155    1865 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/addons-094000/id_rsa Username:docker}

	I0912 14:29:25.014413    1865 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml

	I0912 14:29:25.014418    1865 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)

	I0912 14:29:25.036112    1865 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml

	I0912 14:29:25.074187    1865 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml

	I0912 14:29:25.104733    1865 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml

	I0912 14:29:25.160150    1865 addons.go:234] Setting addon default-storageclass=true in "addons-094000"

	I0912 14:29:25.160173    1865 host.go:66] Checking if "addons-094000" exists ...

	I0912 14:29:25.160863    1865 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml

	I0912 14:29:25.160871    1865 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0912 14:29:25.160877    1865 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/addons-094000/id_rsa Username:docker}

	I0912 14:29:25.343426    1865 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml

	I0912 14:29:25.343438    1865 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)

	I0912 14:29:25.541771    1865 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml

	I0912 14:29:25.541782    1865 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)

	I0912 14:29:25.597986    1865 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0912 14:29:25.633548    1865 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml

	I0912 14:29:25.932835    1865 pod_ready.go:98] error getting pod "coredns-7c65d6cfc9-jzjzs" in "kube-system" namespace (skipping!): pods "coredns-7c65d6cfc9-jzjzs" not found

	I0912 14:29:25.932847    1865 pod_ready.go:82] duration metric: took 2.003601709s for pod "coredns-7c65d6cfc9-jzjzs" in "kube-system" namespace to be "Ready" ...

	E0912 14:29:25.932852    1865 pod_ready.go:67] WaitExtra: waitPodCondition: error getting pod "coredns-7c65d6cfc9-jzjzs" in "kube-system" namespace (skipping!): pods "coredns-7c65d6cfc9-jzjzs" not found

	I0912 14:29:25.932856    1865 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-vj2r9" in "kube-system" namespace to be "Ready" ...

	I0912 14:29:28.006778    1865 pod_ready.go:103] pod "coredns-7c65d6cfc9-vj2r9" in "kube-system" namespace has status "Ready":"False"

	I0912 14:29:28.535135    1865 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml: (4.234422125s)

	I0912 14:29:28.535148    1865 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (4.213853875s)

	I0912 14:29:28.535182    1865 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (4.166070292s)

	I0912 14:29:28.535224    1865 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (3.880179291s)

	W0912 14:29:28.535238    1865 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I0912 14:29:28.535254    1865 retry.go:31] will retry after 261.916588ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I0912 14:29:28.535265    1865 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (3.827283167s)

	I0912 14:29:28.535305    1865 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (3.791681792s)

	I0912 14:29:28.535351    1865 addons.go:475] Verifying addon metrics-server=true in "addons-094000"

	I0912 14:29:28.535366    1865 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (3.787865167s)

	I0912 14:29:28.535380    1865 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (3.663531584s)

	I0912 14:29:28.535484    1865 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (3.499460041s)

	I0912 14:29:28.540000    1865 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:

		minikube -p addons-094000 service yakd-dashboard -n yakd-dashboard

	I0912 14:29:28.797652    1865 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0912 14:29:28.901973    1865 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (3.797334333s)

	I0912 14:29:28.901993    1865 addons.go:475] Verifying addon ingress=true in "addons-094000"

	I0912 14:29:28.902000    1865 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (3.304097875s)

	I0912 14:29:28.902092    1865 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (3.827997584s)

	I0912 14:29:28.902104    1865 addons.go:475] Verifying addon csi-hostpath-driver=true in "addons-094000"

	I0912 14:29:28.902097    1865 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (3.2686035s)

	I0912 14:29:28.902154    1865 addons.go:475] Verifying addon registry=true in "addons-094000"

	I0912 14:29:28.906083    1865 out.go:177] * Verifying ingress addon...

	I0912 14:29:28.914997    1865 out.go:177] * Verifying csi-hostpath-driver addon...

	I0912 14:29:28.922950    1865 out.go:177] * Verifying registry addon...

	I0912 14:29:28.929400    1865 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...

	I0912 14:29:28.932444    1865 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...

	I0912 14:29:28.935384    1865 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...

	I0912 14:29:28.939809    1865 kapi.go:86] Found 0 Pods for label selector app.kubernetes.io/name=ingress-nginx

	I0912 14:29:28.940680    1865 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry

	I0912 14:29:28.940686    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:28.941081    1865 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver

	I0912 14:29:28.941087    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:28.948353    1865 pod_ready.go:93] pod "coredns-7c65d6cfc9-vj2r9" in "kube-system" namespace has status "Ready":"True"

	I0912 14:29:28.948363    1865 pod_ready.go:82] duration metric: took 3.015590958s for pod "coredns-7c65d6cfc9-vj2r9" in "kube-system" namespace to be "Ready" ...

	I0912 14:29:28.948370    1865 pod_ready.go:79] waiting up to 6m0s for pod "etcd-addons-094000" in "kube-system" namespace to be "Ready" ...

	I0912 14:29:29.437504    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:29.453452    1865 pod_ready.go:93] pod "etcd-addons-094000" in "kube-system" namespace has status "Ready":"True"

	I0912 14:29:29.453463    1865 pod_ready.go:82] duration metric: took 505.105042ms for pod "etcd-addons-094000" in "kube-system" namespace to be "Ready" ...

	I0912 14:29:29.453469    1865 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-addons-094000" in "kube-system" namespace to be "Ready" ...

	I0912 14:29:29.538218    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:29.934529    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:29.936954    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:30.434745    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:30.436697    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:30.694157    1865 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)

	I0912 14:29:30.694176    1865 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/addons-094000/id_rsa Username:docker}

	I0912 14:29:30.721345    1865 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)

	I0912 14:29:30.728101    1865 addons.go:234] Setting addon gcp-auth=true in "addons-094000"

	I0912 14:29:30.728127    1865 host.go:66] Checking if "addons-094000" exists ...

	I0912 14:29:30.728903    1865 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json

	I0912 14:29:30.728911    1865 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/addons-094000/id_rsa Username:docker}

	I0912 14:29:30.759430    1865 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3

	I0912 14:29:30.771024    1865 out.go:177]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2

	I0912 14:29:30.775342    1865 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml

	I0912 14:29:30.775348    1865 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)

	I0912 14:29:30.782319    1865 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml

	I0912 14:29:30.782326    1865 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)

	I0912 14:29:30.793662    1865 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I0912 14:29:30.793669    1865 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)

	I0912 14:29:30.804616    1865 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I0912 14:29:30.934485    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:30.936930    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:31.210901    1865 addons.go:475] Verifying addon gcp-auth=true in "addons-094000"

	I0912 14:29:31.264484    1865 out.go:177] * Verifying gcp-auth addon...

	I0912 14:29:31.273458    1865 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...

	I0912 14:29:31.274962    1865 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=gcp-auth

	I0912 14:29:31.434516    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:31.436828    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:31.457730    1865 pod_ready.go:103] pod "kube-apiserver-addons-094000" in "kube-system" namespace has status "Ready":"False"

	I0912 14:29:31.934382    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:31.936678    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:32.434694    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:32.436793    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:32.934878    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:32.936996    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:33.434367    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:33.436822    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:33.934338    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:33.936657    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:33.957564    1865 pod_ready.go:103] pod "kube-apiserver-addons-094000" in "kube-system" namespace has status "Ready":"False"

	I0912 14:29:34.458095    1865 pod_ready.go:93] pod "kube-apiserver-addons-094000" in "kube-system" namespace has status "Ready":"True"

	I0912 14:29:34.458109    1865 pod_ready.go:82] duration metric: took 5.004782s for pod "kube-apiserver-addons-094000" in "kube-system" namespace to be "Ready" ...

	I0912 14:29:34.458114    1865 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-addons-094000" in "kube-system" namespace to be "Ready" ...

	I0912 14:29:34.460154    1865 pod_ready.go:93] pod "kube-controller-manager-addons-094000" in "kube-system" namespace has status "Ready":"True"

	I0912 14:29:34.460163    1865 pod_ready.go:82] duration metric: took 2.045625ms for pod "kube-controller-manager-addons-094000" in "kube-system" namespace to be "Ready" ...

	I0912 14:29:34.460167    1865 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-vv56v" in "kube-system" namespace to be "Ready" ...

	I0912 14:29:34.462060    1865 pod_ready.go:93] pod "kube-proxy-vv56v" in "kube-system" namespace has status "Ready":"True"

	I0912 14:29:34.462069    1865 pod_ready.go:82] duration metric: took 1.898334ms for pod "kube-proxy-vv56v" in "kube-system" namespace to be "Ready" ...

	I0912 14:29:34.462073    1865 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-addons-094000" in "kube-system" namespace to be "Ready" ...

	I0912 14:29:34.466509    1865 pod_ready.go:93] pod "kube-scheduler-addons-094000" in "kube-system" namespace has status "Ready":"True"

	I0912 14:29:34.466520    1865 pod_ready.go:82] duration metric: took 4.442875ms for pod "kube-scheduler-addons-094000" in "kube-system" namespace to be "Ready" ...

	I0912 14:29:34.466524    1865 pod_ready.go:39] duration metric: took 10.542896625s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0912 14:29:34.466538    1865 api_server.go:52] waiting for apiserver process to appear ...

	I0912 14:29:34.466596    1865 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0912 14:29:34.473321    1865 api_server.go:72] duration metric: took 10.793392458s to wait for apiserver process to appear ...

	I0912 14:29:34.473332    1865 api_server.go:88] waiting for apiserver healthz status ...

	I0912 14:29:34.473340    1865 api_server.go:253] Checking apiserver healthz at https://192.168.105.2:8443/healthz ...

	I0912 14:29:34.477257    1865 api_server.go:279] https://192.168.105.2:8443/healthz returned 200:

	ok

	I0912 14:29:34.478065    1865 api_server.go:141] control plane version: v1.31.1

	I0912 14:29:34.478073    1865 api_server.go:131] duration metric: took 4.739083ms to wait for apiserver health ...

	I0912 14:29:34.478076    1865 system_pods.go:43] waiting for kube-system pods to appear ...

	I0912 14:29:34.533722    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:34.533939    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:34.536048    1865 system_pods.go:59] 17 kube-system pods found

	I0912 14:29:34.536054    1865 system_pods.go:61] "coredns-7c65d6cfc9-vj2r9" [98cfa77f-1c88-46db-967f-43edc1c3cd7a] Running

	I0912 14:29:34.536058    1865 system_pods.go:61] "csi-hostpath-attacher-0" [1bacd096-0ada-4927-8e97-f7f4305edf48] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])

	I0912 14:29:34.536064    1865 system_pods.go:61] "csi-hostpath-resizer-0" [57da50d3-51f7-4e26-a1b4-4f8a47885f44] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])

	I0912 14:29:34.536067    1865 system_pods.go:61] "csi-hostpathplugin-kc89b" [f6f7cdb2-0de4-418e-86a1-61f40d539e10] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])

	I0912 14:29:34.536069    1865 system_pods.go:61] "etcd-addons-094000" [c92eaa5d-2632-4961-b320-bef1f8b4161f] Running

	I0912 14:29:34.536072    1865 system_pods.go:61] "kube-apiserver-addons-094000" [0c1ba576-d537-4e5e-bd09-3f1656fe3e8a] Running

	I0912 14:29:34.536074    1865 system_pods.go:61] "kube-controller-manager-addons-094000" [8469aa0e-4d69-46b6-99f9-1a0956dceb76] Running

	I0912 14:29:34.536076    1865 system_pods.go:61] "kube-ingress-dns-minikube" [8277b4a6-0537-4126-9826-db38c49c189c] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])

	I0912 14:29:34.536078    1865 system_pods.go:61] "kube-proxy-vv56v" [42e0d765-f927-42ca-98ad-c355fd7dc961] Running

	I0912 14:29:34.536080    1865 system_pods.go:61] "kube-scheduler-addons-094000" [96fd4a75-3e95-47b2-865a-ab33d615831f] Running

	I0912 14:29:34.536083    1865 system_pods.go:61] "metrics-server-84c5f94fbc-kwgtm" [15370a23-e77e-4961-8c9d-79e7c4de4ce9] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0912 14:29:34.536085    1865 system_pods.go:61] "nvidia-device-plugin-daemonset-ccfkk" [0f414de0-66c3-4a20-adf0-75eebe79b9d9] Running

	I0912 14:29:34.536087    1865 system_pods.go:61] "registry-66c9cd494c-p5f26" [d42d83d3-de78-4a99-ab0d-4539040c1a33] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])

	I0912 14:29:34.536091    1865 system_pods.go:61] "registry-proxy-zh429" [21dafca9-6625-404e-9961-8c638a8f1694] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])

	I0912 14:29:34.536095    1865 system_pods.go:61] "snapshot-controller-56fcc65765-7dnm2" [82a2f59c-61f9-46b7-94bd-8db3908adefd] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0912 14:29:34.536098    1865 system_pods.go:61] "snapshot-controller-56fcc65765-sqxrf" [075a3de8-2bec-44fd-918f-2a67ad5c2a21] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0912 14:29:34.536100    1865 system_pods.go:61] "storage-provisioner" [ab0d9c24-6010-4db8-a714-76425506a864] Running

	I0912 14:29:34.536103    1865 system_pods.go:74] duration metric: took 58.0255ms to wait for pod list to return data ...

	I0912 14:29:34.536107    1865 default_sa.go:34] waiting for default service account to be created ...

	I0912 14:29:34.537162    1865 default_sa.go:45] found service account: "default"

	I0912 14:29:34.537167    1865 default_sa.go:55] duration metric: took 1.056958ms for default service account to be created ...

	I0912 14:29:34.537170    1865 system_pods.go:116] waiting for k8s-apps to be running ...

	I0912 14:29:34.663188    1865 system_pods.go:86] 17 kube-system pods found

	I0912 14:29:34.663199    1865 system_pods.go:89] "coredns-7c65d6cfc9-vj2r9" [98cfa77f-1c88-46db-967f-43edc1c3cd7a] Running

	I0912 14:29:34.663205    1865 system_pods.go:89] "csi-hostpath-attacher-0" [1bacd096-0ada-4927-8e97-f7f4305edf48] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])

	I0912 14:29:34.663209    1865 system_pods.go:89] "csi-hostpath-resizer-0" [57da50d3-51f7-4e26-a1b4-4f8a47885f44] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])

	I0912 14:29:34.663213    1865 system_pods.go:89] "csi-hostpathplugin-kc89b" [f6f7cdb2-0de4-418e-86a1-61f40d539e10] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])

	I0912 14:29:34.663216    1865 system_pods.go:89] "etcd-addons-094000" [c92eaa5d-2632-4961-b320-bef1f8b4161f] Running

	I0912 14:29:34.663219    1865 system_pods.go:89] "kube-apiserver-addons-094000" [0c1ba576-d537-4e5e-bd09-3f1656fe3e8a] Running

	I0912 14:29:34.663222    1865 system_pods.go:89] "kube-controller-manager-addons-094000" [8469aa0e-4d69-46b6-99f9-1a0956dceb76] Running

	I0912 14:29:34.663227    1865 system_pods.go:89] "kube-ingress-dns-minikube" [8277b4a6-0537-4126-9826-db38c49c189c] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])

	I0912 14:29:34.663229    1865 system_pods.go:89] "kube-proxy-vv56v" [42e0d765-f927-42ca-98ad-c355fd7dc961] Running

	I0912 14:29:34.663232    1865 system_pods.go:89] "kube-scheduler-addons-094000" [96fd4a75-3e95-47b2-865a-ab33d615831f] Running

	I0912 14:29:34.663236    1865 system_pods.go:89] "metrics-server-84c5f94fbc-kwgtm" [15370a23-e77e-4961-8c9d-79e7c4de4ce9] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0912 14:29:34.663239    1865 system_pods.go:89] "nvidia-device-plugin-daemonset-ccfkk" [0f414de0-66c3-4a20-adf0-75eebe79b9d9] Running

	I0912 14:29:34.663243    1865 system_pods.go:89] "registry-66c9cd494c-p5f26" [d42d83d3-de78-4a99-ab0d-4539040c1a33] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])

	I0912 14:29:34.663246    1865 system_pods.go:89] "registry-proxy-zh429" [21dafca9-6625-404e-9961-8c638a8f1694] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])

	I0912 14:29:34.663255    1865 system_pods.go:89] "snapshot-controller-56fcc65765-7dnm2" [82a2f59c-61f9-46b7-94bd-8db3908adefd] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0912 14:29:34.663260    1865 system_pods.go:89] "snapshot-controller-56fcc65765-sqxrf" [075a3de8-2bec-44fd-918f-2a67ad5c2a21] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0912 14:29:34.663262    1865 system_pods.go:89] "storage-provisioner" [ab0d9c24-6010-4db8-a714-76425506a864] Running

	I0912 14:29:34.663267    1865 system_pods.go:126] duration metric: took 126.09775ms to wait for k8s-apps to be running ...

	I0912 14:29:34.663272    1865 system_svc.go:44] waiting for kubelet service to be running ....

	I0912 14:29:34.663350    1865 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0912 14:29:34.670548    1865 system_svc.go:56] duration metric: took 7.273291ms WaitForService to wait for kubelet

	I0912 14:29:34.670559    1865 kubeadm.go:582] duration metric: took 10.990637166s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0912 14:29:34.670569    1865 node_conditions.go:102] verifying NodePressure condition ...

	I0912 14:29:34.859455    1865 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0912 14:29:34.859475    1865 node_conditions.go:123] node cpu capacity is 2

	I0912 14:29:34.859483    1865 node_conditions.go:105] duration metric: took 188.916584ms to run NodePressure ...

	I0912 14:29:34.859491    1865 start.go:241] waiting for startup goroutines ...

	I0912 14:29:34.934851    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:34.938176    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:35.435075    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:35.436667    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:35.935262    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:35.936862    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:36.434192    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:36.436573    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:36.934066    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:36.936623    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:37.434361    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:37.436939    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:37.934042    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:37.936851    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:38.434234    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:38.436641    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:38.934366    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:38.937686    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:39.434324    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:39.436753    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:39.934423    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:39.936697    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:40.434168    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:40.437580    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:40.936617    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:40.937545    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:41.434222    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:41.436369    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:41.934527    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:41.936411    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:42.434994    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:42.436936    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:42.934074    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:42.936511    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:43.433936    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:43.436488    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:43.937329    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:43.942933    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:44.434159    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:44.436567    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:44.935170    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:44.936948    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:45.434070    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:45.436536    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:45.934112    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:45.936462    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:46.433944    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:46.436502    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:46.933979    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:46.936653    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:47.433707    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:47.436730    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:47.934205    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:47.936687    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:48.434076    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:48.436215    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:48.933940    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:48.936344    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:49.574881    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:49.575033    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:49.933992    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:49.936497    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:50.437575    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:50.438205    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:50.933828    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:50.936303    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:51.434706    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:51.436590    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:51.933913    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:51.935932    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:52.433783    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:52.436320    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:53.147067    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:53.147327    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:53.435501    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:53.436937    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:53.935850    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:53.937008    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:54.433625    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:54.436041    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:54.934674    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:54.936579    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:55.433792    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:55.436034    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:55.933475    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:55.936349    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:56.434371    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:56.436154    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:56.933831    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:56.936053    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:57.434772    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:57.436517    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:57.934802    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:57.936650    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:58.433922    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:58.436388    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:58.933738    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:58.936142    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:59.433509    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:59.436166    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:29:59.933561    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:29:59.936076    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:30:00.433798    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:00.436117    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:30:00.933543    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:00.935942    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:30:01.433849    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:01.435883    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0912 14:30:01.936031    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:01.937010    1865 kapi.go:107] duration metric: took 33.0025875s to wait for kubernetes.io/minikube-addons=registry ...

	I0912 14:30:02.435530    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:02.934231    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:03.433509    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:03.933483    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:04.433468    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:04.934833    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:05.434261    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:05.933494    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:06.433091    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:06.933146    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:07.433266    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:07.933421    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:08.434602    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:08.933685    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:09.432930    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:09.933380    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:10.435519    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:10.933364    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:11.433184    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:11.933395    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:12.433124    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:12.933859    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:13.438824    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:13.933340    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:14.433540    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:14.933204    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:15.434770    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:15.933026    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:16.433183    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:16.933051    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:17.433149    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:17.933116    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:18.433453    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:18.932789    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:19.433256    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:19.934719    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:20.432931    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:20.932859    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:21.432915    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:22.003515    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:22.435174    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:22.936253    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:23.432959    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:23.932818    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:24.433170    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:24.938247    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0912 14:30:25.443715    1865 kapi.go:107] duration metric: took 56.512890583s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...

	I0912 14:30:50.931690    1865 kapi.go:86] Found 1 Pods for label selector app.kubernetes.io/name=ingress-nginx

	I0912 14:30:50.931705    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:30:51.431461    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:30:51.932734    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:30:52.432983    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:30:52.930975    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:30:53.429515    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:30:53.775109    1865 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth

	I0912 14:30:53.775119    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:30:53.930965    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:30:54.276057    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:30:54.430673    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:30:54.775470    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:30:54.931276    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:30:55.279709    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:30:55.431899    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:30:55.776290    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:30:55.937272    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:30:56.276036    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:30:56.431021    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:30:56.775961    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:30:56.934558    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:30:57.279336    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:30:57.431528    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:30:57.776044    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:30:57.932404    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:30:58.279480    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:30:58.435701    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:30:58.775528    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:30:58.930519    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:30:59.275029    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:30:59.431612    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:30:59.774387    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:30:59.930777    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:00.278752    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:00.437891    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:00.775209    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:00.930879    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:01.277224    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:01.433048    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:01.776063    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:01.933877    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:02.274630    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:02.433375    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:02.775954    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:02.934647    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:03.278465    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:03.432875    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:03.775295    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:03.931085    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:04.276651    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:04.434345    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:04.775975    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:04.930558    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:05.274376    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:05.430756    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:05.774397    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:05.930894    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:06.274449    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:06.430148    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:06.775307    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:06.930657    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:07.279372    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:07.432348    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:07.775672    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:07.931378    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:08.279287    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:08.435784    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:08.774637    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:08.928950    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:09.275313    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:09.432630    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:09.777009    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:09.933167    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:10.280159    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:10.431122    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:10.775641    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:10.931544    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:11.278818    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:11.432143    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:11.780341    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:11.931403    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:12.280407    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:12.435880    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:12.779712    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:12.934793    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:13.279945    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:13.436625    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:13.776192    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:13.931495    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:14.277834    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:14.437611    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:14.776072    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:14.929455    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:15.273368    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:15.430874    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:15.774319    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:15.929286    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:16.274121    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:16.429756    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:16.774926    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:16.930730    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:17.275830    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:17.433530    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:17.777442    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:17.931549    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:18.279615    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:18.436432    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:18.774114    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:18.930132    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:19.275741    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:19.431833    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:19.776841    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:19.932647    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:20.278719    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:20.432943    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:20.776417    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:20.931425    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:21.280491    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:21.431635    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:21.778634    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:21.940623    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:22.277243    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:22.434156    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:22.776635    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:22.933251    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:23.275900    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:23.431637    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:23.773903    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:23.929701    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:24.279640    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:24.430888    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:24.776096    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:24.930126    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:25.279647    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:25.431664    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:25.775737    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:25.929363    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:26.274822    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:26.429844    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:26.775403    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:26.930570    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:27.275954    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:27.430908    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:27.774290    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:27.928663    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:28.278350    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:28.433638    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:28.774084    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:28.929985    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:29.274926    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:29.429724    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:29.774474    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:29.930095    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:30.276936    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:30.434589    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:30.773426    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:30.931167    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:31.285928    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:31.438556    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:31.774421    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:31.930413    1865 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx

	I0912 14:31:31.930422    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:32.273785    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:32.430041    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:32.773611    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:32.930146    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:33.273859    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:33.430933    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:33.773561    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:33.929759    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:34.273631    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:34.430238    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:34.773622    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:34.927950    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:35.273823    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:35.430151    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:35.774284    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:35.930128    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:36.273821    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:36.429892    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:36.775136    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:36.932179    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:37.273188    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:37.429863    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:37.773795    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:37.930342    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:38.273729    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:38.429989    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:38.772788    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:38.930699    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:39.273517    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:39.429322    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:39.773756    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:39.930993    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:40.274476    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:40.432092    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:40.777879    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:40.931752    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:41.274919    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:41.432172    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:41.776144    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:41.930619    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:42.275142    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:42.429645    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:42.774436    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:42.932649    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:43.285753    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:43.432733    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:43.775719    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:43.931009    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:44.277868    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:44.429990    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:44.773815    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:44.931132    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:45.276852    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:45.431635    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:45.774971    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:45.929300    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:46.273263    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:46.430027    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:46.774792    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:46.932167    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:47.274286    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:47.429675    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:47.774357    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:47.931323    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:48.277309    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:48.431243    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:48.773757    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:48.929856    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:49.273870    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:49.429971    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:49.774623    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:49.930517    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:50.279607    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:50.432492    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:50.774639    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:50.931015    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:51.277040    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:51.434188    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:51.773806    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:51.932903    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:52.278475    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:52.438558    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:52.775460    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:52.932695    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:53.276575    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:53.432830    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:53.773866    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:53.930164    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:54.277564    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:54.433477    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:54.773757    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:54.929354    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:55.273093    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:55.429526    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:55.772806    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:55.929533    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:56.273126    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:56.429233    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:56.773675    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:56.929343    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:57.273071    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:57.428594    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:57.773116    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:57.929705    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:58.273149    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:58.429621    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:58.771872    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:58.930546    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:59.272806    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:59.428946    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:31:59.771978    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:31:59.929329    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:32:00.272873    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:32:00.429278    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:32:00.772516    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:32:00.929146    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:32:01.272967    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:32:01.429144    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:32:01.772871    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:32:01.929423    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:32:02.275282    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:32:02.429811    1865 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0912 14:32:02.772979    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:32:02.929572    1865 kapi.go:107] duration metric: took 2m34.004659458s to wait for app.kubernetes.io/name=ingress-nginx ...

	I0912 14:32:03.273058    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:32:03.772889    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:32:04.273128    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:32:04.772729    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:32:05.272728    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:32:05.772785    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:32:06.273305    1865 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0912 14:32:06.772747    1865 kapi.go:107] duration metric: took 2m35.503821666s to wait for kubernetes.io/minikube-addons=gcp-auth ...

	I0912 14:32:06.777482    1865 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-094000 cluster.

	I0912 14:32:06.783391    1865 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.

	I0912 14:32:06.789422    1865 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.

	I0912 14:32:06.794351    1865 out.go:177] * Enabled addons: storage-provisioner, volcano, nvidia-device-plugin, ingress-dns, metrics-server, cloud-spanner, inspektor-gadget, yakd, storage-provisioner-rancher, default-storageclass, volumesnapshots, registry, csi-hostpath-driver, ingress, gcp-auth

	I0912 14:32:06.798364    1865 addons.go:510] duration metric: took 2m43.12286225s for enable addons: enabled=[storage-provisioner volcano nvidia-device-plugin ingress-dns metrics-server cloud-spanner inspektor-gadget yakd storage-provisioner-rancher default-storageclass volumesnapshots registry csi-hostpath-driver ingress gcp-auth]

	I0912 14:32:06.798378    1865 start.go:246] waiting for cluster config update ...

	I0912 14:32:06.798386    1865 start.go:255] writing updated cluster config ...

	I0912 14:32:06.798815    1865 ssh_runner.go:195] Run: rm -f paused

	I0912 14:32:06.947505    1865 start.go:600] kubectl: 1.29.2, cluster: 1.31.1 (minor skew: 2)

	I0912 14:32:06.954427    1865 out.go:201] 

	W0912 14:32:06.958456    1865 out.go:270] ! /usr/local/bin/kubectl is version 1.29.2, which may have incompatibilities with Kubernetes 1.31.1.

	I0912 14:32:06.961390    1865 out.go:177]   - Want kubectl v1.31.1? Try 'minikube kubectl -- get pods -A'

	I0912 14:32:06.969247    1865 out.go:177] * Done! kubectl is now configured to use "addons-094000" cluster and "default" namespace by default

	==> Docker <==

	Sep 12 21:41:56 addons-094000 dockerd[1289]: time="2024-09-12T21:41:56.803202947Z" level=info msg="cleaning up dead shim" namespace=moby

	Sep 12 21:41:58 addons-094000 dockerd[1282]: time="2024-09-12T21:41:58.866794089Z" level=info msg="ignoring event" container=9eda0bbc3d9a26910b1ba74c58ee34a54a1ed25461109155b9f3a8f24a9d3c03 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 12 21:41:58 addons-094000 dockerd[1289]: time="2024-09-12T21:41:58.867130557Z" level=info msg="shim disconnected" id=9eda0bbc3d9a26910b1ba74c58ee34a54a1ed25461109155b9f3a8f24a9d3c03 namespace=moby

	Sep 12 21:41:58 addons-094000 dockerd[1289]: time="2024-09-12T21:41:58.867164279Z" level=warning msg="cleaning up after shim disconnected" id=9eda0bbc3d9a26910b1ba74c58ee34a54a1ed25461109155b9f3a8f24a9d3c03 namespace=moby

	Sep 12 21:41:58 addons-094000 dockerd[1289]: time="2024-09-12T21:41:58.867169072Z" level=info msg="cleaning up dead shim" namespace=moby

	Sep 12 21:41:58 addons-094000 dockerd[1289]: time="2024-09-12T21:41:58.883288331Z" level=info msg="shim disconnected" id=0de37e2aa27a6cd86bbe8527ca713f09366dacdab7d5d62119b0f4da39eb0b3e namespace=moby

	Sep 12 21:41:58 addons-094000 dockerd[1289]: time="2024-09-12T21:41:58.883375116Z" level=warning msg="cleaning up after shim disconnected" id=0de37e2aa27a6cd86bbe8527ca713f09366dacdab7d5d62119b0f4da39eb0b3e namespace=moby

	Sep 12 21:41:58 addons-094000 dockerd[1289]: time="2024-09-12T21:41:58.883380493Z" level=info msg="cleaning up dead shim" namespace=moby

	Sep 12 21:41:58 addons-094000 dockerd[1282]: time="2024-09-12T21:41:58.883602791Z" level=info msg="ignoring event" container=0de37e2aa27a6cd86bbe8527ca713f09366dacdab7d5d62119b0f4da39eb0b3e module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 12 21:41:59 addons-094000 dockerd[1282]: time="2024-09-12T21:41:59.007013452Z" level=info msg="ignoring event" container=362f66c2bb1f9aa92147d4697719ad7c524b75f14cefc3fa5b0599b0bcbff7e9 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 12 21:41:59 addons-094000 dockerd[1289]: time="2024-09-12T21:41:59.007157301Z" level=info msg="shim disconnected" id=362f66c2bb1f9aa92147d4697719ad7c524b75f14cefc3fa5b0599b0bcbff7e9 namespace=moby

	Sep 12 21:41:59 addons-094000 dockerd[1289]: time="2024-09-12T21:41:59.007186729Z" level=warning msg="cleaning up after shim disconnected" id=362f66c2bb1f9aa92147d4697719ad7c524b75f14cefc3fa5b0599b0bcbff7e9 namespace=moby

	Sep 12 21:41:59 addons-094000 dockerd[1289]: time="2024-09-12T21:41:59.007190647Z" level=info msg="cleaning up dead shim" namespace=moby

	Sep 12 21:41:59 addons-094000 dockerd[1282]: time="2024-09-12T21:41:59.053099019Z" level=info msg="ignoring event" container=1e6d25b95e114794617ce05debe2ba72aa9b7951adecab064f89ad0533fc2b7d module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 12 21:41:59 addons-094000 dockerd[1289]: time="2024-09-12T21:41:59.053689754Z" level=info msg="shim disconnected" id=1e6d25b95e114794617ce05debe2ba72aa9b7951adecab064f89ad0533fc2b7d namespace=moby

	Sep 12 21:41:59 addons-094000 dockerd[1289]: time="2024-09-12T21:41:59.053723309Z" level=warning msg="cleaning up after shim disconnected" id=1e6d25b95e114794617ce05debe2ba72aa9b7951adecab064f89ad0533fc2b7d namespace=moby

	Sep 12 21:41:59 addons-094000 dockerd[1289]: time="2024-09-12T21:41:59.053727602Z" level=info msg="cleaning up dead shim" namespace=moby

	Sep 12 21:41:59 addons-094000 dockerd[1282]: time="2024-09-12T21:41:59.134552978Z" level=info msg="ignoring event" container=46cd3f7bc3bc0a00acb08546871702d180d9020bed46309fadd5d224e1bd0032 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 12 21:41:59 addons-094000 dockerd[1289]: time="2024-09-12T21:41:59.134632634Z" level=info msg="shim disconnected" id=46cd3f7bc3bc0a00acb08546871702d180d9020bed46309fadd5d224e1bd0032 namespace=moby

	Sep 12 21:41:59 addons-094000 dockerd[1289]: time="2024-09-12T21:41:59.134678945Z" level=warning msg="cleaning up after shim disconnected" id=46cd3f7bc3bc0a00acb08546871702d180d9020bed46309fadd5d224e1bd0032 namespace=moby

	Sep 12 21:41:59 addons-094000 dockerd[1289]: time="2024-09-12T21:41:59.134684113Z" level=info msg="cleaning up dead shim" namespace=moby

	Sep 12 21:41:59 addons-094000 dockerd[1282]: time="2024-09-12T21:41:59.162262366Z" level=info msg="ignoring event" container=5c030c2418ad5a3a3934d2134f53828faf1ce5066de13292d9f6439a7751840e module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 12 21:41:59 addons-094000 dockerd[1289]: time="2024-09-12T21:41:59.162394002Z" level=info msg="shim disconnected" id=5c030c2418ad5a3a3934d2134f53828faf1ce5066de13292d9f6439a7751840e namespace=moby

	Sep 12 21:41:59 addons-094000 dockerd[1289]: time="2024-09-12T21:41:59.162426640Z" level=warning msg="cleaning up after shim disconnected" id=5c030c2418ad5a3a3934d2134f53828faf1ce5066de13292d9f6439a7751840e namespace=moby

	Sep 12 21:41:59 addons-094000 dockerd[1289]: time="2024-09-12T21:41:59.162430850Z" level=info msg="cleaning up dead shim" namespace=moby

	==> container status <==

	CONTAINER           IMAGE                                                                                                                        CREATED             STATE               NAME                      ATTEMPT             POD ID              POD

	f07f6b608e189       busybox@sha256:34b191d63fbc93e25e275bfccf1b5365664e5ac28f06d974e8d50090fbb49f41                                              3 seconds ago       Exited              busybox                   0                   0de37e2aa27a6       test-local-path

	a1709138dedd7       busybox@sha256:3fbc632167424a6d997e74f52b878d7cc478225cffac6bc977eedfe51c7f4e79                                              8 seconds ago       Exited              helper-pod                0                   66b6373b9e929       helper-pod-create-pvc-ccf8019f-9494-470c-adb1-2ca3643c7b43

	422c468244be1       ghcr.io/inspektor-gadget/inspektor-gadget@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec            57 seconds ago      Exited              gadget                    7                   93ef49f3b6b23       gadget-9wp6w

	5494ecbe6cb1e       gcr.io/k8s-minikube/gcp-auth-webhook@sha256:e6c5b3bc32072ea370d34c27836efd11b3519d25bd444c2a8efc339cff0e20fb                 9 minutes ago       Running             gcp-auth                  0                   aa7da7822a262       gcp-auth-89d5ffd79-qhxwk

	64b8bb357bba9       registry.k8s.io/ingress-nginx/controller@sha256:d5f8217feeac4887cb1ed21f27c2674e58be06bd8f5184cacea2a69abaf78dce             9 minutes ago       Running             controller                0                   b900761774853       ingress-nginx-controller-bc57996ff-9fp2z

	1637715b43b3f       420193b27261a                                                                                                                10 minutes ago      Exited              patch                     1                   f4a010755f75a       ingress-nginx-admission-patch-trc86

	e2b59cbcfe7c8       registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:a320a50cc91bd15fd2d6fa6de58bd98c1bd64b9a6f926ce23a600d87043455a3   10 minutes ago      Exited              create                    0                   8f3484aab5fe4       ingress-nginx-admission-create-gg68k

	1e6d25b95e114       gcr.io/k8s-minikube/kube-registry-proxy@sha256:b3fa0b2df8737fdb85ad5918a7e2652527463e357afff83a5e5bb966bcedc367              11 minutes ago      Exited              registry-proxy            0                   5c030c2418ad5       registry-proxy-zh429

	362f66c2bb1f9       registry@sha256:ac0192b549007e22998eb74e8d8488dcfe70f1489520c3b144a6047ac5efbe90                                             12 minutes ago      Exited              registry                  0                   46cd3f7bc3bc0       registry-66c9cd494c-p5f26

	f38c428cb886b       registry.k8s.io/metrics-server/metrics-server@sha256:ffcb2bf004d6aa0a17d90e0247cf94f2865c8901dcab4427034c341951c239f9        12 minutes ago      Running             metrics-server            0                   36dbc5017a5c5       metrics-server-84c5f94fbc-kwgtm

	98950f9de9f1b       rancher/local-path-provisioner@sha256:e34c88ae0affb1cdefbb874140d6339d4a27ec4ee420ae8199cd839997b05246                       12 minutes ago      Running             local-path-provisioner    0                   85dbda8f3725c       local-path-provisioner-86d989889c-z5lqx

	2a2461e0db7f8       gcr.io/k8s-minikube/minikube-ingress-dns@sha256:4211a1de532376c881851542238121b26792225faa36a7b02dccad88fd05797c             12 minutes ago      Running             minikube-ingress-dns      0                   95a1fc0490c4e       kube-ingress-dns-minikube

	037c89f1d1a99       gcr.io/cloud-spanner-emulator/emulator@sha256:636fdfc528824bae5f0ea2eca6ae307fe81092f05ec21038008bc0d6100e52fc               12 minutes ago      Running             cloud-spanner-emulator    0                   546f0df91dac6       cloud-spanner-emulator-769b77f747-jmz4x

	01a23a6d9162c       ba04bb24b9575                                                                                                                12 minutes ago      Running             storage-provisioner       0                   6f7b4fb1d7cec       storage-provisioner

	cd8e82f41fc6c       2f6c962e7b831                                                                                                                12 minutes ago      Running             coredns                   0                   7c6c5f2e6046a       coredns-7c65d6cfc9-vj2r9

	3ed42e46d3da7       24a140c548c07                                                                                                                12 minutes ago      Running             kube-proxy                0                   da4c5b29816f9       kube-proxy-vv56v

	9ce52093e2b23       d3f53a98c0a9d                                                                                                                12 minutes ago      Running             kube-apiserver            0                   be33963653595       kube-apiserver-addons-094000

	44fe2d9010037       7f8aa378bb47d                                                                                                                12 minutes ago      Running             kube-scheduler            0                   4a992641939c7       kube-scheduler-addons-094000

	2240bd8077091       279f381cb3736                                                                                                                12 minutes ago      Running             kube-controller-manager   0                   e41c1291d43be       kube-controller-manager-addons-094000

	3d70acdb463a5       27e3830e14027                                                                                                                12 minutes ago      Running             etcd                      0                   4872ca30988cf       etcd-addons-094000

	==> controller_ingress [64b8bb357bba] <==

	  Build:         46e76e5916813cfca2a9b0bfdc34b69a0000f6b9

	  Repository:    https://github.com/kubernetes/ingress-nginx

	  nginx version: nginx/1.25.5

	-------------------------------------------------------------------------------

	W0912 21:32:02.523587       7 client_config.go:659] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.

	I0912 21:32:02.523699       7 main.go:205] "Creating API client" host="https://10.96.0.1:443"

	I0912 21:32:02.527476       7 main.go:248] "Running in Kubernetes cluster" major="1" minor="31" git="v1.31.1" state="clean" commit="948afe5ca072329a73c8e79ed5938717a5cb3d21" platform="linux/arm64"

	I0912 21:32:02.610216       7 main.go:101] "SSL fake certificate created" file="/etc/ingress-controller/ssl/default-fake-certificate.pem"

	I0912 21:32:02.626076       7 ssl.go:535] "loading tls certificate" path="/usr/local/certificates/cert" key="/usr/local/certificates/key"

	I0912 21:32:02.633000       7 nginx.go:271] "Starting NGINX Ingress controller"

	I0912 21:32:02.642835       7 event.go:377] Event(v1.ObjectReference{Kind:"ConfigMap", Namespace:"ingress-nginx", Name:"ingress-nginx-controller", UID:"e64fefb8-d66d-4e65-a5ea-e652ebc27a97", APIVersion:"v1", ResourceVersion:"699", FieldPath:""}): type: 'Normal' reason: 'CREATE' ConfigMap ingress-nginx/ingress-nginx-controller

	I0912 21:32:02.649877       7 event.go:377] Event(v1.ObjectReference{Kind:"ConfigMap", Namespace:"ingress-nginx", Name:"tcp-services", UID:"c45dd024-deba-4268-871e-8eec335d1804", APIVersion:"v1", ResourceVersion:"703", FieldPath:""}): type: 'Normal' reason: 'CREATE' ConfigMap ingress-nginx/tcp-services

	I0912 21:32:02.649899       7 event.go:377] Event(v1.ObjectReference{Kind:"ConfigMap", Namespace:"ingress-nginx", Name:"udp-services", UID:"1f003956-1b94-46b3-9e04-378ae6d68bfc", APIVersion:"v1", ResourceVersion:"710", FieldPath:""}): type: 'Normal' reason: 'CREATE' ConfigMap ingress-nginx/udp-services

	I0912 21:32:03.835246       7 nginx.go:317] "Starting NGINX process"

	I0912 21:32:03.835401       7 leaderelection.go:250] attempting to acquire leader lease ingress-nginx/ingress-nginx-leader...

	I0912 21:32:03.835415       7 nginx.go:337] "Starting validation webhook" address=":8443" certPath="/usr/local/certificates/cert" keyPath="/usr/local/certificates/key"

	I0912 21:32:03.835583       7 controller.go:193] "Configuration changes detected, backend reload required"

	I0912 21:32:03.847217       7 controller.go:213] "Backend successfully reloaded"

	I0912 21:32:03.847311       7 controller.go:224] "Initial sync, sleeping for 1 second"

	I0912 21:32:03.847509       7 event.go:377] Event(v1.ObjectReference{Kind:"Pod", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-bc57996ff-9fp2z", UID:"a7d2b926-806c-4cff-bf63-3475ac219413", APIVersion:"v1", ResourceVersion:"1228", FieldPath:""}): type: 'Normal' reason: 'RELOAD' NGINX reload triggered due to a change in configuration

	I0912 21:32:03.851287       7 leaderelection.go:260] successfully acquired lease ingress-nginx/ingress-nginx-leader

	I0912 21:32:03.851465       7 status.go:85] "New leader elected" identity="ingress-nginx-controller-bc57996ff-9fp2z"

	I0912 21:32:03.913866       7 status.go:219] "POD is not ready" pod="ingress-nginx/ingress-nginx-controller-bc57996ff-9fp2z" node="addons-094000"

	==> coredns [cd8e82f41fc6] <==

	[INFO] 127.0.0.1:58733 - 22425 "HINFO IN 8145035439525199814.4139738628472736569. udp 57 false 512" NXDOMAIN qr,rd,ra 132 0.0260525s

	[INFO] 10.244.0.9:48701 - 18344 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000104254s

	[INFO] 10.244.0.9:48701 - 25262 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000027229s

	[INFO] 10.244.0.9:39897 - 43721 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.00005729s

	[INFO] 10.244.0.9:39897 - 58063 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000026314s

	[INFO] 10.244.0.9:53529 - 32848 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000033724s

	[INFO] 10.244.0.9:53529 - 15439 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000044133s

	[INFO] 10.244.0.9:34190 - 53281 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000031851s

	[INFO] 10.244.0.9:34190 - 33570 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000036723s

	[INFO] 10.244.0.9:38980 - 51767 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000044008s

	[INFO] 10.244.0.9:38980 - 60725 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000025397s

	[INFO] 10.244.0.9:32933 - 1307 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000011741s

	[INFO] 10.244.0.9:32933 - 3866 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000027563s

	[INFO] 10.244.0.9:59615 - 47234 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.00001707s

	[INFO] 10.244.0.9:59615 - 45187 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000011117s

	[INFO] 10.244.0.9:51719 - 44874 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000011991s

	[INFO] 10.244.0.9:51719 - 64069 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000026688s

	[INFO] 10.244.0.24:40516 - 20267 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.006302104s

	[INFO] 10.244.0.24:60441 - 11197 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.006345214s

	[INFO] 10.244.0.24:50491 - 27632 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000753224s

	[INFO] 10.244.0.24:55870 - 63493 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000793084s

	[INFO] 10.244.0.24:48098 - 47692 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000039819s

	[INFO] 10.244.0.24:47311 - 33624 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000094798s

	[INFO] 10.244.0.24:39572 - 39697 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 572 0.004893246s

	[INFO] 10.244.0.24:44489 - 2492 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.005013786s

	==> describe nodes <==

	Name:               addons-094000

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=arm64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=arm64

	                    kubernetes.io/hostname=addons-094000

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=f6bc674a17941874d4e5b792b09c1791d30622b8

	                    minikube.k8s.io/name=addons-094000

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2024_09_12T14_29_19_0700

	                    minikube.k8s.io/version=v1.34.0

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	                    topology.hostpath.csi/node=addons-094000

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Thu, 12 Sep 2024 21:29:16 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  addons-094000

	  AcquireTime:     <unset>

	  RenewTime:       Thu, 12 Sep 2024 21:41:54 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Thu, 12 Sep 2024 21:37:58 +0000   Thu, 12 Sep 2024 21:29:15 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Thu, 12 Sep 2024 21:37:58 +0000   Thu, 12 Sep 2024 21:29:15 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Thu, 12 Sep 2024 21:37:58 +0000   Thu, 12 Sep 2024 21:29:15 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Thu, 12 Sep 2024 21:37:58 +0000   Thu, 12 Sep 2024 21:29:21 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.105.2

	  Hostname:    addons-094000

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3904752Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3904752Ki

	  pods:               110

	System Info:

	  Machine ID:                 9aa957a966124f9bb4e0b774a47d8ca1

	  System UUID:                9aa957a966124f9bb4e0b774a47d8ca1

	  Boot ID:                    80b2124d-68fb-4e81-ae86-fa217dadf068

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               arm64

	  Container Runtime Version:  docker://27.2.1

	  Kubelet Version:            v1.31.1

	  Kube-Proxy Version:         v1.31.1

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (16 in total)

	  Namespace                   Name                                        CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                        ------------  ----------  ---------------  -------------  ---

	  default                     busybox                                     0 (0%)        0 (0%)      0 (0%)           0 (0%)         9m12s

	  default                     cloud-spanner-emulator-769b77f747-jmz4x     0 (0%)        0 (0%)      0 (0%)           0 (0%)         12m

	  default                     registry-test                               0 (0%)        0 (0%)      0 (0%)           0 (0%)         61s

	  gadget                      gadget-9wp6w                                0 (0%)        0 (0%)      0 (0%)           0 (0%)         12m

	  gcp-auth                    gcp-auth-89d5ffd79-qhxwk                    0 (0%)        0 (0%)      0 (0%)           0 (0%)         11m

	  ingress-nginx               ingress-nginx-controller-bc57996ff-9fp2z    100m (5%)     0 (0%)      90Mi (2%)        0 (0%)         11m

	  kube-system                 coredns-7c65d6cfc9-vj2r9                    100m (5%)     0 (0%)      70Mi (1%)        170Mi (4%)     12m

	  kube-system                 etcd-addons-094000                          100m (5%)     0 (0%)      100Mi (2%)       0 (0%)         12m

	  kube-system                 kube-apiserver-addons-094000                250m (12%)    0 (0%)      0 (0%)           0 (0%)         12m

	  kube-system                 kube-controller-manager-addons-094000       200m (10%)    0 (0%)      0 (0%)           0 (0%)         12m

	  kube-system                 kube-ingress-dns-minikube                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         12m

	  kube-system                 kube-proxy-vv56v                            0 (0%)        0 (0%)      0 (0%)           0 (0%)         12m

	  kube-system                 kube-scheduler-addons-094000                100m (5%)     0 (0%)      0 (0%)           0 (0%)         12m

	  kube-system                 metrics-server-84c5f94fbc-kwgtm             100m (5%)     0 (0%)      200Mi (5%)       0 (0%)         12m

	  kube-system                 storage-provisioner                         0 (0%)        0 (0%)      0 (0%)           0 (0%)         12m

	  local-path-storage          local-path-provisioner-86d989889c-z5lqx     0 (0%)        0 (0%)      0 (0%)           0 (0%)         12m

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests     Limits

	  --------           --------     ------

	  cpu                950m (47%)   0 (0%)

	  memory             460Mi (12%)  170Mi (4%)

	  ephemeral-storage  0 (0%)       0 (0%)

	  hugepages-1Gi      0 (0%)       0 (0%)

	  hugepages-2Mi      0 (0%)       0 (0%)

	  hugepages-32Mi     0 (0%)       0 (0%)

	  hugepages-64Ki     0 (0%)       0 (0%)

	Events:

	  Type    Reason                   Age   From             Message

	  ----    ------                   ----  ----             -------

	  Normal  Starting                 12m   kube-proxy       

	  Normal  Starting                 12m   kubelet          Starting kubelet.

	  Normal  NodeAllocatableEnforced  12m   kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  12m   kubelet          Node addons-094000 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    12m   kubelet          Node addons-094000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     12m   kubelet          Node addons-094000 status is now: NodeHasSufficientPID

	  Normal  NodeReady                12m   kubelet          Node addons-094000 status is now: NodeReady

	  Normal  RegisteredNode           12m   node-controller  Node addons-094000 event: Registered Node addons-094000 in Controller

	==> dmesg <==

	[ +15.142222] kauditd_printk_skb: 9 callbacks suppressed

	[  +5.192870] kauditd_printk_skb: 9 callbacks suppressed

	[Sep12 21:30] kauditd_printk_skb: 2 callbacks suppressed

	[  +6.778025] kauditd_printk_skb: 18 callbacks suppressed

	[  +7.077742] kauditd_printk_skb: 7 callbacks suppressed

	[  +6.899882] kauditd_printk_skb: 26 callbacks suppressed

	[Sep12 21:31] kauditd_printk_skb: 21 callbacks suppressed

	[ +27.085751] kauditd_printk_skb: 2 callbacks suppressed

	[  +5.211873] kauditd_printk_skb: 68 callbacks suppressed

	[  +8.649018] kauditd_printk_skb: 18 callbacks suppressed

	[  +9.006137] kauditd_printk_skb: 2 callbacks suppressed

	[Sep12 21:32] kauditd_printk_skb: 22 callbacks suppressed

	[ +12.355044] kauditd_printk_skb: 6 callbacks suppressed

	[ +22.681304] kauditd_printk_skb: 7 callbacks suppressed

	[ +10.289149] kauditd_printk_skb: 20 callbacks suppressed

	[Sep12 21:33] kauditd_printk_skb: 2 callbacks suppressed

	[Sep12 21:35] kauditd_printk_skb: 10 callbacks suppressed

	[Sep12 21:40] kauditd_printk_skb: 2 callbacks suppressed

	[  +6.915245] kauditd_printk_skb: 7 callbacks suppressed

	[Sep12 21:41] kauditd_printk_skb: 22 callbacks suppressed

	[  +6.759152] kauditd_printk_skb: 7 callbacks suppressed

	[  +7.625921] kauditd_printk_skb: 33 callbacks suppressed

	[  +5.375337] kauditd_printk_skb: 6 callbacks suppressed

	[ +11.369851] kauditd_printk_skb: 2 callbacks suppressed

	[  +5.446530] kauditd_printk_skb: 23 callbacks suppressed

	==> etcd [3d70acdb463a] <==

	{"level":"info","ts":"2024-09-12T21:29:15.038955Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.105.2:2379"}

	{"level":"warn","ts":"2024-09-12T21:29:34.575191Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"151.241451ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods\" limit:1 ","response":"range_response_count:0 size:5"}

	{"level":"info","ts":"2024-09-12T21:29:34.575255Z","caller":"traceutil/trace.go:171","msg":"trace[306247226] range","detail":"{range_begin:/registry/pods; range_end:; response_count:0; response_revision:925; }","duration":"151.324617ms","start":"2024-09-12T21:29:34.423923Z","end":"2024-09-12T21:29:34.575248Z","steps":["trace[306247226] 'range keys from in-memory index tree'  (duration: 151.212903ms)"],"step_count":1}

	{"level":"warn","ts":"2024-09-12T21:29:34.575192Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"184.312576ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/gcp-auth/gcp-auth-certs-create.17f49c7226e2c032\" ","response":"range_response_count:1 size:917"}

	{"level":"info","ts":"2024-09-12T21:29:34.575456Z","caller":"traceutil/trace.go:171","msg":"trace[974931706] range","detail":"{range_begin:/registry/events/gcp-auth/gcp-auth-certs-create.17f49c7226e2c032; range_end:; response_count:1; response_revision:925; }","duration":"184.599039ms","start":"2024-09-12T21:29:34.390853Z","end":"2024-09-12T21:29:34.575452Z","steps":["trace[974931706] 'range keys from in-memory index tree'  (duration: 184.255688ms)"],"step_count":1}

	{"level":"warn","ts":"2024-09-12T21:29:49.649846Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"139.696825ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods\" limit:1 ","response":"range_response_count:0 size:5"}

	{"level":"info","ts":"2024-09-12T21:29:49.649912Z","caller":"traceutil/trace.go:171","msg":"trace[884296111] range","detail":"{range_begin:/registry/pods; range_end:; response_count:0; response_revision:988; }","duration":"139.750479ms","start":"2024-09-12T21:29:49.510134Z","end":"2024-09-12T21:29:49.649885Z","steps":["trace[884296111] 'range keys from in-memory index tree'  (duration: 139.640591ms)"],"step_count":1}

	{"level":"warn","ts":"2024-09-12T21:29:49.650000Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"138.487346ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods\" limit:1 ","response":"range_response_count:0 size:5"}

	{"level":"info","ts":"2024-09-12T21:29:49.650008Z","caller":"traceutil/trace.go:171","msg":"trace[434955050] range","detail":"{range_begin:/registry/pods; range_end:; response_count:0; response_revision:988; }","duration":"138.496788ms","start":"2024-09-12T21:29:49.511508Z","end":"2024-09-12T21:29:49.650005Z","steps":["trace[434955050] 'range keys from in-memory index tree'  (duration: 138.453281ms)"],"step_count":1}

	{"level":"warn","ts":"2024-09-12T21:29:49.650037Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"135.380691ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods\" limit:1 ","response":"range_response_count:0 size:5"}

	{"level":"info","ts":"2024-09-12T21:29:49.650045Z","caller":"traceutil/trace.go:171","msg":"trace[1584951466] range","detail":"{range_begin:/registry/pods; range_end:; response_count:0; response_revision:988; }","duration":"135.387096ms","start":"2024-09-12T21:29:49.514654Z","end":"2024-09-12T21:29:49.650041Z","steps":["trace[1584951466] 'range keys from in-memory index tree'  (duration: 135.369211ms)"],"step_count":1}

	{"level":"warn","ts":"2024-09-12T21:29:49.650074Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"134.490021ms","expected-duration":"100ms","prefix":"read-only range ","request":"limit:1 serializable:true keys_only:true ","response":"range_response_count:0 size:5"}

	{"level":"info","ts":"2024-09-12T21:29:49.650079Z","caller":"traceutil/trace.go:171","msg":"trace[989290022] range","detail":"{range_begin:; range_end:; response_count:0; response_revision:988; }","duration":"134.497383ms","start":"2024-09-12T21:29:49.515580Z","end":"2024-09-12T21:29:49.650078Z","steps":["trace[989290022] 'range keys from in-memory index tree'  (duration: 134.488648ms)"],"step_count":1}

	{"level":"warn","ts":"2024-09-12T21:29:53.217266Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"213.152563ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods\" limit:1 ","response":"range_response_count:0 size:5"}

	{"level":"info","ts":"2024-09-12T21:29:53.217364Z","caller":"traceutil/trace.go:171","msg":"trace[582653800] range","detail":"{range_begin:/registry/pods; range_end:; response_count:0; response_revision:997; }","duration":"213.25739ms","start":"2024-09-12T21:29:53.004101Z","end":"2024-09-12T21:29:53.217358Z","steps":["trace[582653800] 'range keys from in-memory index tree'  (duration: 213.12227ms)"],"step_count":1}

	{"level":"warn","ts":"2024-09-12T21:29:53.217442Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"210.907294ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods\" limit:1 ","response":"range_response_count:0 size:5"}

	{"level":"info","ts":"2024-09-12T21:29:53.217464Z","caller":"traceutil/trace.go:171","msg":"trace[1672822008] range","detail":"{range_begin:/registry/pods; range_end:; response_count:0; response_revision:997; }","duration":"210.929808ms","start":"2024-09-12T21:29:53.006532Z","end":"2024-09-12T21:29:53.217462Z","steps":["trace[1672822008] 'range keys from in-memory index tree'  (duration: 210.871547ms)"],"step_count":1}

	{"level":"warn","ts":"2024-09-12T21:29:53.217510Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"208.276907ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods\" limit:1 ","response":"range_response_count:0 size:5"}

	{"level":"info","ts":"2024-09-12T21:29:53.217530Z","caller":"traceutil/trace.go:171","msg":"trace[548058198] range","detail":"{range_begin:/registry/pods; range_end:; response_count:0; response_revision:997; }","duration":"208.297215ms","start":"2024-09-12T21:29:53.009231Z","end":"2024-09-12T21:29:53.217528Z","steps":["trace[548058198] 'range keys from in-memory index tree'  (duration: 208.260261ms)"],"step_count":1}

	{"level":"info","ts":"2024-09-12T21:29:53.221585Z","caller":"traceutil/trace.go:171","msg":"trace[27562101] linearizableReadLoop","detail":"{readStateIndex:1022; appliedIndex:1021; }","duration":"170.873991ms","start":"2024-09-12T21:29:53.050704Z","end":"2024-09-12T21:29:53.221578Z","steps":["trace[27562101] 'read index received'  (duration: 168.303861ms)","trace[27562101] 'applied index is now lower than readState.Index'  (duration: 2.569755ms)"],"step_count":2}

	{"level":"warn","ts":"2024-09-12T21:29:53.221681Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"170.966917ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}

	{"level":"info","ts":"2024-09-12T21:29:53.221697Z","caller":"traceutil/trace.go:171","msg":"trace[465961155] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:997; }","duration":"170.990803ms","start":"2024-09-12T21:29:53.050704Z","end":"2024-09-12T21:29:53.221694Z","steps":["trace[465961155] 'agreement among raft nodes before linearized reading'  (duration: 170.956804ms)"],"step_count":1}

	{"level":"info","ts":"2024-09-12T21:39:15.544028Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1854}

	{"level":"info","ts":"2024-09-12T21:39:15.638731Z","caller":"mvcc/kvstore_compaction.go:69","msg":"finished scheduled compaction","compact-revision":1854,"took":"90.596208ms","hash":3668390359,"current-db-size-bytes":8826880,"current-db-size":"8.8 MB","current-db-size-in-use-bytes":4870144,"current-db-size-in-use":"4.9 MB"}

	{"level":"info","ts":"2024-09-12T21:39:15.638848Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":3668390359,"revision":1854,"compact-revision":-1}

	==> gcp-auth [5494ecbe6cb1] <==

	2024/09/12 21:32:05 GCP Auth Webhook started!

	2024/09/12 21:32:23 Ready to marshal response ...

	2024/09/12 21:32:23 Ready to write response ...

	2024/09/12 21:32:23 Ready to marshal response ...

	2024/09/12 21:32:23 Ready to write response ...

	2024/09/12 21:32:47 Ready to marshal response ...

	2024/09/12 21:32:47 Ready to write response ...

	2024/09/12 21:32:47 Ready to marshal response ...

	2024/09/12 21:32:47 Ready to write response ...

	2024/09/12 21:32:47 Ready to marshal response ...

	2024/09/12 21:32:47 Ready to write response ...

	2024/09/12 21:40:51 Ready to marshal response ...

	2024/09/12 21:40:51 Ready to write response ...

	2024/09/12 21:40:58 Ready to marshal response ...

	2024/09/12 21:40:58 Ready to write response ...

	2024/09/12 21:41:18 Ready to marshal response ...

	2024/09/12 21:41:18 Ready to write response ...

	2024/09/12 21:41:49 Ready to marshal response ...

	2024/09/12 21:41:49 Ready to write response ...

	2024/09/12 21:41:49 Ready to marshal response ...

	2024/09/12 21:41:49 Ready to write response ...

	==> kernel <==

	 21:41:59 up 13 min,  0 users,  load average: 0.65, 0.54, 0.42

	Linux addons-094000 5.10.207 #1 SMP PREEMPT Thu Sep 12 17:20:51 UTC 2024 aarch64 GNU/Linux

	PRETTY_NAME="Buildroot 2023.02.9"

	==> kube-apiserver [9ce52093e2b2] <==

	I0912 21:32:37.882391       1 handler.go:286] Adding GroupVersion scheduling.volcano.sh v1beta1 to ResourceManager

	I0912 21:32:37.950853       1 handler.go:286] Adding GroupVersion flow.volcano.sh v1alpha1 to ResourceManager

	I0912 21:32:38.035889       1 handler.go:286] Adding GroupVersion flow.volcano.sh v1alpha1 to ResourceManager

	I0912 21:32:38.138804       1 handler.go:286] Adding GroupVersion flow.volcano.sh v1alpha1 to ResourceManager

	W0912 21:32:38.815120       1 cacher.go:171] Terminating all watchers from cacher commands.bus.volcano.sh

	W0912 21:32:38.825391       1 cacher.go:171] Terminating all watchers from cacher jobs.batch.volcano.sh

	W0912 21:32:38.883184       1 cacher.go:171] Terminating all watchers from cacher podgroups.scheduling.volcano.sh

	W0912 21:32:38.895626       1 cacher.go:171] Terminating all watchers from cacher numatopologies.nodeinfo.volcano.sh

	W0912 21:32:39.058420       1 cacher.go:171] Terminating all watchers from cacher queues.scheduling.volcano.sh

	W0912 21:32:39.141436       1 cacher.go:171] Terminating all watchers from cacher jobtemplates.flow.volcano.sh

	W0912 21:32:39.175415       1 cacher.go:171] Terminating all watchers from cacher jobflows.flow.volcano.sh

	I0912 21:40:59.762265       1 controller.go:615] quota admission added evaluator for: volumesnapshots.snapshot.storage.k8s.io

	I0912 21:41:32.705258       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0912 21:41:32.705283       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0912 21:41:32.713172       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0912 21:41:32.713193       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0912 21:41:32.731008       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0912 21:41:32.731032       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0912 21:41:32.731869       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0912 21:41:32.731911       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0912 21:41:32.745359       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0912 21:41:32.745376       1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	W0912 21:41:33.731673       1 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io

	W0912 21:41:33.746238       1 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io

	W0912 21:41:33.816212       1 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io

	==> kube-controller-manager [2240bd807709] <==

	E0912 21:41:41.992527       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	W0912 21:41:43.482501       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0912 21:41:43.482593       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	W0912 21:41:46.062471       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0912 21:41:46.062579       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	I0912 21:41:48.234720       1 namespace_controller.go:187] "Namespace has been deleted" logger="namespace-controller" namespace="yakd-dashboard"

	W0912 21:41:49.668040       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0912 21:41:49.668063       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	W0912 21:41:49.724787       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0912 21:41:49.724812       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	W0912 21:41:50.906675       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0912 21:41:50.906708       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	W0912 21:41:51.335623       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0912 21:41:51.335766       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	W0912 21:41:52.399081       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0912 21:41:52.399194       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	I0912 21:41:53.456515       1 shared_informer.go:313] Waiting for caches to sync for resource quota

	I0912 21:41:53.456828       1 shared_informer.go:320] Caches are synced for resource quota

	I0912 21:41:53.896185       1 shared_informer.go:313] Waiting for caches to sync for garbage collector

	I0912 21:41:53.896233       1 shared_informer.go:320] Caches are synced for garbage collector

	W0912 21:41:55.663706       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0912 21:41:55.663840       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	W0912 21:41:56.525267       1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0912 21:41:56.525388       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"

	I0912 21:41:58.984401       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/registry-66c9cd494c" duration="1.459µs"

	==> kube-proxy [3ed42e46d3da] <==

		add table ip kube-proxy

		^^^^^^^^^^^^^^^^^^^^^^^^

	 >

	E0912 21:29:24.475496       1 proxier.go:734] "Error cleaning up nftables rules" err=<

		could not run nftables command: /dev/stdin:1:1-25: Error: Could not process rule: Operation not supported

		add table ip6 kube-proxy

		^^^^^^^^^^^^^^^^^^^^^^^^^

	 >

	I0912 21:29:24.480217       1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.105.2"]

	E0912 21:29:24.480257       1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"

	I0912 21:29:24.492666       1 server_linux.go:146] "No iptables support for family" ipFamily="IPv6"

	I0912 21:29:24.492738       1 server.go:245] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I0912 21:29:24.492765       1 server_linux.go:169] "Using iptables Proxier"

	I0912 21:29:24.493697       1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"

	I0912 21:29:24.493976       1 server.go:483] "Version info" version="v1.31.1"

	I0912 21:29:24.493999       1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0912 21:29:24.494971       1 config.go:199] "Starting service config controller"

	I0912 21:29:24.495136       1 shared_informer.go:313] Waiting for caches to sync for service config

	I0912 21:29:24.495245       1 config.go:105] "Starting endpoint slice config controller"

	I0912 21:29:24.495275       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config

	I0912 21:29:24.495725       1 config.go:328] "Starting node config controller"

	I0912 21:29:24.496392       1 shared_informer.go:313] Waiting for caches to sync for node config

	I0912 21:29:24.596727       1 shared_informer.go:320] Caches are synced for node config

	I0912 21:29:24.596749       1 shared_informer.go:320] Caches are synced for service config

	I0912 21:29:24.596755       1 shared_informer.go:320] Caches are synced for endpoint slice config

	==> kube-scheduler [44fe2d901003] <==

	W0912 21:29:16.438726       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0912 21:29:16.438762       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"

	W0912 21:29:16.438801       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0912 21:29:16.438951       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError"

	W0912 21:29:16.439007       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0912 21:29:16.439035       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError"

	W0912 21:29:16.439088       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E0912 21:29:16.439113       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"

	W0912 21:29:16.439163       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E0912 21:29:16.439188       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User \"system:kube-scheduler\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError"

	W0912 21:29:16.439221       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0912 21:29:16.439255       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError"

	W0912 21:29:16.439291       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E0912 21:29:16.439326       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"

	W0912 21:29:16.439368       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E0912 21:29:16.439388       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError"

	W0912 21:29:16.439438       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0912 21:29:16.439460       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError"

	W0912 21:29:16.439530       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0912 21:29:16.439555       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"

	W0912 21:29:17.279936       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E0912 21:29:17.280053       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"

	W0912 21:29:17.329245       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0912 21:29:17.329454       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError"

	I0912 21:29:17.736378       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	==> kubelet <==

	Sep 12 21:41:54 addons-094000 kubelet[2055]: I0912 21:41:54.813429    2055 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/398d8dbb-345b-4421-b43b-31488b83f81e-gcp-creds\") pod \"test-local-path\" (UID: \"398d8dbb-345b-4421-b43b-31488b83f81e\") " pod="default/test-local-path"

	Sep 12 21:41:54 addons-094000 kubelet[2055]: I0912 21:41:54.813456    2055 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-ccf8019f-9494-470c-adb1-2ca3643c7b43\" (UniqueName: \"kubernetes.io/host-path/398d8dbb-345b-4421-b43b-31488b83f81e-pvc-ccf8019f-9494-470c-adb1-2ca3643c7b43\") pod \"test-local-path\" (UID: \"398d8dbb-345b-4421-b43b-31488b83f81e\") " pod="default/test-local-path"

	Sep 12 21:41:54 addons-094000 kubelet[2055]: I0912 21:41:54.813473    2055 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9fkg\" (UniqueName: \"kubernetes.io/projected/398d8dbb-345b-4421-b43b-31488b83f81e-kube-api-access-l9fkg\") pod \"test-local-path\" (UID: \"398d8dbb-345b-4421-b43b-31488b83f81e\") " pod="default/test-local-path"

	Sep 12 21:41:58 addons-094000 kubelet[2055]: E0912 21:41:58.599403    2055 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"busybox\" with ImagePullBackOff: \"Back-off pulling image \\\"gcr.io/k8s-minikube/busybox:1.28.4-glibc\\\"\"" pod="default/busybox" podUID="fe3278f3-e2dd-4f79-ae0c-96d5872e626d"

	Sep 12 21:41:58 addons-094000 kubelet[2055]: I0912 21:41:58.950937    2055 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/host-path/398d8dbb-345b-4421-b43b-31488b83f81e-pvc-ccf8019f-9494-470c-adb1-2ca3643c7b43\") pod \"398d8dbb-345b-4421-b43b-31488b83f81e\" (UID: \"398d8dbb-345b-4421-b43b-31488b83f81e\") "

	Sep 12 21:41:58 addons-094000 kubelet[2055]: I0912 21:41:58.950954    2055 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/58ed4c4c-7791-49d7-a8b5-fb0f2e78a4af-gcp-creds\") pod \"58ed4c4c-7791-49d7-a8b5-fb0f2e78a4af\" (UID: \"58ed4c4c-7791-49d7-a8b5-fb0f2e78a4af\") "

	Sep 12 21:41:58 addons-094000 kubelet[2055]: I0912 21:41:58.950978    2055 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pz6bk\" (UniqueName: \"kubernetes.io/projected/58ed4c4c-7791-49d7-a8b5-fb0f2e78a4af-kube-api-access-pz6bk\") pod \"58ed4c4c-7791-49d7-a8b5-fb0f2e78a4af\" (UID: \"58ed4c4c-7791-49d7-a8b5-fb0f2e78a4af\") "

	Sep 12 21:41:58 addons-094000 kubelet[2055]: I0912 21:41:58.950987    2055 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/398d8dbb-345b-4421-b43b-31488b83f81e-gcp-creds\") pod \"398d8dbb-345b-4421-b43b-31488b83f81e\" (UID: \"398d8dbb-345b-4421-b43b-31488b83f81e\") "

	Sep 12 21:41:58 addons-094000 kubelet[2055]: I0912 21:41:58.950997    2055 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9fkg\" (UniqueName: \"kubernetes.io/projected/398d8dbb-345b-4421-b43b-31488b83f81e-kube-api-access-l9fkg\") pod \"398d8dbb-345b-4421-b43b-31488b83f81e\" (UID: \"398d8dbb-345b-4421-b43b-31488b83f81e\") "

	Sep 12 21:41:58 addons-094000 kubelet[2055]: I0912 21:41:58.951168    2055 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/58ed4c4c-7791-49d7-a8b5-fb0f2e78a4af-gcp-creds" (OuterVolumeSpecName: "gcp-creds") pod "58ed4c4c-7791-49d7-a8b5-fb0f2e78a4af" (UID: "58ed4c4c-7791-49d7-a8b5-fb0f2e78a4af"). InnerVolumeSpecName "gcp-creds". PluginName "kubernetes.io/host-path", VolumeGidValue ""

	Sep 12 21:41:58 addons-094000 kubelet[2055]: I0912 21:41:58.951187    2055 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/398d8dbb-345b-4421-b43b-31488b83f81e-pvc-ccf8019f-9494-470c-adb1-2ca3643c7b43" (OuterVolumeSpecName: "data") pod "398d8dbb-345b-4421-b43b-31488b83f81e" (UID: "398d8dbb-345b-4421-b43b-31488b83f81e"). InnerVolumeSpecName "pvc-ccf8019f-9494-470c-adb1-2ca3643c7b43". PluginName "kubernetes.io/host-path", VolumeGidValue ""

	Sep 12 21:41:58 addons-094000 kubelet[2055]: I0912 21:41:58.951480    2055 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/398d8dbb-345b-4421-b43b-31488b83f81e-gcp-creds" (OuterVolumeSpecName: "gcp-creds") pod "398d8dbb-345b-4421-b43b-31488b83f81e" (UID: "398d8dbb-345b-4421-b43b-31488b83f81e"). InnerVolumeSpecName "gcp-creds". PluginName "kubernetes.io/host-path", VolumeGidValue ""

	Sep 12 21:41:58 addons-094000 kubelet[2055]: I0912 21:41:58.951627    2055 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/398d8dbb-345b-4421-b43b-31488b83f81e-kube-api-access-l9fkg" (OuterVolumeSpecName: "kube-api-access-l9fkg") pod "398d8dbb-345b-4421-b43b-31488b83f81e" (UID: "398d8dbb-345b-4421-b43b-31488b83f81e"). InnerVolumeSpecName "kube-api-access-l9fkg". PluginName "kubernetes.io/projected", VolumeGidValue ""

	Sep 12 21:41:58 addons-094000 kubelet[2055]: I0912 21:41:58.951796    2055 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58ed4c4c-7791-49d7-a8b5-fb0f2e78a4af-kube-api-access-pz6bk" (OuterVolumeSpecName: "kube-api-access-pz6bk") pod "58ed4c4c-7791-49d7-a8b5-fb0f2e78a4af" (UID: "58ed4c4c-7791-49d7-a8b5-fb0f2e78a4af"). InnerVolumeSpecName "kube-api-access-pz6bk". PluginName "kubernetes.io/projected", VolumeGidValue ""

	Sep 12 21:41:59 addons-094000 kubelet[2055]: I0912 21:41:59.052292    2055 reconciler_common.go:288] "Volume detached for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/398d8dbb-345b-4421-b43b-31488b83f81e-gcp-creds\") on node \"addons-094000\" DevicePath \"\""

	Sep 12 21:41:59 addons-094000 kubelet[2055]: I0912 21:41:59.052304    2055 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-l9fkg\" (UniqueName: \"kubernetes.io/projected/398d8dbb-345b-4421-b43b-31488b83f81e-kube-api-access-l9fkg\") on node \"addons-094000\" DevicePath \"\""

	Sep 12 21:41:59 addons-094000 kubelet[2055]: I0912 21:41:59.052310    2055 reconciler_common.go:288] "Volume detached for volume \"pvc-ccf8019f-9494-470c-adb1-2ca3643c7b43\" (UniqueName: \"kubernetes.io/host-path/398d8dbb-345b-4421-b43b-31488b83f81e-pvc-ccf8019f-9494-470c-adb1-2ca3643c7b43\") on node \"addons-094000\" DevicePath \"\""

	Sep 12 21:41:59 addons-094000 kubelet[2055]: I0912 21:41:59.052324    2055 reconciler_common.go:288] "Volume detached for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/58ed4c4c-7791-49d7-a8b5-fb0f2e78a4af-gcp-creds\") on node \"addons-094000\" DevicePath \"\""

	Sep 12 21:41:59 addons-094000 kubelet[2055]: I0912 21:41:59.052329    2055 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-pz6bk\" (UniqueName: \"kubernetes.io/projected/58ed4c4c-7791-49d7-a8b5-fb0f2e78a4af-kube-api-access-pz6bk\") on node \"addons-094000\" DevicePath \"\""

	Sep 12 21:41:59 addons-094000 kubelet[2055]: I0912 21:41:59.353205    2055 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dq7x9\" (UniqueName: \"kubernetes.io/projected/d42d83d3-de78-4a99-ab0d-4539040c1a33-kube-api-access-dq7x9\") pod \"d42d83d3-de78-4a99-ab0d-4539040c1a33\" (UID: \"d42d83d3-de78-4a99-ab0d-4539040c1a33\") "

	Sep 12 21:41:59 addons-094000 kubelet[2055]: I0912 21:41:59.353230    2055 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxn2p\" (UniqueName: \"kubernetes.io/projected/21dafca9-6625-404e-9961-8c638a8f1694-kube-api-access-rxn2p\") pod \"21dafca9-6625-404e-9961-8c638a8f1694\" (UID: \"21dafca9-6625-404e-9961-8c638a8f1694\") "

	Sep 12 21:41:59 addons-094000 kubelet[2055]: I0912 21:41:59.354210    2055 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21dafca9-6625-404e-9961-8c638a8f1694-kube-api-access-rxn2p" (OuterVolumeSpecName: "kube-api-access-rxn2p") pod "21dafca9-6625-404e-9961-8c638a8f1694" (UID: "21dafca9-6625-404e-9961-8c638a8f1694"). InnerVolumeSpecName "kube-api-access-rxn2p". PluginName "kubernetes.io/projected", VolumeGidValue ""

	Sep 12 21:41:59 addons-094000 kubelet[2055]: I0912 21:41:59.354497    2055 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d42d83d3-de78-4a99-ab0d-4539040c1a33-kube-api-access-dq7x9" (OuterVolumeSpecName: "kube-api-access-dq7x9") pod "d42d83d3-de78-4a99-ab0d-4539040c1a33" (UID: "d42d83d3-de78-4a99-ab0d-4539040c1a33"). InnerVolumeSpecName "kube-api-access-dq7x9". PluginName "kubernetes.io/projected", VolumeGidValue ""

	Sep 12 21:41:59 addons-094000 kubelet[2055]: I0912 21:41:59.453493    2055 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-rxn2p\" (UniqueName: \"kubernetes.io/projected/21dafca9-6625-404e-9961-8c638a8f1694-kube-api-access-rxn2p\") on node \"addons-094000\" DevicePath \"\""

	Sep 12 21:41:59 addons-094000 kubelet[2055]: I0912 21:41:59.453508    2055 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-dq7x9\" (UniqueName: \"kubernetes.io/projected/d42d83d3-de78-4a99-ab0d-4539040c1a33-kube-api-access-dq7x9\") on node \"addons-094000\" DevicePath \"\""

	==> storage-provisioner [01a23a6d9162] <==

	I0912 21:29:24.917689       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0912 21:29:24.923136       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0912 21:29:24.923158       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I0912 21:29:24.935406       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0912 21:29:24.935484       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-094000_74258189-11de-4e06-8a56-1e9d51dca455!

	I0912 21:29:24.936210       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"e13dad6e-60c5-42c7-9d5e-283ea5eee1cc", APIVersion:"v1", ResourceVersion:"372", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-094000_74258189-11de-4e06-8a56-1e9d51dca455 became leader

	I0912 21:29:25.039916       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-094000_74258189-11de-4e06-8a56-1e9d51dca455!

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.APIServer}} -p addons-094000 -n addons-094000

helpers_test.go:261: (dbg) Run:  kubectl --context addons-094000 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:272: non-running pods: busybox ingress-nginx-admission-create-gg68k ingress-nginx-admission-patch-trc86 helper-pod-delete-pvc-ccf8019f-9494-470c-adb1-2ca3643c7b43

helpers_test.go:274: ======> post-mortem[TestAddons/parallel/Registry]: describe non-running pods <======

helpers_test.go:277: (dbg) Run:  kubectl --context addons-094000 describe pod busybox ingress-nginx-admission-create-gg68k ingress-nginx-admission-patch-trc86 helper-pod-delete-pvc-ccf8019f-9494-470c-adb1-2ca3643c7b43

helpers_test.go:277: (dbg) Non-zero exit: kubectl --context addons-094000 describe pod busybox ingress-nginx-admission-create-gg68k ingress-nginx-admission-patch-trc86 helper-pod-delete-pvc-ccf8019f-9494-470c-adb1-2ca3643c7b43: exit status 1 (41.679125ms)

-- stdout --

	Name:             busybox

	Namespace:        default

	Priority:         0

	Service Account:  default

	Node:             addons-094000/192.168.105.2

	Start Time:       Thu, 12 Sep 2024 14:32:47 -0700

	Labels:           integration-test=busybox

	Annotations:      <none>

	Status:           Pending

	IP:               10.244.0.26

	IPs:

	  IP:  10.244.0.26

	Containers:

	  busybox:

	    Container ID:  

	    Image:         gcr.io/k8s-minikube/busybox:1.28.4-glibc

	    Image ID:      

	    Port:          <none>

	    Host Port:     <none>

	    Command:

	      sleep

	      3600

	    State:          Waiting

	      Reason:       ImagePullBackOff

	    Ready:          False

	    Restart Count:  0

	    Environment:

	      GOOGLE_APPLICATION_CREDENTIALS:  /google-app-creds.json

	      PROJECT_ID:                      this_is_fake

	      GCP_PROJECT:                     this_is_fake

	      GCLOUD_PROJECT:                  this_is_fake

	      GOOGLE_CLOUD_PROJECT:            this_is_fake

	      CLOUDSDK_CORE_PROJECT:           this_is_fake

	    Mounts:

	      /google-app-creds.json from gcp-creds (ro)

	      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-jgd8f (ro)

	Conditions:

	  Type                        Status

	  PodReadyToStartContainers   True 

	  Initialized                 True 

	  Ready                       False 

	  ContainersReady             False 

	  PodScheduled                True 

	Volumes:

	  kube-api-access-jgd8f:

	    Type:                    Projected (a volume that contains injected data from multiple sources)

	    TokenExpirationSeconds:  3607

	    ConfigMapName:           kube-root-ca.crt

	    ConfigMapOptional:       <nil>

	    DownwardAPI:             true

	  gcp-creds:

	    Type:          HostPath (bare host directory volume)

	    Path:          /var/lib/minikube/google_application_credentials.json

	    HostPathType:  File

	QoS Class:         BestEffort

	Node-Selectors:    <none>

	Tolerations:       node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

	                   node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

	Events:

	  Type     Reason     Age                    From               Message

	  ----     ------     ----                   ----               -------

	  Normal   Scheduled  9m12s                  default-scheduler  Successfully assigned default/busybox to addons-094000

	  Normal   Pulling    7m41s (x4 over 9m12s)  kubelet            Pulling image "gcr.io/k8s-minikube/busybox:1.28.4-glibc"

	  Warning  Failed     7m41s (x4 over 9m11s)  kubelet            Failed to pull image "gcr.io/k8s-minikube/busybox:1.28.4-glibc": Error response from daemon: Head "https://gcr.io/v2/k8s-minikube/busybox/manifests/1.28.4-glibc": unauthorized: authentication failed

	  Warning  Failed     7m41s (x4 over 9m11s)  kubelet            Error: ErrImagePull

	  Warning  Failed     7m25s (x6 over 9m11s)  kubelet            Error: ImagePullBackOff

	  Normal   BackOff    4m7s (x20 over 9m11s)  kubelet            Back-off pulling image "gcr.io/k8s-minikube/busybox:1.28.4-glibc"

-- /stdout --

** stderr ** 

	Error from server (NotFound): pods "ingress-nginx-admission-create-gg68k" not found

	Error from server (NotFound): pods "ingress-nginx-admission-patch-trc86" not found

	Error from server (NotFound): pods "helper-pod-delete-pvc-ccf8019f-9494-470c-adb1-2ca3643c7b43" not found

** /stderr **

helpers_test.go:279: kubectl --context addons-094000 describe pod busybox ingress-nginx-admission-create-gg68k ingress-nginx-admission-patch-trc86 helper-pod-delete-pvc-ccf8019f-9494-470c-adb1-2ca3643c7b43: exit status 1

--- FAIL: TestAddons/parallel/Registry (71.33s)

=== RUN   TestCertOptions

=== PAUSE TestCertOptions

=== CONT  TestCertOptions

cert_options_test.go:49: (dbg) Run:  out/minikube-darwin-arm64 start -p cert-options-450000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=qemu2 

cert_options_test.go:49: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p cert-options-450000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=qemu2 : exit status 80 (9.908270333s)

-- stdout --

	* [cert-options-450000] minikube v1.34.0 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19616

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19616-1259/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19616-1259/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "cert-options-450000" primary control-plane node in "cert-options-450000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "cert-options-450000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p cert-options-450000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

cert_options_test.go:51: failed to start minikube with args: "out/minikube-darwin-arm64 start -p cert-options-450000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=qemu2 " : exit status 80

cert_options_test.go:60: (dbg) Run:  out/minikube-darwin-arm64 -p cert-options-450000 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"

cert_options_test.go:60: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p cert-options-450000 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt": exit status 83 (80.924042ms)

-- stdout --

	* The control-plane node cert-options-450000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p cert-options-450000"

-- /stdout --

cert_options_test.go:62: failed to read apiserver cert inside minikube. args "out/minikube-darwin-arm64 -p cert-options-450000 ssh \"openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt\"": exit status 83

cert_options_test.go:69: apiserver cert does not include 127.0.0.1 in SAN.

cert_options_test.go:69: apiserver cert does not include 192.168.15.15 in SAN.

cert_options_test.go:69: apiserver cert does not include localhost in SAN.

cert_options_test.go:69: apiserver cert does not include www.google.com in SAN.

cert_options_test.go:88: (dbg) Run:  kubectl --context cert-options-450000 config view

cert_options_test.go:93: Kubeconfig apiserver server port incorrect. Output of 

'kubectl config view' = "\n-- stdout --\n\tapiVersion: v1\n\tclusters: null\n\tcontexts: null\n\tcurrent-context: \"\"\n\tkind: Config\n\tpreferences: {}\n\tusers: null\n\n-- /stdout --"

cert_options_test.go:100: (dbg) Run:  out/minikube-darwin-arm64 ssh -p cert-options-450000 -- "sudo cat /etc/kubernetes/admin.conf"

cert_options_test.go:100: (dbg) Non-zero exit: out/minikube-darwin-arm64 ssh -p cert-options-450000 -- "sudo cat /etc/kubernetes/admin.conf": exit status 83 (39.245792ms)

-- stdout --

	* The control-plane node cert-options-450000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p cert-options-450000"

-- /stdout --

cert_options_test.go:102: failed to SSH to minikube with args: "out/minikube-darwin-arm64 ssh -p cert-options-450000 -- \"sudo cat /etc/kubernetes/admin.conf\"" : exit status 83

cert_options_test.go:106: Internal minikube kubeconfig (admin.conf) does not contains the right api port. 

-- stdout --

	* The control-plane node cert-options-450000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p cert-options-450000"

-- /stdout --

cert_options_test.go:109: *** TestCertOptions FAILED at 2024-09-12 15:14:43.791683 -0700 PDT m=+2804.253856542

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p cert-options-450000 -n cert-options-450000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p cert-options-450000 -n cert-options-450000: exit status 7 (29.581625ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "cert-options-450000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "cert-options-450000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p cert-options-450000

--- FAIL: TestCertOptions (10.17s)

=== RUN   TestCertExpiration

=== PAUSE TestCertExpiration

=== CONT  TestCertExpiration

cert_options_test.go:123: (dbg) Run:  out/minikube-darwin-arm64 start -p cert-expiration-152000 --memory=2048 --cert-expiration=3m --driver=qemu2 

cert_options_test.go:123: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p cert-expiration-152000 --memory=2048 --cert-expiration=3m --driver=qemu2 : exit status 80 (10.04304125s)

-- stdout --

	* [cert-expiration-152000] minikube v1.34.0 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19616

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19616-1259/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19616-1259/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "cert-expiration-152000" primary control-plane node in "cert-expiration-152000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "cert-expiration-152000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p cert-expiration-152000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

cert_options_test.go:125: failed to start minikube with args: "out/minikube-darwin-arm64 start -p cert-expiration-152000 --memory=2048 --cert-expiration=3m --driver=qemu2 " : exit status 80

cert_options_test.go:131: (dbg) Run:  out/minikube-darwin-arm64 start -p cert-expiration-152000 --memory=2048 --cert-expiration=8760h --driver=qemu2 

cert_options_test.go:131: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p cert-expiration-152000 --memory=2048 --cert-expiration=8760h --driver=qemu2 : exit status 80 (5.180829166s)

-- stdout --

	* [cert-expiration-152000] minikube v1.34.0 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19616

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19616-1259/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19616-1259/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on existing profile

	* Starting "cert-expiration-152000" primary control-plane node in "cert-expiration-152000" cluster

	* Restarting existing qemu2 VM for "cert-expiration-152000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Restarting existing qemu2 VM for "cert-expiration-152000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p cert-expiration-152000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

cert_options_test.go:133: failed to start minikube after cert expiration: "out/minikube-darwin-arm64 start -p cert-expiration-152000 --memory=2048 --cert-expiration=8760h --driver=qemu2 " : exit status 80

cert_options_test.go:136: minikube start output did not warn about expired certs: 

-- stdout --

	* [cert-expiration-152000] minikube v1.34.0 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19616

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19616-1259/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19616-1259/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on existing profile

	* Starting "cert-expiration-152000" primary control-plane node in "cert-expiration-152000" cluster

	* Restarting existing qemu2 VM for "cert-expiration-152000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Restarting existing qemu2 VM for "cert-expiration-152000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p cert-expiration-152000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

cert_options_test.go:138: *** TestCertExpiration FAILED at 2024-09-12 15:17:43.780112 -0700 PDT m=+2984.247333542

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p cert-expiration-152000 -n cert-expiration-152000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p cert-expiration-152000 -n cert-expiration-152000: exit status 7 (56.3585ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "cert-expiration-152000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "cert-expiration-152000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p cert-expiration-152000

--- FAIL: TestCertExpiration (195.36s)

=== RUN   TestDockerFlags

=== PAUSE TestDockerFlags

=== CONT  TestDockerFlags

docker_test.go:51: (dbg) Run:  out/minikube-darwin-arm64 start -p docker-flags-239000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=qemu2 

docker_test.go:51: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p docker-flags-239000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=qemu2 : exit status 80 (10.10189125s)

-- stdout --

	* [docker-flags-239000] minikube v1.34.0 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19616

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19616-1259/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19616-1259/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "docker-flags-239000" primary control-plane node in "docker-flags-239000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "docker-flags-239000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0912 15:14:23.419365    4601 out.go:345] Setting OutFile to fd 1 ...

	I0912 15:14:23.419479    4601 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:14:23.419483    4601 out.go:358] Setting ErrFile to fd 2...

	I0912 15:14:23.419485    4601 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:14:23.419609    4601 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19616-1259/.minikube/bin

	I0912 15:14:23.420768    4601 out.go:352] Setting JSON to false

	I0912 15:14:23.437056    4601 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":4427,"bootTime":1726174836,"procs":472,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0912 15:14:23.437124    4601 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0912 15:14:23.443538    4601 out.go:177] * [docker-flags-239000] minikube v1.34.0 on Darwin 14.5 (arm64)

	I0912 15:14:23.450316    4601 out.go:177]   - MINIKUBE_LOCATION=19616

	I0912 15:14:23.450399    4601 notify.go:220] Checking for updates...

	I0912 15:14:23.458310    4601 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19616-1259/kubeconfig

	I0912 15:14:23.461308    4601 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0912 15:14:23.464352    4601 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0912 15:14:23.467358    4601 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19616-1259/.minikube

	I0912 15:14:23.470363    4601 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0912 15:14:23.473607    4601 config.go:182] Loaded profile config "force-systemd-flag-381000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I0912 15:14:23.473676    4601 config.go:182] Loaded profile config "multinode-323000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I0912 15:14:23.473733    4601 driver.go:394] Setting default libvirt URI to qemu:///system

	I0912 15:14:23.478315    4601 out.go:177] * Using the qemu2 driver based on user configuration

	I0912 15:14:23.485306    4601 start.go:297] selected driver: qemu2

	I0912 15:14:23.485312    4601 start.go:901] validating driver "qemu2" against <nil>

	I0912 15:14:23.485318    4601 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0912 15:14:23.487700    4601 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0912 15:14:23.490227    4601 out.go:177] * Automatically selected the socket_vmnet network

	I0912 15:14:23.493330    4601 start_flags.go:942] Waiting for no components: map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false]

	I0912 15:14:23.493361    4601 cni.go:84] Creating CNI manager for ""

	I0912 15:14:23.493368    4601 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0912 15:14:23.493378    4601 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0912 15:14:23.493407    4601 start.go:340] cluster config:

	{Name:docker-flags-239000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726156396-19616@sha256:66b06a42534e914a5c8ad765d7508a93a34031939ec9a6b3a818ef0a444ff889 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:docker-flags-239000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[]

DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMn

etClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0912 15:14:23.497151    4601 iso.go:125] acquiring lock: {Name:mk3fa9c1c2a2731193a2e63235bbe8976497103e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0912 15:14:23.504330    4601 out.go:177] * Starting "docker-flags-239000" primary control-plane node in "docker-flags-239000" cluster

	I0912 15:14:23.508362    4601 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime docker

	I0912 15:14:23.508378    4601 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19616-1259/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4

	I0912 15:14:23.508389    4601 cache.go:56] Caching tarball of preloaded images

	I0912 15:14:23.508448    4601 preload.go:172] Found /Users/jenkins/minikube-integration/19616-1259/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0912 15:14:23.508454    4601 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on docker

	I0912 15:14:23.508528    4601 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/docker-flags-239000/config.json ...

	I0912 15:14:23.508540    4601 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/docker-flags-239000/config.json: {Name:mk5b53b16adf31dc04f58bbc8e1db921385146e0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0912 15:14:23.508768    4601 start.go:360] acquireMachinesLock for docker-flags-239000: {Name:mk18104440c14407e7206cb5d92d4872e7d20daa Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0912 15:14:23.508811    4601 start.go:364] duration metric: took 33.792µs to acquireMachinesLock for "docker-flags-239000"

	I0912 15:14:23.508824    4601 start.go:93] Provisioning new machine with config: &{Name:docker-flags-239000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19616/minikube-v1.34.0-1726156389-19616-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726156396-19616@sha256:66b06a42534e914a5c8ad765d7508a93a34031939ec9a6b3a818ef0a444ff889 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey

: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:docker-flags-239000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:dock

er MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0912 15:14:23.508854    4601 start.go:125] createHost starting for "" (driver="qemu2")

	I0912 15:14:23.517319    4601 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0912 15:14:23.535758    4601 start.go:159] libmachine.API.Create for "docker-flags-239000" (driver="qemu2")

	I0912 15:14:23.535785    4601 client.go:168] LocalClient.Create starting

	I0912 15:14:23.535851    4601 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19616-1259/.minikube/certs/ca.pem

	I0912 15:14:23.535884    4601 main.go:141] libmachine: Decoding PEM data...

	I0912 15:14:23.535896    4601 main.go:141] libmachine: Parsing certificate...

	I0912 15:14:23.535931    4601 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19616-1259/.minikube/certs/cert.pem

	I0912 15:14:23.535956    4601 main.go:141] libmachine: Decoding PEM data...

	I0912 15:14:23.535967    4601 main.go:141] libmachine: Parsing certificate...

	I0912 15:14:23.536414    4601 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19616-1259/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19616-1259/.minikube/cache/iso/arm64/minikube-v1.34.0-1726156389-19616-arm64.iso...

	I0912 15:14:23.712532    4601 main.go:141] libmachine: Creating SSH key...

	I0912 15:14:23.890105    4601 main.go:141] libmachine: Creating Disk image...

	I0912 15:14:23.890111    4601 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0912 15:14:23.890367    4601 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/docker-flags-239000/disk.qcow2.raw /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/docker-flags-239000/disk.qcow2

	I0912 15:14:23.899770    4601 main.go:141] libmachine: STDOUT: 

	I0912 15:14:23.899790    4601 main.go:141] libmachine: STDERR: 

	I0912 15:14:23.899849    4601 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/docker-flags-239000/disk.qcow2 +20000M

	I0912 15:14:23.907722    4601 main.go:141] libmachine: STDOUT: Image resized.

	I0912 15:14:23.907738    4601 main.go:141] libmachine: STDERR: 

	I0912 15:14:23.907756    4601 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/docker-flags-239000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/docker-flags-239000/disk.qcow2

	I0912 15:14:23.907761    4601 main.go:141] libmachine: Starting QEMU VM...

	I0912 15:14:23.907777    4601 qemu.go:418] Using hvf for hardware acceleration

	I0912 15:14:23.907817    4601 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/docker-flags-239000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/docker-flags-239000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/docker-flags-239000/qemu.pid -device virtio-net-pci,netdev=net0,mac=4a:e0:56:a4:5f:bb -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/docker-flags-239000/disk.qcow2

	I0912 15:14:23.909468    4601 main.go:141] libmachine: STDOUT: 

	I0912 15:14:23.909484    4601 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0912 15:14:23.909502    4601 client.go:171] duration metric: took 373.721958ms to LocalClient.Create

	I0912 15:14:25.911607    4601 start.go:128] duration metric: took 2.402800958s to createHost

	I0912 15:14:25.911650    4601 start.go:83] releasing machines lock for "docker-flags-239000", held for 2.402896s

	W0912 15:14:25.911722    4601 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0912 15:14:25.935811    4601 out.go:177] * Deleting "docker-flags-239000" in qemu2 ...

	W0912 15:14:25.962646    4601 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0912 15:14:25.962666    4601 start.go:729] Will try again in 5 seconds ...

	I0912 15:14:30.964784    4601 start.go:360] acquireMachinesLock for docker-flags-239000: {Name:mk18104440c14407e7206cb5d92d4872e7d20daa Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0912 15:14:31.090737    4601 start.go:364] duration metric: took 125.824167ms to acquireMachinesLock for "docker-flags-239000"

	I0912 15:14:31.090895    4601 start.go:93] Provisioning new machine with config: &{Name:docker-flags-239000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19616/minikube-v1.34.0-1726156389-19616-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726156396-19616@sha256:66b06a42534e914a5c8ad765d7508a93a34031939ec9a6b3a818ef0a444ff889 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey

: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:docker-flags-239000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:dock

er MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0912 15:14:31.091135    4601 start.go:125] createHost starting for "" (driver="qemu2")

	I0912 15:14:31.107739    4601 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0912 15:14:31.157536    4601 start.go:159] libmachine.API.Create for "docker-flags-239000" (driver="qemu2")

	I0912 15:14:31.157586    4601 client.go:168] LocalClient.Create starting

	I0912 15:14:31.157715    4601 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19616-1259/.minikube/certs/ca.pem

	I0912 15:14:31.157774    4601 main.go:141] libmachine: Decoding PEM data...

	I0912 15:14:31.157790    4601 main.go:141] libmachine: Parsing certificate...

	I0912 15:14:31.157854    4601 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19616-1259/.minikube/certs/cert.pem

	I0912 15:14:31.157899    4601 main.go:141] libmachine: Decoding PEM data...

	I0912 15:14:31.157914    4601 main.go:141] libmachine: Parsing certificate...

	I0912 15:14:31.158656    4601 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19616-1259/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19616-1259/.minikube/cache/iso/arm64/minikube-v1.34.0-1726156389-19616-arm64.iso...

	I0912 15:14:31.354274    4601 main.go:141] libmachine: Creating SSH key...

	I0912 15:14:31.418575    4601 main.go:141] libmachine: Creating Disk image...

	I0912 15:14:31.418580    4601 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0912 15:14:31.418782    4601 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/docker-flags-239000/disk.qcow2.raw /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/docker-flags-239000/disk.qcow2

	I0912 15:14:31.428035    4601 main.go:141] libmachine: STDOUT: 

	I0912 15:14:31.428057    4601 main.go:141] libmachine: STDERR: 

	I0912 15:14:31.428094    4601 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/docker-flags-239000/disk.qcow2 +20000M

	I0912 15:14:31.435861    4601 main.go:141] libmachine: STDOUT: Image resized.

	I0912 15:14:31.435886    4601 main.go:141] libmachine: STDERR: 

	I0912 15:14:31.435901    4601 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/docker-flags-239000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/docker-flags-239000/disk.qcow2

	I0912 15:14:31.435905    4601 main.go:141] libmachine: Starting QEMU VM...

	I0912 15:14:31.435915    4601 qemu.go:418] Using hvf for hardware acceleration

	I0912 15:14:31.435944    4601 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/docker-flags-239000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/docker-flags-239000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/docker-flags-239000/qemu.pid -device virtio-net-pci,netdev=net0,mac=96:e1:59:09:fe:6a -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/docker-flags-239000/disk.qcow2

	I0912 15:14:31.437609    4601 main.go:141] libmachine: STDOUT: 

	I0912 15:14:31.437627    4601 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0912 15:14:31.437638    4601 client.go:171] duration metric: took 280.054791ms to LocalClient.Create

	I0912 15:14:33.439726    4601 start.go:128] duration metric: took 2.348625125s to createHost

	I0912 15:14:33.439776    4601 start.go:83] releasing machines lock for "docker-flags-239000", held for 2.349038459s

	W0912 15:14:33.440186    4601 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p docker-flags-239000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p docker-flags-239000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0912 15:14:33.458836    4601 out.go:201] 

	W0912 15:14:33.466680    4601 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0912 15:14:33.466697    4601 out.go:270] * 

	* 

	W0912 15:14:33.469002    4601 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0912 15:14:33.478635    4601 out.go:201] 

** /stderr **

docker_test.go:53: failed to start minikube with args: "out/minikube-darwin-arm64 start -p docker-flags-239000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=qemu2 " : exit status 80

docker_test.go:56: (dbg) Run:  out/minikube-darwin-arm64 -p docker-flags-239000 ssh "sudo systemctl show docker --property=Environment --no-pager"

docker_test.go:56: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p docker-flags-239000 ssh "sudo systemctl show docker --property=Environment --no-pager": exit status 83 (79.403ms)

-- stdout --

	* The control-plane node docker-flags-239000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p docker-flags-239000"

-- /stdout --

docker_test.go:58: failed to 'systemctl show docker' inside minikube. args "out/minikube-darwin-arm64 -p docker-flags-239000 ssh \"sudo systemctl show docker --property=Environment --no-pager\"": exit status 83

docker_test.go:63: expected env key/value "FOO=BAR" to be passed to minikube's docker and be included in: *"* The control-plane node docker-flags-239000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p docker-flags-239000\"\n"*.

docker_test.go:63: expected env key/value "BAZ=BAT" to be passed to minikube's docker and be included in: *"* The control-plane node docker-flags-239000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p docker-flags-239000\"\n"*.

docker_test.go:67: (dbg) Run:  out/minikube-darwin-arm64 -p docker-flags-239000 ssh "sudo systemctl show docker --property=ExecStart --no-pager"

docker_test.go:67: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p docker-flags-239000 ssh "sudo systemctl show docker --property=ExecStart --no-pager": exit status 83 (44.74975ms)

-- stdout --

	* The control-plane node docker-flags-239000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p docker-flags-239000"

-- /stdout --

docker_test.go:69: failed on the second 'systemctl show docker' inside minikube. args "out/minikube-darwin-arm64 -p docker-flags-239000 ssh \"sudo systemctl show docker --property=ExecStart --no-pager\"": exit status 83

docker_test.go:73: expected "out/minikube-darwin-arm64 -p docker-flags-239000 ssh \"sudo systemctl show docker --property=ExecStart --no-pager\"" output to have include *--debug* . output: "* The control-plane node docker-flags-239000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p docker-flags-239000\"\n"

panic.go:626: *** TestDockerFlags FAILED at 2024-09-12 15:14:33.6206 -0700 PDT m=+2794.082488917

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p docker-flags-239000 -n docker-flags-239000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p docker-flags-239000 -n docker-flags-239000: exit status 7 (28.734208ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "docker-flags-239000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "docker-flags-239000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p docker-flags-239000

--- FAIL: TestDockerFlags (10.34s)

=== RUN   TestForceSystemdFlag

=== PAUSE TestForceSystemdFlag

=== CONT  TestForceSystemdFlag

docker_test.go:91: (dbg) Run:  out/minikube-darwin-arm64 start -p force-systemd-flag-381000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=qemu2 

docker_test.go:91: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p force-systemd-flag-381000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=qemu2 : exit status 80 (10.210554458s)

-- stdout --

	* [force-systemd-flag-381000] minikube v1.34.0 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19616

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19616-1259/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19616-1259/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "force-systemd-flag-381000" primary control-plane node in "force-systemd-flag-381000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "force-systemd-flag-381000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0912 15:14:18.183100    4580 out.go:345] Setting OutFile to fd 1 ...

	I0912 15:14:18.183213    4580 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:14:18.183215    4580 out.go:358] Setting ErrFile to fd 2...

	I0912 15:14:18.183218    4580 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:14:18.183333    4580 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19616-1259/.minikube/bin

	I0912 15:14:18.184434    4580 out.go:352] Setting JSON to false

	I0912 15:14:18.200412    4580 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":4422,"bootTime":1726174836,"procs":472,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0912 15:14:18.200481    4580 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0912 15:14:18.207441    4580 out.go:177] * [force-systemd-flag-381000] minikube v1.34.0 on Darwin 14.5 (arm64)

	I0912 15:14:18.215334    4580 out.go:177]   - MINIKUBE_LOCATION=19616

	I0912 15:14:18.215380    4580 notify.go:220] Checking for updates...

	I0912 15:14:18.226325    4580 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19616-1259/kubeconfig

	I0912 15:14:18.229297    4580 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0912 15:14:18.232351    4580 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0912 15:14:18.235283    4580 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19616-1259/.minikube

	I0912 15:14:18.238311    4580 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0912 15:14:18.241638    4580 config.go:182] Loaded profile config "force-systemd-env-236000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I0912 15:14:18.241707    4580 config.go:182] Loaded profile config "multinode-323000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I0912 15:14:18.241755    4580 driver.go:394] Setting default libvirt URI to qemu:///system

	I0912 15:14:18.245313    4580 out.go:177] * Using the qemu2 driver based on user configuration

	I0912 15:14:18.252290    4580 start.go:297] selected driver: qemu2

	I0912 15:14:18.252296    4580 start.go:901] validating driver "qemu2" against <nil>

	I0912 15:14:18.252302    4580 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0912 15:14:18.254652    4580 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0912 15:14:18.256333    4580 out.go:177] * Automatically selected the socket_vmnet network

	I0912 15:14:18.259382    4580 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]

	I0912 15:14:18.259394    4580 cni.go:84] Creating CNI manager for ""

	I0912 15:14:18.259402    4580 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0912 15:14:18.259406    4580 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0912 15:14:18.259435    4580 start.go:340] cluster config:

	{Name:force-systemd-flag-381000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726156396-19616@sha256:66b06a42534e914a5c8ad765d7508a93a34031939ec9a6b3a818ef0a444ff889 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:force-systemd-flag-381000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster

.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet Static

IP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0912 15:14:18.263081    4580 iso.go:125] acquiring lock: {Name:mk3fa9c1c2a2731193a2e63235bbe8976497103e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0912 15:14:18.270323    4580 out.go:177] * Starting "force-systemd-flag-381000" primary control-plane node in "force-systemd-flag-381000" cluster

	I0912 15:14:18.274354    4580 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime docker

	I0912 15:14:18.274373    4580 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19616-1259/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4

	I0912 15:14:18.274388    4580 cache.go:56] Caching tarball of preloaded images

	I0912 15:14:18.274456    4580 preload.go:172] Found /Users/jenkins/minikube-integration/19616-1259/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0912 15:14:18.274462    4580 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on docker

	I0912 15:14:18.274522    4580 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/force-systemd-flag-381000/config.json ...

	I0912 15:14:18.274534    4580 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/force-systemd-flag-381000/config.json: {Name:mk4a98c8242222824199280399d3c0e1e2d0546a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0912 15:14:18.274776    4580 start.go:360] acquireMachinesLock for force-systemd-flag-381000: {Name:mk18104440c14407e7206cb5d92d4872e7d20daa Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0912 15:14:18.274814    4580 start.go:364] duration metric: took 29.541µs to acquireMachinesLock for "force-systemd-flag-381000"

	I0912 15:14:18.274828    4580 start.go:93] Provisioning new machine with config: &{Name:force-systemd-flag-381000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19616/minikube-v1.34.0-1726156389-19616-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726156396-19616@sha256:66b06a42534e914a5c8ad765d7508a93a34031939ec9a6b3a818ef0a444ff889 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernetes

Config:{KubernetesVersion:v1.31.1 ClusterName:force-systemd-flag-381000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror

: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0912 15:14:18.274862    4580 start.go:125] createHost starting for "" (driver="qemu2")

	I0912 15:14:18.283281    4580 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0912 15:14:18.301894    4580 start.go:159] libmachine.API.Create for "force-systemd-flag-381000" (driver="qemu2")

	I0912 15:14:18.301918    4580 client.go:168] LocalClient.Create starting

	I0912 15:14:18.301982    4580 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19616-1259/.minikube/certs/ca.pem

	I0912 15:14:18.302015    4580 main.go:141] libmachine: Decoding PEM data...

	I0912 15:14:18.302023    4580 main.go:141] libmachine: Parsing certificate...

	I0912 15:14:18.302073    4580 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19616-1259/.minikube/certs/cert.pem

	I0912 15:14:18.302100    4580 main.go:141] libmachine: Decoding PEM data...

	I0912 15:14:18.302109    4580 main.go:141] libmachine: Parsing certificate...

	I0912 15:14:18.302437    4580 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19616-1259/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19616-1259/.minikube/cache/iso/arm64/minikube-v1.34.0-1726156389-19616-arm64.iso...

	I0912 15:14:18.460685    4580 main.go:141] libmachine: Creating SSH key...

	I0912 15:14:18.737591    4580 main.go:141] libmachine: Creating Disk image...

	I0912 15:14:18.737602    4580 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0912 15:14:18.738088    4580 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/force-systemd-flag-381000/disk.qcow2.raw /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/force-systemd-flag-381000/disk.qcow2

	I0912 15:14:18.747795    4580 main.go:141] libmachine: STDOUT: 

	I0912 15:14:18.747816    4580 main.go:141] libmachine: STDERR: 

	I0912 15:14:18.747862    4580 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/force-systemd-flag-381000/disk.qcow2 +20000M

	I0912 15:14:18.755675    4580 main.go:141] libmachine: STDOUT: Image resized.

	I0912 15:14:18.755691    4580 main.go:141] libmachine: STDERR: 

	I0912 15:14:18.755708    4580 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/force-systemd-flag-381000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/force-systemd-flag-381000/disk.qcow2

	I0912 15:14:18.755715    4580 main.go:141] libmachine: Starting QEMU VM...

	I0912 15:14:18.755730    4580 qemu.go:418] Using hvf for hardware acceleration

	I0912 15:14:18.755756    4580 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/force-systemd-flag-381000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/force-systemd-flag-381000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/force-systemd-flag-381000/qemu.pid -device virtio-net-pci,netdev=net0,mac=76:31:51:ff:39:a5 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/force-systemd-flag-381000/disk.qcow2

	I0912 15:14:18.757324    4580 main.go:141] libmachine: STDOUT: 

	I0912 15:14:18.757346    4580 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0912 15:14:18.757369    4580 client.go:171] duration metric: took 455.45725ms to LocalClient.Create

	I0912 15:14:20.759485    4580 start.go:128] duration metric: took 2.484672292s to createHost

	I0912 15:14:20.759603    4580 start.go:83] releasing machines lock for "force-systemd-flag-381000", held for 2.48484675s

	W0912 15:14:20.759656    4580 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0912 15:14:20.784675    4580 out.go:177] * Deleting "force-systemd-flag-381000" in qemu2 ...

	W0912 15:14:20.810435    4580 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0912 15:14:20.810459    4580 start.go:729] Will try again in 5 seconds ...

	I0912 15:14:25.812480    4580 start.go:360] acquireMachinesLock for force-systemd-flag-381000: {Name:mk18104440c14407e7206cb5d92d4872e7d20daa Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0912 15:14:25.911800    4580 start.go:364] duration metric: took 99.1695ms to acquireMachinesLock for "force-systemd-flag-381000"

	I0912 15:14:25.911937    4580 start.go:93] Provisioning new machine with config: &{Name:force-systemd-flag-381000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19616/minikube-v1.34.0-1726156389-19616-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726156396-19616@sha256:66b06a42534e914a5c8ad765d7508a93a34031939ec9a6b3a818ef0a444ff889 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernetes

Config:{KubernetesVersion:v1.31.1 ClusterName:force-systemd-flag-381000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror

: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0912 15:14:25.912198    4580 start.go:125] createHost starting for "" (driver="qemu2")

	I0912 15:14:25.926776    4580 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0912 15:14:25.977072    4580 start.go:159] libmachine.API.Create for "force-systemd-flag-381000" (driver="qemu2")

	I0912 15:14:25.977117    4580 client.go:168] LocalClient.Create starting

	I0912 15:14:25.977236    4580 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19616-1259/.minikube/certs/ca.pem

	I0912 15:14:25.977312    4580 main.go:141] libmachine: Decoding PEM data...

	I0912 15:14:25.977326    4580 main.go:141] libmachine: Parsing certificate...

	I0912 15:14:25.977389    4580 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19616-1259/.minikube/certs/cert.pem

	I0912 15:14:25.977438    4580 main.go:141] libmachine: Decoding PEM data...

	I0912 15:14:25.977451    4580 main.go:141] libmachine: Parsing certificate...

	I0912 15:14:25.978059    4580 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19616-1259/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19616-1259/.minikube/cache/iso/arm64/minikube-v1.34.0-1726156389-19616-arm64.iso...

	I0912 15:14:26.160316    4580 main.go:141] libmachine: Creating SSH key...

	I0912 15:14:26.291767    4580 main.go:141] libmachine: Creating Disk image...

	I0912 15:14:26.291776    4580 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0912 15:14:26.291968    4580 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/force-systemd-flag-381000/disk.qcow2.raw /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/force-systemd-flag-381000/disk.qcow2

	I0912 15:14:26.301308    4580 main.go:141] libmachine: STDOUT: 

	I0912 15:14:26.301325    4580 main.go:141] libmachine: STDERR: 

	I0912 15:14:26.301372    4580 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/force-systemd-flag-381000/disk.qcow2 +20000M

	I0912 15:14:26.309296    4580 main.go:141] libmachine: STDOUT: Image resized.

	I0912 15:14:26.309309    4580 main.go:141] libmachine: STDERR: 

	I0912 15:14:26.309321    4580 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/force-systemd-flag-381000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/force-systemd-flag-381000/disk.qcow2

	I0912 15:14:26.309328    4580 main.go:141] libmachine: Starting QEMU VM...

	I0912 15:14:26.309339    4580 qemu.go:418] Using hvf for hardware acceleration

	I0912 15:14:26.309375    4580 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/force-systemd-flag-381000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/force-systemd-flag-381000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/force-systemd-flag-381000/qemu.pid -device virtio-net-pci,netdev=net0,mac=de:3b:44:ad:ff:7e -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/force-systemd-flag-381000/disk.qcow2

	I0912 15:14:26.311021    4580 main.go:141] libmachine: STDOUT: 

	I0912 15:14:26.311034    4580 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0912 15:14:26.311048    4580 client.go:171] duration metric: took 333.932958ms to LocalClient.Create

	I0912 15:14:28.313282    4580 start.go:128] duration metric: took 2.401071375s to createHost

	I0912 15:14:28.313390    4580 start.go:83] releasing machines lock for "force-systemd-flag-381000", held for 2.401616917s

	W0912 15:14:28.313773    4580 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p force-systemd-flag-381000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p force-systemd-flag-381000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0912 15:14:28.331362    4580 out.go:201] 

	W0912 15:14:28.340333    4580 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0912 15:14:28.340372    4580 out.go:270] * 

	* 

	W0912 15:14:28.342244    4580 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0912 15:14:28.352269    4580 out.go:201] 

** /stderr **

docker_test.go:93: failed to start minikube with args: "out/minikube-darwin-arm64 start -p force-systemd-flag-381000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=qemu2 " : exit status 80

docker_test.go:110: (dbg) Run:  out/minikube-darwin-arm64 -p force-systemd-flag-381000 ssh "docker info --format {{.CgroupDriver}}"

docker_test.go:110: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p force-systemd-flag-381000 ssh "docker info --format {{.CgroupDriver}}": exit status 83 (76.037542ms)

-- stdout --

	* The control-plane node force-systemd-flag-381000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p force-systemd-flag-381000"

-- /stdout --

docker_test.go:112: failed to get docker cgroup driver. args "out/minikube-darwin-arm64 -p force-systemd-flag-381000 ssh \"docker info --format {{.CgroupDriver}}\"": exit status 83

docker_test.go:106: *** TestForceSystemdFlag FAILED at 2024-09-12 15:14:28.445257 -0700 PDT m=+2788.907000209

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-flag-381000 -n force-systemd-flag-381000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-flag-381000 -n force-systemd-flag-381000: exit status 7 (34.802958ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "force-systemd-flag-381000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "force-systemd-flag-381000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p force-systemd-flag-381000

--- FAIL: TestForceSystemdFlag (10.40s)

=== RUN   TestForceSystemdEnv

=== PAUSE TestForceSystemdEnv

=== CONT  TestForceSystemdEnv

docker_test.go:155: (dbg) Run:  out/minikube-darwin-arm64 start -p force-systemd-env-236000 --memory=2048 --alsologtostderr -v=5 --driver=qemu2 

docker_test.go:155: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p force-systemd-env-236000 --memory=2048 --alsologtostderr -v=5 --driver=qemu2 : exit status 80 (10.324586375s)

-- stdout --

	* [force-systemd-env-236000] minikube v1.34.0 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19616

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19616-1259/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19616-1259/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=true

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "force-systemd-env-236000" primary control-plane node in "force-systemd-env-236000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "force-systemd-env-236000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0912 15:14:12.903744    4548 out.go:345] Setting OutFile to fd 1 ...

	I0912 15:14:12.903860    4548 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:14:12.903863    4548 out.go:358] Setting ErrFile to fd 2...

	I0912 15:14:12.903865    4548 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:14:12.904004    4548 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19616-1259/.minikube/bin

	I0912 15:14:12.905109    4548 out.go:352] Setting JSON to false

	I0912 15:14:12.921842    4548 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":4416,"bootTime":1726174836,"procs":471,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0912 15:14:12.921914    4548 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0912 15:14:12.927242    4548 out.go:177] * [force-systemd-env-236000] minikube v1.34.0 on Darwin 14.5 (arm64)

	I0912 15:14:12.936384    4548 out.go:177]   - MINIKUBE_LOCATION=19616

	I0912 15:14:12.936439    4548 notify.go:220] Checking for updates...

	I0912 15:14:12.943313    4548 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19616-1259/kubeconfig

	I0912 15:14:12.946319    4548 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0912 15:14:12.949325    4548 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0912 15:14:12.957340    4548 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19616-1259/.minikube

	I0912 15:14:12.960374    4548 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=true

	I0912 15:14:12.963668    4548 config.go:182] Loaded profile config "multinode-323000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I0912 15:14:12.963727    4548 driver.go:394] Setting default libvirt URI to qemu:///system

	I0912 15:14:12.967338    4548 out.go:177] * Using the qemu2 driver based on user configuration

	I0912 15:14:12.974282    4548 start.go:297] selected driver: qemu2

	I0912 15:14:12.974287    4548 start.go:901] validating driver "qemu2" against <nil>

	I0912 15:14:12.974298    4548 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0912 15:14:12.976676    4548 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0912 15:14:12.980323    4548 out.go:177] * Automatically selected the socket_vmnet network

	I0912 15:14:12.984405    4548 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]

	I0912 15:14:12.984432    4548 cni.go:84] Creating CNI manager for ""

	I0912 15:14:12.984446    4548 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0912 15:14:12.984453    4548 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0912 15:14:12.984482    4548 start.go:340] cluster config:

	{Name:force-systemd-env-236000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726156396-19616@sha256:66b06a42534e914a5c8ad765d7508a93a34031939ec9a6b3a818ef0a444ff889 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:force-systemd-env-236000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.l

ocal ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP

: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0912 15:14:12.988372    4548 iso.go:125] acquiring lock: {Name:mk3fa9c1c2a2731193a2e63235bbe8976497103e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0912 15:14:12.995323    4548 out.go:177] * Starting "force-systemd-env-236000" primary control-plane node in "force-systemd-env-236000" cluster

	I0912 15:14:12.999315    4548 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime docker

	I0912 15:14:12.999328    4548 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19616-1259/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4

	I0912 15:14:12.999334    4548 cache.go:56] Caching tarball of preloaded images

	I0912 15:14:12.999395    4548 preload.go:172] Found /Users/jenkins/minikube-integration/19616-1259/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0912 15:14:12.999399    4548 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on docker

	I0912 15:14:12.999451    4548 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/force-systemd-env-236000/config.json ...

	I0912 15:14:12.999461    4548 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/force-systemd-env-236000/config.json: {Name:mkbdd9e15e322c81135bdcf9d6425be207b1d25a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0912 15:14:12.999654    4548 start.go:360] acquireMachinesLock for force-systemd-env-236000: {Name:mk18104440c14407e7206cb5d92d4872e7d20daa Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0912 15:14:12.999687    4548 start.go:364] duration metric: took 25.541µs to acquireMachinesLock for "force-systemd-env-236000"

	I0912 15:14:12.999699    4548 start.go:93] Provisioning new machine with config: &{Name:force-systemd-env-236000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19616/minikube-v1.34.0-1726156389-19616-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726156396-19616@sha256:66b06a42534e914a5c8ad765d7508a93a34031939ec9a6b3a818ef0a444ff889 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC

onfig:{KubernetesVersion:v1.31.1 ClusterName:force-systemd-env-236000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror:

DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0912 15:14:12.999730    4548 start.go:125] createHost starting for "" (driver="qemu2")

	I0912 15:14:13.007288    4548 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0912 15:14:13.024113    4548 start.go:159] libmachine.API.Create for "force-systemd-env-236000" (driver="qemu2")

	I0912 15:14:13.024143    4548 client.go:168] LocalClient.Create starting

	I0912 15:14:13.024222    4548 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19616-1259/.minikube/certs/ca.pem

	I0912 15:14:13.024256    4548 main.go:141] libmachine: Decoding PEM data...

	I0912 15:14:13.024263    4548 main.go:141] libmachine: Parsing certificate...

	I0912 15:14:13.024301    4548 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19616-1259/.minikube/certs/cert.pem

	I0912 15:14:13.024324    4548 main.go:141] libmachine: Decoding PEM data...

	I0912 15:14:13.024336    4548 main.go:141] libmachine: Parsing certificate...

	I0912 15:14:13.024720    4548 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19616-1259/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19616-1259/.minikube/cache/iso/arm64/minikube-v1.34.0-1726156389-19616-arm64.iso...

	I0912 15:14:13.212891    4548 main.go:141] libmachine: Creating SSH key...

	I0912 15:14:13.306438    4548 main.go:141] libmachine: Creating Disk image...

	I0912 15:14:13.306448    4548 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0912 15:14:13.306742    4548 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/force-systemd-env-236000/disk.qcow2.raw /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/force-systemd-env-236000/disk.qcow2

	I0912 15:14:13.316422    4548 main.go:141] libmachine: STDOUT: 

	I0912 15:14:13.316442    4548 main.go:141] libmachine: STDERR: 

	I0912 15:14:13.316492    4548 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/force-systemd-env-236000/disk.qcow2 +20000M

	I0912 15:14:13.324679    4548 main.go:141] libmachine: STDOUT: Image resized.

	I0912 15:14:13.324695    4548 main.go:141] libmachine: STDERR: 

	I0912 15:14:13.324707    4548 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/force-systemd-env-236000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/force-systemd-env-236000/disk.qcow2

	I0912 15:14:13.324711    4548 main.go:141] libmachine: Starting QEMU VM...

	I0912 15:14:13.324725    4548 qemu.go:418] Using hvf for hardware acceleration

	I0912 15:14:13.324753    4548 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/force-systemd-env-236000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/force-systemd-env-236000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/force-systemd-env-236000/qemu.pid -device virtio-net-pci,netdev=net0,mac=d6:61:6c:79:dc:f4 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/force-systemd-env-236000/disk.qcow2

	I0912 15:14:13.326493    4548 main.go:141] libmachine: STDOUT: 

	I0912 15:14:13.326508    4548 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0912 15:14:13.326532    4548 client.go:171] duration metric: took 302.393917ms to LocalClient.Create

	I0912 15:14:15.328698    4548 start.go:128] duration metric: took 2.329003959s to createHost

	I0912 15:14:15.328780    4548 start.go:83] releasing machines lock for "force-systemd-env-236000", held for 2.329148041s

	W0912 15:14:15.328903    4548 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0912 15:14:15.336155    4548 out.go:177] * Deleting "force-systemd-env-236000" in qemu2 ...

	W0912 15:14:15.369890    4548 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0912 15:14:15.369917    4548 start.go:729] Will try again in 5 seconds ...

	I0912 15:14:20.371946    4548 start.go:360] acquireMachinesLock for force-systemd-env-236000: {Name:mk18104440c14407e7206cb5d92d4872e7d20daa Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0912 15:14:20.759729    4548 start.go:364] duration metric: took 387.6725ms to acquireMachinesLock for "force-systemd-env-236000"

	I0912 15:14:20.759883    4548 start.go:93] Provisioning new machine with config: &{Name:force-systemd-env-236000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19616/minikube-v1.34.0-1726156389-19616-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726156396-19616@sha256:66b06a42534e914a5c8ad765d7508a93a34031939ec9a6b3a818ef0a444ff889 Memory:2048 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC

onfig:{KubernetesVersion:v1.31.1 ClusterName:force-systemd-env-236000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror:

DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0912 15:14:20.760074    4548 start.go:125] createHost starting for "" (driver="qemu2")

	I0912 15:14:20.775697    4548 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0912 15:14:20.825137    4548 start.go:159] libmachine.API.Create for "force-systemd-env-236000" (driver="qemu2")

	I0912 15:14:20.825189    4548 client.go:168] LocalClient.Create starting

	I0912 15:14:20.825287    4548 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19616-1259/.minikube/certs/ca.pem

	I0912 15:14:20.825358    4548 main.go:141] libmachine: Decoding PEM data...

	I0912 15:14:20.825389    4548 main.go:141] libmachine: Parsing certificate...

	I0912 15:14:20.825448    4548 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19616-1259/.minikube/certs/cert.pem

	I0912 15:14:20.825493    4548 main.go:141] libmachine: Decoding PEM data...

	I0912 15:14:20.825506    4548 main.go:141] libmachine: Parsing certificate...

	I0912 15:14:20.826155    4548 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19616-1259/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19616-1259/.minikube/cache/iso/arm64/minikube-v1.34.0-1726156389-19616-arm64.iso...

	I0912 15:14:21.011514    4548 main.go:141] libmachine: Creating SSH key...

	I0912 15:14:21.123624    4548 main.go:141] libmachine: Creating Disk image...

	I0912 15:14:21.123629    4548 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0912 15:14:21.123852    4548 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/force-systemd-env-236000/disk.qcow2.raw /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/force-systemd-env-236000/disk.qcow2

	I0912 15:14:21.133417    4548 main.go:141] libmachine: STDOUT: 

	I0912 15:14:21.133439    4548 main.go:141] libmachine: STDERR: 

	I0912 15:14:21.133484    4548 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/force-systemd-env-236000/disk.qcow2 +20000M

	I0912 15:14:21.141412    4548 main.go:141] libmachine: STDOUT: Image resized.

	I0912 15:14:21.141436    4548 main.go:141] libmachine: STDERR: 

	I0912 15:14:21.141447    4548 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/force-systemd-env-236000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/force-systemd-env-236000/disk.qcow2

	I0912 15:14:21.141452    4548 main.go:141] libmachine: Starting QEMU VM...

	I0912 15:14:21.141460    4548 qemu.go:418] Using hvf for hardware acceleration

	I0912 15:14:21.141491    4548 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/force-systemd-env-236000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/force-systemd-env-236000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/force-systemd-env-236000/qemu.pid -device virtio-net-pci,netdev=net0,mac=3a:3c:e4:82:e8:7c -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/force-systemd-env-236000/disk.qcow2

	I0912 15:14:21.143174    4548 main.go:141] libmachine: STDOUT: 

	I0912 15:14:21.143192    4548 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0912 15:14:21.143204    4548 client.go:171] duration metric: took 318.019583ms to LocalClient.Create

	I0912 15:14:23.145487    4548 start.go:128] duration metric: took 2.385428083s to createHost

	I0912 15:14:23.145558    4548 start.go:83] releasing machines lock for "force-systemd-env-236000", held for 2.385862375s

	W0912 15:14:23.145903    4548 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p force-systemd-env-236000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p force-systemd-env-236000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0912 15:14:23.162571    4548 out.go:201] 

	W0912 15:14:23.171427    4548 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0912 15:14:23.171445    4548 out.go:270] * 

	* 

	W0912 15:14:23.173521    4548 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0912 15:14:23.184382    4548 out.go:201] 

** /stderr **

docker_test.go:157: failed to start minikube with args: "out/minikube-darwin-arm64 start -p force-systemd-env-236000 --memory=2048 --alsologtostderr -v=5 --driver=qemu2 " : exit status 80

docker_test.go:110: (dbg) Run:  out/minikube-darwin-arm64 -p force-systemd-env-236000 ssh "docker info --format {{.CgroupDriver}}"

docker_test.go:110: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p force-systemd-env-236000 ssh "docker info --format {{.CgroupDriver}}": exit status 83 (78.314958ms)

-- stdout --

	* The control-plane node force-systemd-env-236000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p force-systemd-env-236000"

-- /stdout --

docker_test.go:112: failed to get docker cgroup driver. args "out/minikube-darwin-arm64 -p force-systemd-env-236000 ssh \"docker info --format {{.CgroupDriver}}\"": exit status 83

docker_test.go:166: *** TestForceSystemdEnv FAILED at 2024-09-12 15:14:23.280411 -0700 PDT m=+2783.742009376

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-env-236000 -n force-systemd-env-236000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-env-236000 -n force-systemd-env-236000: exit status 7 (35.753625ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "force-systemd-env-236000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "force-systemd-env-236000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p force-systemd-env-236000

--- FAIL: TestForceSystemdEnv (10.52s)

=== RUN   TestFunctional/parallel/ServiceCmdConnect

=== PAUSE TestFunctional/parallel/ServiceCmdConnect

=== CONT  TestFunctional/parallel/ServiceCmdConnect

functional_test.go:1627: (dbg) Run:  kubectl --context functional-384000 create deployment hello-node-connect --image=registry.k8s.io/echoserver-arm:1.8

functional_test.go:1635: (dbg) Run:  kubectl --context functional-384000 expose deployment hello-node-connect --type=NodePort --port=8080

functional_test.go:1640: (dbg) TestFunctional/parallel/ServiceCmdConnect: waiting 10m0s for pods matching "app=hello-node-connect" in namespace "default" ...

helpers_test.go:344: "hello-node-connect-65d86f57f4-vc7hw" [1bff9fcb-c996-4630-ac27-ff2ca00b3c31] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])

helpers_test.go:344: "hello-node-connect-65d86f57f4-vc7hw" [1bff9fcb-c996-4630-ac27-ff2ca00b3c31] Running / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])

functional_test.go:1640: (dbg) TestFunctional/parallel/ServiceCmdConnect: app=hello-node-connect healthy within 10.006933375s

functional_test.go:1649: (dbg) Run:  out/minikube-darwin-arm64 -p functional-384000 service hello-node-connect --url

functional_test.go:1655: found endpoint for hello-node-connect: http://192.168.105.4:30546

functional_test.go:1661: error fetching http://192.168.105.4:30546: Get "http://192.168.105.4:30546": dial tcp 192.168.105.4:30546: connect: connection refused

functional_test.go:1661: error fetching http://192.168.105.4:30546: Get "http://192.168.105.4:30546": dial tcp 192.168.105.4:30546: connect: connection refused

E0912 14:47:27.469541    1784 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/addons-094000/client.crt: no such file or directory" logger="UnhandledError"

functional_test.go:1661: error fetching http://192.168.105.4:30546: Get "http://192.168.105.4:30546": dial tcp 192.168.105.4:30546: connect: connection refused

functional_test.go:1661: error fetching http://192.168.105.4:30546: Get "http://192.168.105.4:30546": dial tcp 192.168.105.4:30546: connect: connection refused

functional_test.go:1661: error fetching http://192.168.105.4:30546: Get "http://192.168.105.4:30546": dial tcp 192.168.105.4:30546: connect: connection refused

2024/09/12 14:47:36 [DEBUG] GET http://127.0.0.1:36195/api/v1/namespaces/kubernetes-dashboard/services/http:kubernetes-dashboard:/proxy/

functional_test.go:1661: error fetching http://192.168.105.4:30546: Get "http://192.168.105.4:30546": dial tcp 192.168.105.4:30546: connect: connection refused

functional_test.go:1661: error fetching http://192.168.105.4:30546: Get "http://192.168.105.4:30546": dial tcp 192.168.105.4:30546: connect: connection refused

functional_test.go:1681: failed to fetch http://192.168.105.4:30546: Get "http://192.168.105.4:30546": dial tcp 192.168.105.4:30546: connect: connection refused

functional_test.go:1598: service test failed - dumping debug information

functional_test.go:1599: -----------------------service failure post-mortem--------------------------------

functional_test.go:1602: (dbg) Run:  kubectl --context functional-384000 describe po hello-node-connect

functional_test.go:1606: hello-node pod describe:

Name:             hello-node-connect-65d86f57f4-vc7hw

Namespace:        default

Priority:         0

Service Account:  default

Node:             functional-384000/192.168.105.4

Start Time:       Thu, 12 Sep 2024 14:47:16 -0700

Labels:           app=hello-node-connect

pod-template-hash=65d86f57f4

Annotations:      <none>

Status:           Running

IP:               10.244.0.10

IPs:

IP:           10.244.0.10

Controlled By:  ReplicaSet/hello-node-connect-65d86f57f4

Containers:

echoserver-arm:

Container ID:   docker://0df32a8efdd6d86a5749cd0350b0ccd395e5400bc81bc5200390cb682771200e

Image:          registry.k8s.io/echoserver-arm:1.8

Image ID:       docker-pullable://registry.k8s.io/echoserver-arm@sha256:b33d4cdf6ed097f4e9b77b135d83a596ab73c6268b0342648818eb85f5edfdb5

Port:           <none>

Host Port:      <none>

State:          Terminated

Reason:       Error

Exit Code:    1

Started:      Thu, 12 Sep 2024 14:47:36 -0700

Finished:     Thu, 12 Sep 2024 14:47:36 -0700

Last State:     Terminated

Reason:       Error

Exit Code:    1

Started:      Thu, 12 Sep 2024 14:47:20 -0700

Finished:     Thu, 12 Sep 2024 14:47:20 -0700

Ready:          False

Restart Count:  2

Environment:    <none>

Mounts:

/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-7qjvf (ro)

Conditions:

Type                        Status

PodReadyToStartContainers   True 

Initialized                 True 

Ready                       False 

ContainersReady             False 

PodScheduled                True 

Volumes:

kube-api-access-7qjvf:

Type:                    Projected (a volume that contains injected data from multiple sources)

TokenExpirationSeconds:  3607

ConfigMapName:           kube-root-ca.crt

ConfigMapOptional:       <nil>

DownwardAPI:             true

QoS Class:                   BestEffort

Node-Selectors:              <none>

Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

Events:

Type     Reason     Age               From               Message

----     ------     ----              ----               -------

Normal   Scheduled  28s               default-scheduler  Successfully assigned default/hello-node-connect-65d86f57f4-vc7hw to functional-384000

Normal   Pulling    28s               kubelet            Pulling image "registry.k8s.io/echoserver-arm:1.8"

Normal   Pulled     24s               kubelet            Successfully pulled image "registry.k8s.io/echoserver-arm:1.8" in 3.884s (3.884s including waiting). Image size: 84957542 bytes.

Normal   Created    8s (x3 over 24s)  kubelet            Created container echoserver-arm

Normal   Started    8s (x3 over 24s)  kubelet            Started container echoserver-arm

Normal   Pulled     8s (x2 over 24s)  kubelet            Container image "registry.k8s.io/echoserver-arm:1.8" already present on machine

Warning  BackOff    7s (x3 over 23s)  kubelet            Back-off restarting failed container echoserver-arm in pod hello-node-connect-65d86f57f4-vc7hw_default(1bff9fcb-c996-4630-ac27-ff2ca00b3c31)

functional_test.go:1608: (dbg) Run:  kubectl --context functional-384000 logs -l app=hello-node-connect

functional_test.go:1612: hello-node logs:

exec /usr/sbin/nginx: exec format error

functional_test.go:1614: (dbg) Run:  kubectl --context functional-384000 describe svc hello-node-connect

functional_test.go:1618: hello-node svc describe:

Name:                     hello-node-connect

Namespace:                default

Labels:                   app=hello-node-connect

Annotations:              <none>

Selector:                 app=hello-node-connect

Type:                     NodePort

IP Family Policy:         SingleStack

IP Families:              IPv4

IP:                       10.104.75.219

IPs:                      10.104.75.219

Port:                     <unset>  8080/TCP

TargetPort:               8080/TCP

NodePort:                 <unset>  30546/TCP

Endpoints:                

Session Affinity:         None

External Traffic Policy:  Cluster

Events:                   <none>

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p functional-384000 -n functional-384000

helpers_test.go:244: <<< TestFunctional/parallel/ServiceCmdConnect FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestFunctional/parallel/ServiceCmdConnect]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-darwin-arm64 -p functional-384000 logs -n 25

helpers_test.go:252: TestFunctional/parallel/ServiceCmdConnect logs: 

-- stdout --

	==> Audit <==

	|----------------|--------------------------------------|-------------------|---------|---------|---------------------|---------------------|

	|    Command     |                 Args                 |      Profile      |  User   | Version |     Start Time      |      End Time       |

	|----------------|--------------------------------------|-------------------|---------|---------|---------------------|---------------------|

	| ssh            | functional-384000 ssh findmnt        | functional-384000 | jenkins | v1.34.0 | 12 Sep 24 14:47 PDT | 12 Sep 24 14:47 PDT |

	|                | -T /mount2                           |                   |         |         |                     |                     |

	| ssh            | functional-384000 ssh findmnt        | functional-384000 | jenkins | v1.34.0 | 12 Sep 24 14:47 PDT | 12 Sep 24 14:47 PDT |

	|                | -T /mount3                           |                   |         |         |                     |                     |

	| mount          | -p functional-384000                 | functional-384000 | jenkins | v1.34.0 | 12 Sep 24 14:47 PDT |                     |

	|                | --kill=true                          |                   |         |         |                     |                     |

	| addons         | functional-384000 addons list        | functional-384000 | jenkins | v1.34.0 | 12 Sep 24 14:47 PDT | 12 Sep 24 14:47 PDT |

	| addons         | functional-384000 addons list        | functional-384000 | jenkins | v1.34.0 | 12 Sep 24 14:47 PDT | 12 Sep 24 14:47 PDT |

	|                | -o json                              |                   |         |         |                     |                     |

	| service        | functional-384000 service            | functional-384000 | jenkins | v1.34.0 | 12 Sep 24 14:47 PDT | 12 Sep 24 14:47 PDT |

	|                | hello-node-connect --url             |                   |         |         |                     |                     |

	| service        | functional-384000 service list       | functional-384000 | jenkins | v1.34.0 | 12 Sep 24 14:47 PDT | 12 Sep 24 14:47 PDT |

	| service        | functional-384000 service list       | functional-384000 | jenkins | v1.34.0 | 12 Sep 24 14:47 PDT | 12 Sep 24 14:47 PDT |

	|                | -o json                              |                   |         |         |                     |                     |

	| service        | functional-384000 service            | functional-384000 | jenkins | v1.34.0 | 12 Sep 24 14:47 PDT | 12 Sep 24 14:47 PDT |

	|                | --namespace=default --https          |                   |         |         |                     |                     |

	|                | --url hello-node                     |                   |         |         |                     |                     |

	| service        | functional-384000                    | functional-384000 | jenkins | v1.34.0 | 12 Sep 24 14:47 PDT | 12 Sep 24 14:47 PDT |

	|                | service hello-node --url             |                   |         |         |                     |                     |

	|                | --format={{.IP}}                     |                   |         |         |                     |                     |

	| service        | functional-384000 service            | functional-384000 | jenkins | v1.34.0 | 12 Sep 24 14:47 PDT | 12 Sep 24 14:47 PDT |

	|                | hello-node --url                     |                   |         |         |                     |                     |

	| start          | -p functional-384000                 | functional-384000 | jenkins | v1.34.0 | 12 Sep 24 14:47 PDT |                     |

	|                | --dry-run --memory                   |                   |         |         |                     |                     |

	|                | 250MB --alsologtostderr              |                   |         |         |                     |                     |

	|                | --driver=qemu2                       |                   |         |         |                     |                     |

	| start          | -p functional-384000                 | functional-384000 | jenkins | v1.34.0 | 12 Sep 24 14:47 PDT |                     |

	|                | --dry-run --memory                   |                   |         |         |                     |                     |

	|                | 250MB --alsologtostderr              |                   |         |         |                     |                     |

	|                | --driver=qemu2                       |                   |         |         |                     |                     |

	| start          | -p functional-384000 --dry-run       | functional-384000 | jenkins | v1.34.0 | 12 Sep 24 14:47 PDT |                     |

	|                | --alsologtostderr -v=1               |                   |         |         |                     |                     |

	|                | --driver=qemu2                       |                   |         |         |                     |                     |

	| dashboard      | --url --port 36195                   | functional-384000 | jenkins | v1.34.0 | 12 Sep 24 14:47 PDT | 12 Sep 24 14:47 PDT |

	|                | -p functional-384000                 |                   |         |         |                     |                     |

	|                | --alsologtostderr -v=1               |                   |         |         |                     |                     |

	| image          | functional-384000                    | functional-384000 | jenkins | v1.34.0 | 12 Sep 24 14:47 PDT | 12 Sep 24 14:47 PDT |

	|                | image ls --format short              |                   |         |         |                     |                     |

	|                | --alsologtostderr                    |                   |         |         |                     |                     |

	| image          | functional-384000                    | functional-384000 | jenkins | v1.34.0 | 12 Sep 24 14:47 PDT | 12 Sep 24 14:47 PDT |

	|                | image ls --format json               |                   |         |         |                     |                     |

	|                | --alsologtostderr                    |                   |         |         |                     |                     |

	| image          | functional-384000                    | functional-384000 | jenkins | v1.34.0 | 12 Sep 24 14:47 PDT | 12 Sep 24 14:47 PDT |

	|                | image ls --format yaml               |                   |         |         |                     |                     |

	|                | --alsologtostderr                    |                   |         |         |                     |                     |

	| image          | functional-384000                    | functional-384000 | jenkins | v1.34.0 | 12 Sep 24 14:47 PDT | 12 Sep 24 14:47 PDT |

	|                | image ls --format table              |                   |         |         |                     |                     |

	|                | --alsologtostderr                    |                   |         |         |                     |                     |

	| ssh            | functional-384000 ssh pgrep          | functional-384000 | jenkins | v1.34.0 | 12 Sep 24 14:47 PDT |                     |

	|                | buildkitd                            |                   |         |         |                     |                     |

	| image          | functional-384000 image build -t     | functional-384000 | jenkins | v1.34.0 | 12 Sep 24 14:47 PDT | 12 Sep 24 14:47 PDT |

	|                | localhost/my-image:functional-384000 |                   |         |         |                     |                     |

	|                | testdata/build --alsologtostderr     |                   |         |         |                     |                     |

	| image          | functional-384000 image ls           | functional-384000 | jenkins | v1.34.0 | 12 Sep 24 14:47 PDT | 12 Sep 24 14:47 PDT |

	| update-context | functional-384000                    | functional-384000 | jenkins | v1.34.0 | 12 Sep 24 14:47 PDT | 12 Sep 24 14:47 PDT |

	|                | update-context                       |                   |         |         |                     |                     |

	|                | --alsologtostderr -v=2               |                   |         |         |                     |                     |

	| update-context | functional-384000                    | functional-384000 | jenkins | v1.34.0 | 12 Sep 24 14:47 PDT | 12 Sep 24 14:47 PDT |

	|                | update-context                       |                   |         |         |                     |                     |

	|                | --alsologtostderr -v=2               |                   |         |         |                     |                     |

	| update-context | functional-384000                    | functional-384000 | jenkins | v1.34.0 | 12 Sep 24 14:47 PDT | 12 Sep 24 14:47 PDT |

	|                | update-context                       |                   |         |         |                     |                     |

	|                | --alsologtostderr -v=2               |                   |         |         |                     |                     |

	|----------------|--------------------------------------|-------------------|---------|---------|---------------------|---------------------|

	==> Last Start <==

	Log file created at: 2024/09/12 14:47:29

	Running on machine: MacOS-M1-Agent-2

	Binary: Built with gc go1.22.5 for darwin/arm64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0912 14:47:29.676182    2950 out.go:345] Setting OutFile to fd 1 ...

	I0912 14:47:29.676300    2950 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 14:47:29.676302    2950 out.go:358] Setting ErrFile to fd 2...

	I0912 14:47:29.676308    2950 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 14:47:29.676415    2950 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19616-1259/.minikube/bin

	I0912 14:47:29.677621    2950 out.go:352] Setting JSON to false

	I0912 14:47:29.694733    2950 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":2813,"bootTime":1726174836,"procs":485,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0912 14:47:29.694803    2950 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0912 14:47:29.698692    2950 out.go:177] * [functional-384000] minikube v1.34.0 on Darwin 14.5 (arm64)

	I0912 14:47:29.705751    2950 out.go:177]   - MINIKUBE_LOCATION=19616

	I0912 14:47:29.705822    2950 notify.go:220] Checking for updates...

	I0912 14:47:29.712754    2950 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19616-1259/kubeconfig

	I0912 14:47:29.715758    2950 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0912 14:47:29.718766    2950 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0912 14:47:29.721737    2950 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19616-1259/.minikube

	I0912 14:47:29.724767    2950 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0912 14:47:29.726272    2950 config.go:182] Loaded profile config "functional-384000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I0912 14:47:29.726523    2950 driver.go:394] Setting default libvirt URI to qemu:///system

	I0912 14:47:29.730703    2950 out.go:177] * Using the qemu2 driver based on existing profile

	I0912 14:47:29.737587    2950 start.go:297] selected driver: qemu2

	I0912 14:47:29.737594    2950 start.go:901] validating driver "qemu2" against &{Name:functional-384000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19616/minikube-v1.34.0-1726156389-19616-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726156396-19616@sha256:66b06a42534e914a5c8ad765d7508a93a34031939ec9a6b3a818ef0a444ff889 Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kub

ernetesVersion:v1.31.1 ClusterName:functional-384000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.4 Port:8441 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpirat

ion:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0912 14:47:29.737664    2950 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0912 14:47:29.739882    2950 cni.go:84] Creating CNI manager for ""

	I0912 14:47:29.739895    2950 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0912 14:47:29.739935    2950 start.go:340] cluster config:

	{Name:functional-384000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19616/minikube-v1.34.0-1726156389-19616-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726156396-19616@sha256:66b06a42534e914a5c8ad765d7508a93a34031939ec9a6b3a818ef0a444ff889 Memory:4000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:functional-384000 Namespace:default APIServe

rHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.4 Port:8441 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2

000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0912 14:47:29.751727    2950 out.go:177] * dry-run validation complete!

	==> Docker <==

	Sep 12 21:47:35 functional-384000 dockerd[5658]: time="2024-09-12T21:47:35.776685187Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Sep 12 21:47:35 functional-384000 dockerd[5658]: time="2024-09-12T21:47:35.776894237Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Sep 12 21:47:35 functional-384000 dockerd[5652]: time="2024-09-12T21:47:35.866369690Z" level=warning msg="reference for unknown type: " digest="sha256:76049887f07a0476dc93efc2d3569b9529bf982b22d29f356092ce206e98765c" remote="docker.io/kubernetesui/metrics-scraper@sha256:76049887f07a0476dc93efc2d3569b9529bf982b22d29f356092ce206e98765c"

	Sep 12 21:47:36 functional-384000 dockerd[5658]: time="2024-09-12T21:47:36.174705022Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Sep 12 21:47:36 functional-384000 dockerd[5658]: time="2024-09-12T21:47:36.174767679Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Sep 12 21:47:36 functional-384000 dockerd[5658]: time="2024-09-12T21:47:36.174781885Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Sep 12 21:47:36 functional-384000 dockerd[5658]: time="2024-09-12T21:47:36.174843708Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Sep 12 21:47:36 functional-384000 dockerd[5658]: time="2024-09-12T21:47:36.200619202Z" level=info msg="shim disconnected" id=0df32a8efdd6d86a5749cd0350b0ccd395e5400bc81bc5200390cb682771200e namespace=moby

	Sep 12 21:47:36 functional-384000 dockerd[5652]: time="2024-09-12T21:47:36.200757096Z" level=info msg="ignoring event" container=0df32a8efdd6d86a5749cd0350b0ccd395e5400bc81bc5200390cb682771200e module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 12 21:47:36 functional-384000 dockerd[5658]: time="2024-09-12T21:47:36.200841999Z" level=warning msg="cleaning up after shim disconnected" id=0df32a8efdd6d86a5749cd0350b0ccd395e5400bc81bc5200390cb682771200e namespace=moby

	Sep 12 21:47:36 functional-384000 dockerd[5658]: time="2024-09-12T21:47:36.200852539Z" level=info msg="cleaning up dead shim" namespace=moby

	Sep 12 21:47:37 functional-384000 cri-dockerd[5927]: time="2024-09-12T21:47:37Z" level=info msg="Stop pulling image docker.io/kubernetesui/metrics-scraper:v1.0.8@sha256:76049887f07a0476dc93efc2d3569b9529bf982b22d29f356092ce206e98765c: Status: Downloaded newer image for kubernetesui/metrics-scraper@sha256:76049887f07a0476dc93efc2d3569b9529bf982b22d29f356092ce206e98765c"

	Sep 12 21:47:37 functional-384000 dockerd[5658]: time="2024-09-12T21:47:37.619009027Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Sep 12 21:47:37 functional-384000 dockerd[5658]: time="2024-09-12T21:47:37.619057019Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Sep 12 21:47:37 functional-384000 dockerd[5658]: time="2024-09-12T21:47:37.619064726Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Sep 12 21:47:37 functional-384000 dockerd[5658]: time="2024-09-12T21:47:37.619101554Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Sep 12 21:47:38 functional-384000 dockerd[5658]: time="2024-09-12T21:47:38.190493100Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Sep 12 21:47:38 functional-384000 dockerd[5658]: time="2024-09-12T21:47:38.190701025Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Sep 12 21:47:38 functional-384000 dockerd[5658]: time="2024-09-12T21:47:38.190708524Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Sep 12 21:47:38 functional-384000 dockerd[5658]: time="2024-09-12T21:47:38.190736603Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Sep 12 21:47:38 functional-384000 dockerd[5652]: time="2024-09-12T21:47:38.214004329Z" level=info msg="ignoring event" container=024f2a1942be0ec421a4e6cf5fad163b136c00efe78a63f61eefdfbfe93ed103 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 12 21:47:38 functional-384000 dockerd[5658]: time="2024-09-12T21:47:38.214650226Z" level=info msg="shim disconnected" id=024f2a1942be0ec421a4e6cf5fad163b136c00efe78a63f61eefdfbfe93ed103 namespace=moby

	Sep 12 21:47:38 functional-384000 dockerd[5658]: time="2024-09-12T21:47:38.214681762Z" level=warning msg="cleaning up after shim disconnected" id=024f2a1942be0ec421a4e6cf5fad163b136c00efe78a63f61eefdfbfe93ed103 namespace=moby

	Sep 12 21:47:38 functional-384000 dockerd[5658]: time="2024-09-12T21:47:38.214685970Z" level=info msg="cleaning up dead shim" namespace=moby

	Sep 12 21:47:38 functional-384000 dockerd[5658]: time="2024-09-12T21:47:38.218743069Z" level=warning msg="cleanup warnings time=\"2024-09-12T21:47:38Z\" level=warning msg=\"failed to remove runc container\" error=\"runc did not terminate successfully: exit status 255: \" runtime=io.containerd.runc.v2\n" namespace=moby

	==> container status <==

	CONTAINER           IMAGE                                                                                                  CREATED              STATE               NAME                        ATTEMPT             POD ID              POD

	024f2a1942be0       72565bf5bbedf                                                                                          6 seconds ago        Exited              echoserver-arm              2                   48b8d58d409bc       hello-node-64b4f8f9ff-rh5f2

	854bbcc0f61e5       kubernetesui/metrics-scraper@sha256:76049887f07a0476dc93efc2d3569b9529bf982b22d29f356092ce206e98765c   7 seconds ago        Running             dashboard-metrics-scraper   0                   93c9fbba36f09       dashboard-metrics-scraper-c5db448b4-cx7v7

	0df32a8efdd6d       72565bf5bbedf                                                                                          8 seconds ago        Exited              echoserver-arm              2                   9cceb346a1f66       hello-node-connect-65d86f57f4-vc7hw

	f4b618d13d0e7       kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93         9 seconds ago        Running             kubernetes-dashboard        0                   520252a854bec       kubernetes-dashboard-695b96c756-dqgwq

	e5d1480bc6c37       nginx@sha256:04ba374043ccd2fc5c593885c0eacddebabd5ca375f9323666f28dfd5a9710e3                          28 seconds ago       Running             myfrontend                  0                   5399229f1b90f       sp-pod

	4a3ede54c78a0       gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e    33 seconds ago       Exited              mount-munger                0                   e0e475d02a64f       busybox-mount

	01a2d76b2ad99       nginx@sha256:a5127daff3d6f4606be3100a252419bfa84fd6ee5cd74d0feaca1a5068f97dcf                          42 seconds ago       Running             nginx                       0                   22c7532d0794c       nginx-svc

	29c8469557ed5       2f6c962e7b831                                                                                          About a minute ago   Running             coredns                     2                   3fda3c91443ff       coredns-7c65d6cfc9-vp6n8

	628809c637d42       ba04bb24b9575                                                                                          About a minute ago   Running             storage-provisioner         2                   91212670498f5       storage-provisioner

	12984ce9e9011       24a140c548c07                                                                                          About a minute ago   Running             kube-proxy                  2                   835fe57fe730c       kube-proxy-g4qlh

	5940bab20e79d       27e3830e14027                                                                                          About a minute ago   Running             etcd                        2                   6d4851666edeb       etcd-functional-384000

	6ea672d4ee046       279f381cb3736                                                                                          About a minute ago   Running             kube-controller-manager     2                   8932c766cdd3c       kube-controller-manager-functional-384000

	5e28c3b1657f7       7f8aa378bb47d                                                                                          About a minute ago   Running             kube-scheduler              2                   6f2fb99a05b59       kube-scheduler-functional-384000

	201611a55c1f2       d3f53a98c0a9d                                                                                          About a minute ago   Running             kube-apiserver              0                   c620d06ba0556       kube-apiserver-functional-384000

	c59b5c7b703ff       2f6c962e7b831                                                                                          2 minutes ago        Exited              coredns                     1                   de287576cb239       coredns-7c65d6cfc9-vp6n8

	53faa01db79a4       24a140c548c07                                                                                          2 minutes ago        Exited              kube-proxy                  1                   983715ed141bb       kube-proxy-g4qlh

	366343e68a4f1       ba04bb24b9575                                                                                          2 minutes ago        Exited              storage-provisioner         1                   1b5ad9ede582c       storage-provisioner

	6ddc42747539d       7f8aa378bb47d                                                                                          2 minutes ago        Exited              kube-scheduler              1                   b02bfb7814289       kube-scheduler-functional-384000

	fc70bb9d850db       27e3830e14027                                                                                          2 minutes ago        Exited              etcd                        1                   37b5a3a988cd0       etcd-functional-384000

	d38279e188b49       279f381cb3736                                                                                          2 minutes ago        Exited              kube-controller-manager     1                   24127f46acb90       kube-controller-manager-functional-384000

	==> coredns [29c8469557ed] <==

	.:53

	[INFO] plugin/reload: Running configuration SHA512 = ea7a0d73d9d208f758b1f67640ef03c58089b9d9366cf3478df3bb369b210e39f213811b46224f8a04380814b6e0890ccd358f5b5e8c80bc22ac19c8601ee35b

	CoreDNS-1.11.3

	linux/arm64, go1.21.11, a6338e9

	[INFO] 127.0.0.1:50408 - 46717 "HINFO IN 6472521954302110320.5940400712481196698. udp 57 false 512" NXDOMAIN qr,rd,ra 132 0.010826467s

	[INFO] 10.244.0.1:54385 - 40920 "A IN nginx-svc.default.svc.cluster.local. udp 64 false 4096" NOERROR qr,aa,rd 104 0.000100191s

	[INFO] 10.244.0.1:7267 - 50119 "AAAA IN nginx-svc.default.svc.cluster.local. udp 53 false 512" NOERROR qr,aa,rd 146 0.000160931s

	[INFO] 10.244.0.1:16667 - 25235 "SVCB IN _dns.resolver.arpa. udp 36 false 512" NXDOMAIN qr,rd,ra 116 0.000944133s

	[INFO] 10.244.0.1:42970 - 43148 "A IN nginx-svc.default.svc.cluster.local. udp 53 false 512" NOERROR qr,aa,rd 104 0.000024913s

	[INFO] 10.244.0.1:50148 - 36586 "AAAA IN nginx-svc.default.svc.cluster.local. udp 64 false 1232" NOERROR qr,aa,rd 146 0.000157515s

	[INFO] 10.244.0.1:19934 - 43240 "A IN nginx-svc.default.svc.cluster.local. udp 64 false 1232" NOERROR qr,aa,rd 104 0.000290492s

	==> coredns [c59b5c7b703f] <==

	.:53

	[INFO] plugin/reload: Running configuration SHA512 = ea7a0d73d9d208f758b1f67640ef03c58089b9d9366cf3478df3bb369b210e39f213811b46224f8a04380814b6e0890ccd358f5b5e8c80bc22ac19c8601ee35b

	CoreDNS-1.11.3

	linux/arm64, go1.21.11, a6338e9

	[INFO] 127.0.0.1:34559 - 34373 "HINFO IN 250758401328423977.8554749670312435245. udp 56 false 512" NXDOMAIN qr,rd,ra 131 0.009999974s

	[INFO] SIGTERM: Shutting down servers then terminating

	[INFO] plugin/health: Going into lameduck mode for 5s

	==> describe nodes <==

	Name:               functional-384000

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=arm64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=arm64

	                    kubernetes.io/hostname=functional-384000

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=f6bc674a17941874d4e5b792b09c1791d30622b8

	                    minikube.k8s.io/name=functional-384000

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2024_09_12T14_45_09_0700

	                    minikube.k8s.io/version=v1.34.0

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Thu, 12 Sep 2024 21:45:07 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  functional-384000

	  AcquireTime:     <unset>

	  RenewTime:       Thu, 12 Sep 2024 21:47:38 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Thu, 12 Sep 2024 21:47:28 +0000   Thu, 12 Sep 2024 21:45:05 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Thu, 12 Sep 2024 21:47:28 +0000   Thu, 12 Sep 2024 21:45:05 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Thu, 12 Sep 2024 21:47:28 +0000   Thu, 12 Sep 2024 21:45:05 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Thu, 12 Sep 2024 21:47:28 +0000   Thu, 12 Sep 2024 21:45:12 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.105.4

	  Hostname:    functional-384000

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3904752Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3904752Ki

	  pods:               110

	System Info:

	  Machine ID:                 37499457ab15417b9179c22a99d77fa2

	  System UUID:                37499457ab15417b9179c22a99d77fa2

	  Boot ID:                    d5b93a81-c5fb-48e7-a3a9-078f511506d3

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               arm64

	  Container Runtime Version:  docker://27.2.1

	  Kubelet Version:            v1.31.1

	  Kube-Proxy Version:         v1.31.1

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (13 in total)

	  Namespace                   Name                                         CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                         ------------  ----------  ---------------  -------------  ---

	  default                     hello-node-64b4f8f9ff-rh5f2                  0 (0%)        0 (0%)      0 (0%)           0 (0%)         23s

	  default                     hello-node-connect-65d86f57f4-vc7hw          0 (0%)        0 (0%)      0 (0%)           0 (0%)         28s

	  default                     nginx-svc                                    0 (0%)        0 (0%)      0 (0%)           0 (0%)         46s

	  default                     sp-pod                                       0 (0%)        0 (0%)      0 (0%)           0 (0%)         30s

	  kube-system                 coredns-7c65d6cfc9-vp6n8                     100m (5%)     0 (0%)      70Mi (1%)        170Mi (4%)     2m30s

	  kube-system                 etcd-functional-384000                       100m (5%)     0 (0%)      100Mi (2%)       0 (0%)         2m35s

	  kube-system                 kube-apiserver-functional-384000             250m (12%)    0 (0%)      0 (0%)           0 (0%)         76s

	  kube-system                 kube-controller-manager-functional-384000    200m (10%)    0 (0%)      0 (0%)           0 (0%)         2m35s

	  kube-system                 kube-proxy-g4qlh                             0 (0%)        0 (0%)      0 (0%)           0 (0%)         2m30s

	  kube-system                 kube-scheduler-functional-384000             100m (5%)     0 (0%)      0 (0%)           0 (0%)         2m35s

	  kube-system                 storage-provisioner                          0 (0%)        0 (0%)      0 (0%)           0 (0%)         2m30s

	  kubernetes-dashboard        dashboard-metrics-scraper-c5db448b4-cx7v7    0 (0%)        0 (0%)      0 (0%)           0 (0%)         14s

	  kubernetes-dashboard        kubernetes-dashboard-695b96c756-dqgwq        0 (0%)        0 (0%)      0 (0%)           0 (0%)         14s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%)  0 (0%)

	  memory             170Mi (4%)  170Mi (4%)

	  ephemeral-storage  0 (0%)      0 (0%)

	  hugepages-1Gi      0 (0%)      0 (0%)

	  hugepages-2Mi      0 (0%)      0 (0%)

	  hugepages-32Mi     0 (0%)      0 (0%)

	  hugepages-64Ki     0 (0%)      0 (0%)

	Events:

	  Type    Reason                   Age                  From             Message

	  ----    ------                   ----                 ----             -------

	  Normal  Starting                 2m29s                kube-proxy       

	  Normal  Starting                 76s                  kube-proxy       

	  Normal  Starting                 2m3s                 kube-proxy       

	  Normal  NodeHasSufficientMemory  2m35s                kubelet          Node functional-384000 status is now: NodeHasSufficientMemory

	  Normal  NodeAllocatableEnforced  2m35s                kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasNoDiskPressure    2m35s                kubelet          Node functional-384000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     2m35s                kubelet          Node functional-384000 status is now: NodeHasSufficientPID

	  Normal  Starting                 2m35s                kubelet          Starting kubelet.

	  Normal  NodeReady                2m32s                kubelet          Node functional-384000 status is now: NodeReady

	  Normal  RegisteredNode           2m31s                node-controller  Node functional-384000 event: Registered Node functional-384000 in Controller

	  Normal  NodeHasNoDiskPressure    2m5s (x8 over 2m5s)  kubelet          Node functional-384000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientMemory  2m5s (x8 over 2m5s)  kubelet          Node functional-384000 status is now: NodeHasSufficientMemory

	  Normal  Starting                 2m5s                 kubelet          Starting kubelet.

	  Normal  NodeHasSufficientPID     2m5s (x7 over 2m5s)  kubelet          Node functional-384000 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  2m5s                 kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           2m                   node-controller  Node functional-384000 event: Registered Node functional-384000 in Controller

	  Normal  Starting                 79s                  kubelet          Starting kubelet.

	  Normal  NodeHasSufficientMemory  79s (x8 over 79s)    kubelet          Node functional-384000 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    79s (x8 over 79s)    kubelet          Node functional-384000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     79s (x7 over 79s)    kubelet          Node functional-384000 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  79s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           73s                  node-controller  Node functional-384000 event: Registered Node functional-384000 in Controller

	==> dmesg <==

	[  +2.438282] kauditd_printk_skb: 199 callbacks suppressed

	[  +8.487349] kauditd_printk_skb: 35 callbacks suppressed

	[  +9.140469] systemd-fstab-generator[4750]: Ignoring "noauto" option for root device

	[Sep12 21:46] systemd-fstab-generator[5184]: Ignoring "noauto" option for root device

	[  +0.054066] kauditd_printk_skb: 12 callbacks suppressed

	[  +0.102511] systemd-fstab-generator[5217]: Ignoring "noauto" option for root device

	[  +0.101720] systemd-fstab-generator[5229]: Ignoring "noauto" option for root device

	[  +0.106554] systemd-fstab-generator[5243]: Ignoring "noauto" option for root device

	[  +5.127540] kauditd_printk_skb: 89 callbacks suppressed

	[  +7.398910] systemd-fstab-generator[5876]: Ignoring "noauto" option for root device

	[  +0.074044] systemd-fstab-generator[5888]: Ignoring "noauto" option for root device

	[  +0.066511] systemd-fstab-generator[5900]: Ignoring "noauto" option for root device

	[  +0.084311] systemd-fstab-generator[5915]: Ignoring "noauto" option for root device

	[  +0.226439] systemd-fstab-generator[6086]: Ignoring "noauto" option for root device

	[  +1.152950] systemd-fstab-generator[6207]: Ignoring "noauto" option for root device

	[  +1.082826] kauditd_printk_skb: 194 callbacks suppressed

	[  +5.357100] kauditd_printk_skb: 36 callbacks suppressed

	[ +12.626635] systemd-fstab-generator[7277]: Ignoring "noauto" option for root device

	[  +6.406588] kauditd_printk_skb: 28 callbacks suppressed

	[  +8.198317] kauditd_printk_skb: 3 callbacks suppressed

	[Sep12 21:47] kauditd_printk_skb: 25 callbacks suppressed

	[ +11.526734] kauditd_printk_skb: 23 callbacks suppressed

	[  +5.475924] kauditd_printk_skb: 23 callbacks suppressed

	[  +9.646480] kauditd_printk_skb: 34 callbacks suppressed

	[  +5.451747] kauditd_printk_skb: 20 callbacks suppressed

	==> etcd [5940bab20e79] <==

	{"level":"info","ts":"2024-09-12T21:46:26.122210Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"80e92d98c466b02f","local-member-id":"7520ddf439b1d16","added-peer-id":"7520ddf439b1d16","added-peer-peer-urls":["https://192.168.105.4:2380"]}

	{"level":"info","ts":"2024-09-12T21:46:26.122276Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"80e92d98c466b02f","local-member-id":"7520ddf439b1d16","cluster-version":"3.5"}

	{"level":"info","ts":"2024-09-12T21:46:26.122307Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}

	{"level":"info","ts":"2024-09-12T21:46:26.123306Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}

	{"level":"info","ts":"2024-09-12T21:46:26.124094Z","caller":"embed/etcd.go:728","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}

	{"level":"info","ts":"2024-09-12T21:46:26.124152Z","caller":"embed/etcd.go:599","msg":"serving peer traffic","address":"192.168.105.4:2380"}

	{"level":"info","ts":"2024-09-12T21:46:26.124206Z","caller":"embed/etcd.go:571","msg":"cmux::serve","address":"192.168.105.4:2380"}

	{"level":"info","ts":"2024-09-12T21:46:26.125135Z","caller":"embed/etcd.go:279","msg":"now serving peer/client/metrics","local-member-id":"7520ddf439b1d16","initial-advertise-peer-urls":["https://192.168.105.4:2380"],"listen-peer-urls":["https://192.168.105.4:2380"],"advertise-client-urls":["https://192.168.105.4:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.105.4:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}

	{"level":"info","ts":"2024-09-12T21:46:26.125175Z","caller":"embed/etcd.go:870","msg":"serving metrics","address":"http://127.0.0.1:2381"}

	{"level":"info","ts":"2024-09-12T21:46:27.212537Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 is starting a new election at term 3"}

	{"level":"info","ts":"2024-09-12T21:46:27.212576Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became pre-candidate at term 3"}

	{"level":"info","ts":"2024-09-12T21:46:27.212599Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 received MsgPreVoteResp from 7520ddf439b1d16 at term 3"}

	{"level":"info","ts":"2024-09-12T21:46:27.212609Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became candidate at term 4"}

	{"level":"info","ts":"2024-09-12T21:46:27.212615Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 received MsgVoteResp from 7520ddf439b1d16 at term 4"}

	{"level":"info","ts":"2024-09-12T21:46:27.212622Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became leader at term 4"}

	{"level":"info","ts":"2024-09-12T21:46:27.212628Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 7520ddf439b1d16 elected leader 7520ddf439b1d16 at term 4"}

	{"level":"info","ts":"2024-09-12T21:46:27.213796Z","caller":"etcdserver/server.go:2118","msg":"published local member to cluster through raft","local-member-id":"7520ddf439b1d16","local-member-attributes":"{Name:functional-384000 ClientURLs:[https://192.168.105.4:2379]}","request-path":"/0/members/7520ddf439b1d16/attributes","cluster-id":"80e92d98c466b02f","publish-timeout":"7s"}

	{"level":"info","ts":"2024-09-12T21:46:27.213815Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2024-09-12T21:46:27.213910Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}

	{"level":"info","ts":"2024-09-12T21:46:27.213925Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}

	{"level":"info","ts":"2024-09-12T21:46:27.213942Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2024-09-12T21:46:27.214559Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}

	{"level":"info","ts":"2024-09-12T21:46:27.214748Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}

	{"level":"info","ts":"2024-09-12T21:46:27.215255Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.105.4:2379"}

	{"level":"info","ts":"2024-09-12T21:46:27.215575Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}

	==> etcd [fc70bb9d850d] <==

	{"level":"info","ts":"2024-09-12T21:45:40.585954Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became pre-candidate at term 2"}

	{"level":"info","ts":"2024-09-12T21:45:40.585995Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 received MsgPreVoteResp from 7520ddf439b1d16 at term 2"}

	{"level":"info","ts":"2024-09-12T21:45:40.586025Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became candidate at term 3"}

	{"level":"info","ts":"2024-09-12T21:45:40.586042Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 received MsgVoteResp from 7520ddf439b1d16 at term 3"}

	{"level":"info","ts":"2024-09-12T21:45:40.586080Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became leader at term 3"}

	{"level":"info","ts":"2024-09-12T21:45:40.586138Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 7520ddf439b1d16 elected leader 7520ddf439b1d16 at term 3"}

	{"level":"info","ts":"2024-09-12T21:45:40.587829Z","caller":"etcdserver/server.go:2118","msg":"published local member to cluster through raft","local-member-id":"7520ddf439b1d16","local-member-attributes":"{Name:functional-384000 ClientURLs:[https://192.168.105.4:2379]}","request-path":"/0/members/7520ddf439b1d16/attributes","cluster-id":"80e92d98c466b02f","publish-timeout":"7s"}

	{"level":"info","ts":"2024-09-12T21:45:40.587979Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2024-09-12T21:45:40.588157Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2024-09-12T21:45:40.588565Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}

	{"level":"info","ts":"2024-09-12T21:45:40.589035Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}

	{"level":"info","ts":"2024-09-12T21:45:40.589518Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}

	{"level":"info","ts":"2024-09-12T21:45:40.590122Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.105.4:2379"}

	{"level":"info","ts":"2024-09-12T21:45:40.602542Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}

	{"level":"info","ts":"2024-09-12T21:45:40.602602Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}

	{"level":"info","ts":"2024-09-12T21:46:10.973091Z","caller":"osutil/interrupt_unix.go:64","msg":"received signal; shutting down","signal":"terminated"}

	{"level":"info","ts":"2024-09-12T21:46:10.973114Z","caller":"embed/etcd.go:377","msg":"closing etcd server","name":"functional-384000","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.105.4:2380"],"advertise-client-urls":["https://192.168.105.4:2379"]}

	{"level":"warn","ts":"2024-09-12T21:46:10.973146Z","caller":"embed/serve.go:212","msg":"stopping secure grpc server due to error","error":"accept tcp 127.0.0.1:2379: use of closed network connection"}

	{"level":"warn","ts":"2024-09-12T21:46:10.973186Z","caller":"embed/serve.go:214","msg":"stopped secure grpc server due to error","error":"accept tcp 127.0.0.1:2379: use of closed network connection"}

	{"level":"warn","ts":"2024-09-12T21:46:10.982079Z","caller":"embed/serve.go:212","msg":"stopping secure grpc server due to error","error":"accept tcp 192.168.105.4:2379: use of closed network connection"}

	{"level":"warn","ts":"2024-09-12T21:46:10.982131Z","caller":"embed/serve.go:214","msg":"stopped secure grpc server due to error","error":"accept tcp 192.168.105.4:2379: use of closed network connection"}

	{"level":"info","ts":"2024-09-12T21:46:10.982153Z","caller":"etcdserver/server.go:1521","msg":"skipped leadership transfer for single voting member cluster","local-member-id":"7520ddf439b1d16","current-leader-member-id":"7520ddf439b1d16"}

	{"level":"info","ts":"2024-09-12T21:46:10.983532Z","caller":"embed/etcd.go:581","msg":"stopping serving peer traffic","address":"192.168.105.4:2380"}

	{"level":"info","ts":"2024-09-12T21:46:10.983570Z","caller":"embed/etcd.go:586","msg":"stopped serving peer traffic","address":"192.168.105.4:2380"}

	{"level":"info","ts":"2024-09-12T21:46:10.983574Z","caller":"embed/etcd.go:379","msg":"closed etcd server","name":"functional-384000","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.105.4:2380"],"advertise-client-urls":["https://192.168.105.4:2379"]}

	==> kernel <==

	 21:47:44 up 2 min,  0 users,  load average: 0.71, 0.44, 0.18

	Linux functional-384000 5.10.207 #1 SMP PREEMPT Thu Sep 12 17:20:51 UTC 2024 aarch64 GNU/Linux

	PRETTY_NAME="Buildroot 2023.02.9"

	==> kube-apiserver [201611a55c1f] <==

	I0912 21:46:27.778309       1 shared_informer.go:320] Caches are synced for *generic.policySource[*k8s.io/api/admissionregistration/v1.ValidatingAdmissionPolicy,*k8s.io/api/admissionregistration/v1.ValidatingAdmissionPolicyBinding,k8s.io/apiserver/pkg/admission/plugin/policy/validating.Validator]

	I0912 21:46:27.778319       1 policy_source.go:224] refreshing policies

	I0912 21:46:27.782147       1 handler_discovery.go:450] Starting ResourceDiscoveryManager

	I0912 21:46:27.793474       1 shared_informer.go:320] Caches are synced for crd-autoregister

	I0912 21:46:27.793822       1 aggregator.go:171] initial CRD sync complete...

	I0912 21:46:27.793831       1 autoregister_controller.go:144] Starting autoregister controller

	I0912 21:46:27.793834       1 cache.go:32] Waiting for caches to sync for autoregister controller

	I0912 21:46:27.793837       1 cache.go:39] Caches are synced for autoregister controller

	I0912 21:46:27.804682       1 controller.go:615] quota admission added evaluator for: leases.coordination.k8s.io

	I0912 21:46:28.676661       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.

	I0912 21:46:29.251308       1 controller.go:615] quota admission added evaluator for: serviceaccounts

	I0912 21:46:29.259398       1 controller.go:615] quota admission added evaluator for: deployments.apps

	I0912 21:46:29.274761       1 controller.go:615] quota admission added evaluator for: daemonsets.apps

	I0912 21:46:29.282005       1 controller.go:615] quota admission added evaluator for: roles.rbac.authorization.k8s.io

	I0912 21:46:29.283877       1 controller.go:615] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io

	I0912 21:46:31.101089       1 controller.go:615] quota admission added evaluator for: endpoints

	I0912 21:46:31.454046       1 controller.go:615] quota admission added evaluator for: endpointslices.discovery.k8s.io

	I0912 21:46:48.662704       1 alloc.go:330] "allocated clusterIPs" service="default/invalid-svc" clusterIPs={"IPv4":"10.98.245.116"}

	I0912 21:46:58.683657       1 alloc.go:330] "allocated clusterIPs" service="default/nginx-svc" clusterIPs={"IPv4":"10.108.125.237"}

	I0912 21:47:16.162938       1 controller.go:615] quota admission added evaluator for: replicasets.apps

	I0912 21:47:16.206510       1 alloc.go:330] "allocated clusterIPs" service="default/hello-node-connect" clusterIPs={"IPv4":"10.104.75.219"}

	I0912 21:47:21.999730       1 alloc.go:330] "allocated clusterIPs" service="default/hello-node" clusterIPs={"IPv4":"10.97.120.154"}

	I0912 21:47:30.226304       1 controller.go:615] quota admission added evaluator for: namespaces

	I0912 21:47:30.331436       1 alloc.go:330] "allocated clusterIPs" service="kubernetes-dashboard/kubernetes-dashboard" clusterIPs={"IPv4":"10.99.196.229"}

	I0912 21:47:30.340732       1 alloc.go:330] "allocated clusterIPs" service="kubernetes-dashboard/dashboard-metrics-scraper" clusterIPs={"IPv4":"10.108.117.16"}

	==> kube-controller-manager [6ea672d4ee04] <==

	I0912 21:47:30.255317       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4" duration="10.291203ms"

	E0912 21:47:30.255337       1 replica_set.go:560] "Unhandled Error" err="sync \"kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4\" failed with pods \"dashboard-metrics-scraper-c5db448b4-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found" logger="UnhandledError"

	I0912 21:47:30.260137       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-695b96c756" duration="9.321153ms"

	E0912 21:47:30.260237       1 replica_set.go:560] "Unhandled Error" err="sync \"kubernetes-dashboard/kubernetes-dashboard-695b96c756\" failed with pods \"kubernetes-dashboard-695b96c756-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found" logger="UnhandledError"

	I0912 21:47:30.260262       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4" duration="2.448602ms"

	E0912 21:47:30.260292       1 replica_set.go:560] "Unhandled Error" err="sync \"kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4\" failed with pods \"dashboard-metrics-scraper-c5db448b4-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found" logger="UnhandledError"

	I0912 21:47:30.265383       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4" duration="2.436063ms"

	E0912 21:47:30.265400       1 replica_set.go:560] "Unhandled Error" err="sync \"kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4\" failed with pods \"dashboard-metrics-scraper-c5db448b4-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found" logger="UnhandledError"

	I0912 21:47:30.266736       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-695b96c756" duration="4.642163ms"

	E0912 21:47:30.266768       1 replica_set.go:560] "Unhandled Error" err="sync \"kubernetes-dashboard/kubernetes-dashboard-695b96c756\" failed with pods \"kubernetes-dashboard-695b96c756-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found" logger="UnhandledError"

	I0912 21:47:30.277808       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-695b96c756" duration="9.878104ms"

	I0912 21:47:30.281513       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-695b96c756" duration="3.681402ms"

	I0912 21:47:30.298212       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-695b96c756" duration="16.673125ms"

	I0912 21:47:30.298359       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-695b96c756" duration="32.786µs"

	I0912 21:47:30.306311       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4" duration="18.434839ms"

	I0912 21:47:30.327294       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4" duration="20.951638ms"

	I0912 21:47:30.334205       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4" duration="6.878508ms"

	I0912 21:47:30.334324       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4" duration="22.704µs"

	I0912 21:47:36.106431       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-695b96c756" duration="4.4702ms"

	I0912 21:47:36.106509       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/kubernetes-dashboard-695b96c756" duration="29.662µs"

	I0912 21:47:37.111090       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-connect-65d86f57f4" duration="26.538µs"

	I0912 21:47:38.142056       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-64b4f8f9ff" duration="70.947µs"

	I0912 21:47:38.177025       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4" duration="6.727671ms"

	I0912 21:47:38.177083       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4" duration="18.955µs"

	I0912 21:47:39.271730       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-node-64b4f8f9ff" duration="29.203µs"

	==> kube-controller-manager [d38279e188b4] <==

	I0912 21:45:44.466889       1 shared_informer.go:320] Caches are synced for PVC protection

	I0912 21:45:44.468398       1 shared_informer.go:320] Caches are synced for ephemeral

	I0912 21:45:44.469458       1 shared_informer.go:320] Caches are synced for taint-eviction-controller

	I0912 21:45:44.469549       1 shared_informer.go:320] Caches are synced for ReplicaSet

	I0912 21:45:44.469640       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7c65d6cfc9" duration="41.722µs"

	I0912 21:45:44.477996       1 shared_informer.go:320] Caches are synced for node

	I0912 21:45:44.478062       1 range_allocator.go:171] "Sending events to api server" logger="node-ipam-controller"

	I0912 21:45:44.478095       1 range_allocator.go:177] "Starting range CIDR allocator" logger="node-ipam-controller"

	I0912 21:45:44.478125       1 shared_informer.go:313] Waiting for caches to sync for cidrallocator

	I0912 21:45:44.478128       1 shared_informer.go:320] Caches are synced for cidrallocator

	I0912 21:45:44.478183       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="functional-384000"

	I0912 21:45:44.519907       1 shared_informer.go:320] Caches are synced for attach detach

	I0912 21:45:44.521157       1 shared_informer.go:320] Caches are synced for disruption

	I0912 21:45:44.626814       1 shared_informer.go:320] Caches are synced for resource quota

	I0912 21:45:44.669675       1 shared_informer.go:320] Caches are synced for resource quota

	I0912 21:45:44.669947       1 shared_informer.go:320] Caches are synced for taint

	I0912 21:45:44.670074       1 node_lifecycle_controller.go:1232] "Initializing eviction metric for zone" logger="node-lifecycle-controller" zone=""

	I0912 21:45:44.670182       1 node_lifecycle_controller.go:884] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="functional-384000"

	I0912 21:45:44.670261       1 node_lifecycle_controller.go:1078] "Controller detected that zone is now in new state" logger="node-lifecycle-controller" zone="" newState="Normal"

	I0912 21:45:44.717615       1 shared_informer.go:320] Caches are synced for daemon sets

	I0912 21:45:45.088117       1 shared_informer.go:320] Caches are synced for garbage collector

	I0912 21:45:45.165571       1 shared_informer.go:320] Caches are synced for garbage collector

	I0912 21:45:45.165617       1 garbagecollector.go:157] "All resource monitors have synced. Proceeding to collect garbage" logger="garbage-collector-controller"

	I0912 21:45:49.973497       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7c65d6cfc9" duration="27.09915ms"

	I0912 21:45:49.973553       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7c65d6cfc9" duration="26.692µs"

	==> kube-proxy [12984ce9e901] <==

		add table ip kube-proxy

		^^^^^^^^^^^^^^^^^^^^^^^^

	 >

	E0912 21:46:28.631579       1 proxier.go:734] "Error cleaning up nftables rules" err=<

		could not run nftables command: /dev/stdin:1:1-25: Error: Could not process rule: Operation not supported

		add table ip6 kube-proxy

		^^^^^^^^^^^^^^^^^^^^^^^^^

	 >

	I0912 21:46:28.641374       1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.105.4"]

	E0912 21:46:28.641406       1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"

	I0912 21:46:28.651222       1 server_linux.go:146] "No iptables support for family" ipFamily="IPv6"

	I0912 21:46:28.651239       1 server.go:245] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I0912 21:46:28.651252       1 server_linux.go:169] "Using iptables Proxier"

	I0912 21:46:28.651863       1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"

	I0912 21:46:28.651956       1 server.go:483] "Version info" version="v1.31.1"

	I0912 21:46:28.651964       1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0912 21:46:28.652395       1 config.go:199] "Starting service config controller"

	I0912 21:46:28.652407       1 shared_informer.go:313] Waiting for caches to sync for service config

	I0912 21:46:28.652416       1 config.go:105] "Starting endpoint slice config controller"

	I0912 21:46:28.652419       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config

	I0912 21:46:28.652637       1 config.go:328] "Starting node config controller"

	I0912 21:46:28.652648       1 shared_informer.go:313] Waiting for caches to sync for node config

	I0912 21:46:28.753106       1 shared_informer.go:320] Caches are synced for service config

	I0912 21:46:28.753106       1 shared_informer.go:320] Caches are synced for node config

	I0912 21:46:28.753119       1 shared_informer.go:320] Caches are synced for endpoint slice config

	==> kube-proxy [53faa01db79a] <==

		add table ip kube-proxy

		^^^^^^^^^^^^^^^^^^^^^^^^

	 >

	E0912 21:45:41.727973       1 proxier.go:734] "Error cleaning up nftables rules" err=<

		could not run nftables command: /dev/stdin:1:1-25: Error: Could not process rule: Operation not supported

		add table ip6 kube-proxy

		^^^^^^^^^^^^^^^^^^^^^^^^^

	 >

	I0912 21:45:41.732134       1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.105.4"]

	E0912 21:45:41.732162       1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"

	I0912 21:45:41.739244       1 server_linux.go:146] "No iptables support for family" ipFamily="IPv6"

	I0912 21:45:41.739259       1 server.go:245] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I0912 21:45:41.739269       1 server_linux.go:169] "Using iptables Proxier"

	I0912 21:45:41.739832       1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"

	I0912 21:45:41.739918       1 server.go:483] "Version info" version="v1.31.1"

	I0912 21:45:41.739927       1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0912 21:45:41.740452       1 config.go:199] "Starting service config controller"

	I0912 21:45:41.740461       1 shared_informer.go:313] Waiting for caches to sync for service config

	I0912 21:45:41.740469       1 config.go:105] "Starting endpoint slice config controller"

	I0912 21:45:41.740472       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config

	I0912 21:45:41.740626       1 config.go:328] "Starting node config controller"

	I0912 21:45:41.740635       1 shared_informer.go:313] Waiting for caches to sync for node config

	I0912 21:45:41.840905       1 shared_informer.go:320] Caches are synced for node config

	I0912 21:45:41.840937       1 shared_informer.go:320] Caches are synced for endpoint slice config

	I0912 21:45:41.840918       1 shared_informer.go:320] Caches are synced for service config

	==> kube-scheduler [5e28c3b1657f] <==

	I0912 21:46:26.951497       1 serving.go:386] Generated self-signed cert in-memory

	W0912 21:46:27.703575       1 requestheader_controller.go:196] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'

	W0912 21:46:27.703687       1 authentication.go:370] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"

	W0912 21:46:27.703710       1 authentication.go:371] Continuing without authentication configuration. This may treat all requests as anonymous.

	W0912 21:46:27.703728       1 authentication.go:372] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false

	I0912 21:46:27.721626       1 server.go:167] "Starting Kubernetes Scheduler" version="v1.31.1"

	I0912 21:46:27.721719       1 server.go:169] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0912 21:46:27.726213       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"

	I0912 21:46:27.730138       1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0912 21:46:27.730417       1 secure_serving.go:213] Serving securely on 127.0.0.1:10259

	I0912 21:46:27.730461       1 tlsconfig.go:243] "Starting DynamicServingCertificateController"

	I0912 21:46:27.831035       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	==> kube-scheduler [6ddc42747539] <==

	I0912 21:45:40.423883       1 serving.go:386] Generated self-signed cert in-memory

	W0912 21:45:41.114587       1 requestheader_controller.go:196] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'

	W0912 21:45:41.114867       1 authentication.go:370] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"

	W0912 21:45:41.114885       1 authentication.go:371] Continuing without authentication configuration. This may treat all requests as anonymous.

	W0912 21:45:41.114894       1 authentication.go:372] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false

	I0912 21:45:41.143095       1 server.go:167] "Starting Kubernetes Scheduler" version="v1.31.1"

	I0912 21:45:41.143115       1 server.go:169] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0912 21:45:41.146259       1 secure_serving.go:213] Serving securely on 127.0.0.1:10259

	I0912 21:45:41.146458       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"

	I0912 21:45:41.146489       1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0912 21:45:41.146512       1 tlsconfig.go:243] "Starting DynamicServingCertificateController"

	I0912 21:45:41.249912       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	E0912 21:46:10.986669       1 run.go:72] "command failed" err="finished without leader elect"

	==> kubelet <==

	Sep 12 21:47:22 functional-384000 kubelet[6214]: I0912 21:47:22.880012    6214 scope.go:117] "RemoveContainer" containerID="40dde81e000caae6ea9159c7c6c3c58f133ecc664ebf8e7cde4de3c4fb824c20"

	Sep 12 21:47:22 functional-384000 kubelet[6214]: E0912 21:47:22.880100    6214 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echoserver-arm\" with CrashLoopBackOff: \"back-off 10s restarting failed container=echoserver-arm pod=hello-node-connect-65d86f57f4-vc7hw_default(1bff9fcb-c996-4630-ac27-ff2ca00b3c31)\"" pod="default/hello-node-connect-65d86f57f4-vc7hw" podUID="1bff9fcb-c996-4630-ac27-ff2ca00b3c31"

	Sep 12 21:47:23 functional-384000 kubelet[6214]: I0912 21:47:23.910970    6214 scope.go:117] "RemoveContainer" containerID="b6d7a2d4f4b4b3d0f8eae35516aaf0476704c25c0d32d2aed7a0f27919dff3ec"

	Sep 12 21:47:23 functional-384000 kubelet[6214]: I0912 21:47:23.911336    6214 scope.go:117] "RemoveContainer" containerID="82dfda5b93270a263fbf9e8d8cc1956f498fa428a04fb5f304039918074934ac"

	Sep 12 21:47:23 functional-384000 kubelet[6214]: E0912 21:47:23.911485    6214 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echoserver-arm\" with CrashLoopBackOff: \"back-off 10s restarting failed container=echoserver-arm pod=hello-node-64b4f8f9ff-rh5f2_default(4a29721f-ddf2-4c3b-b13b-cd916dc732a5)\"" pod="default/hello-node-64b4f8f9ff-rh5f2" podUID="4a29721f-ddf2-4c3b-b13b-cd916dc732a5"

	Sep 12 21:47:25 functional-384000 kubelet[6214]: E0912 21:47:25.138630    6214 iptables.go:577] "Could not set up iptables canary" err=<

	Sep 12 21:47:25 functional-384000 kubelet[6214]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Sep 12 21:47:25 functional-384000 kubelet[6214]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Sep 12 21:47:25 functional-384000 kubelet[6214]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Sep 12 21:47:25 functional-384000 kubelet[6214]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Sep 12 21:47:25 functional-384000 kubelet[6214]: I0912 21:47:25.213650    6214 scope.go:117] "RemoveContainer" containerID="adf88b8b7eb960a8f1f8ac2ae701f07b317f250e0942bc4b2ac7332ff334caa2"

	Sep 12 21:47:30 functional-384000 kubelet[6214]: I0912 21:47:30.410682    6214 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ca294e0-fb77-481b-84d5-eeb7e0e22c72-tmp-volume\") pod \"dashboard-metrics-scraper-c5db448b4-cx7v7\" (UID: \"4ca294e0-fb77-481b-84d5-eeb7e0e22c72\") " pod="kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4-cx7v7"

	Sep 12 21:47:30 functional-384000 kubelet[6214]: I0912 21:47:30.410712    6214 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-volume\" (UniqueName: \"kubernetes.io/empty-dir/69b73caa-befb-46e2-9936-0c0e855b6c4e-tmp-volume\") pod \"kubernetes-dashboard-695b96c756-dqgwq\" (UID: \"69b73caa-befb-46e2-9936-0c0e855b6c4e\") " pod="kubernetes-dashboard/kubernetes-dashboard-695b96c756-dqgwq"

	Sep 12 21:47:30 functional-384000 kubelet[6214]: I0912 21:47:30.410739    6214 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvzrt\" (UniqueName: \"kubernetes.io/projected/4ca294e0-fb77-481b-84d5-eeb7e0e22c72-kube-api-access-pvzrt\") pod \"dashboard-metrics-scraper-c5db448b4-cx7v7\" (UID: \"4ca294e0-fb77-481b-84d5-eeb7e0e22c72\") " pod="kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4-cx7v7"

	Sep 12 21:47:30 functional-384000 kubelet[6214]: I0912 21:47:30.410753    6214 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xldr8\" (UniqueName: \"kubernetes.io/projected/69b73caa-befb-46e2-9936-0c0e855b6c4e-kube-api-access-xldr8\") pod \"kubernetes-dashboard-695b96c756-dqgwq\" (UID: \"69b73caa-befb-46e2-9936-0c0e855b6c4e\") " pod="kubernetes-dashboard/kubernetes-dashboard-695b96c756-dqgwq"

	Sep 12 21:47:36 functional-384000 kubelet[6214]: I0912 21:47:36.129954    6214 scope.go:117] "RemoveContainer" containerID="40dde81e000caae6ea9159c7c6c3c58f133ecc664ebf8e7cde4de3c4fb824c20"

	Sep 12 21:47:37 functional-384000 kubelet[6214]: I0912 21:47:37.104974    6214 scope.go:117] "RemoveContainer" containerID="40dde81e000caae6ea9159c7c6c3c58f133ecc664ebf8e7cde4de3c4fb824c20"

	Sep 12 21:47:37 functional-384000 kubelet[6214]: I0912 21:47:37.105093    6214 scope.go:117] "RemoveContainer" containerID="0df32a8efdd6d86a5749cd0350b0ccd395e5400bc81bc5200390cb682771200e"

	Sep 12 21:47:37 functional-384000 kubelet[6214]: E0912 21:47:37.105150    6214 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echoserver-arm\" with CrashLoopBackOff: \"back-off 20s restarting failed container=echoserver-arm pod=hello-node-connect-65d86f57f4-vc7hw_default(1bff9fcb-c996-4630-ac27-ff2ca00b3c31)\"" pod="default/hello-node-connect-65d86f57f4-vc7hw" podUID="1bff9fcb-c996-4630-ac27-ff2ca00b3c31"

	Sep 12 21:47:37 functional-384000 kubelet[6214]: I0912 21:47:37.111583    6214 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kubernetes-dashboard/kubernetes-dashboard-695b96c756-dqgwq" podStartSLOduration=2.155841564 podStartE2EDuration="7.11157147s" podCreationTimestamp="2024-09-12 21:47:30 +0000 UTC" firstStartedPulling="2024-09-12 21:47:30.691946622 +0000 UTC m=+65.624212036" lastFinishedPulling="2024-09-12 21:47:35.647676486 +0000 UTC m=+70.579941942" observedRunningTime="2024-09-12 21:47:36.103000682 +0000 UTC m=+71.035266138" watchObservedRunningTime="2024-09-12 21:47:37.11157147 +0000 UTC m=+72.043836925"

	Sep 12 21:47:38 functional-384000 kubelet[6214]: I0912 21:47:38.129456    6214 scope.go:117] "RemoveContainer" containerID="82dfda5b93270a263fbf9e8d8cc1956f498fa428a04fb5f304039918074934ac"

	Sep 12 21:47:38 functional-384000 kubelet[6214]: I0912 21:47:38.169887    6214 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kubernetes-dashboard/dashboard-metrics-scraper-c5db448b4-cx7v7" podStartSLOduration=1.32463271 podStartE2EDuration="8.169872907s" podCreationTimestamp="2024-09-12 21:47:30 +0000 UTC" firstStartedPulling="2024-09-12 21:47:30.714986046 +0000 UTC m=+65.647251502" lastFinishedPulling="2024-09-12 21:47:37.560226285 +0000 UTC m=+72.492491699" observedRunningTime="2024-09-12 21:47:38.169680813 +0000 UTC m=+73.101946268" watchObservedRunningTime="2024-09-12 21:47:38.169872907 +0000 UTC m=+73.102138363"

	Sep 12 21:47:39 functional-384000 kubelet[6214]: I0912 21:47:39.184678    6214 scope.go:117] "RemoveContainer" containerID="82dfda5b93270a263fbf9e8d8cc1956f498fa428a04fb5f304039918074934ac"

	Sep 12 21:47:39 functional-384000 kubelet[6214]: I0912 21:47:39.184772    6214 scope.go:117] "RemoveContainer" containerID="024f2a1942be0ec421a4e6cf5fad163b136c00efe78a63f61eefdfbfe93ed103"

	Sep 12 21:47:39 functional-384000 kubelet[6214]: E0912 21:47:39.184819    6214 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echoserver-arm\" with CrashLoopBackOff: \"back-off 20s restarting failed container=echoserver-arm pod=hello-node-64b4f8f9ff-rh5f2_default(4a29721f-ddf2-4c3b-b13b-cd916dc732a5)\"" pod="default/hello-node-64b4f8f9ff-rh5f2" podUID="4a29721f-ddf2-4c3b-b13b-cd916dc732a5"

	==> kubernetes-dashboard [f4b618d13d0e] <==

	2024/09/12 21:47:35 Using namespace: kubernetes-dashboard

	2024/09/12 21:47:35 Using in-cluster config to connect to apiserver

	2024/09/12 21:47:35 Using secret token for csrf signing

	2024/09/12 21:47:35 Initializing csrf token from kubernetes-dashboard-csrf secret

	2024/09/12 21:47:35 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf

	2024/09/12 21:47:35 Successful initial request to the apiserver, version: v1.31.1

	2024/09/12 21:47:35 Generating JWE encryption key

	2024/09/12 21:47:35 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting

	2024/09/12 21:47:35 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard

	2024/09/12 21:47:35 Initializing JWE encryption key from synchronized object

	2024/09/12 21:47:35 Creating in-cluster Sidecar client

	2024/09/12 21:47:35 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.

	2024/09/12 21:47:35 Serving insecurely on HTTP port: 9090

	2024/09/12 21:47:35 Starting overwatch

	==> storage-provisioner [366343e68a4f] <==

	I0912 21:45:41.676335       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0912 21:45:41.690734       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0912 21:45:41.690761       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I0912 21:45:41.702038       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0912 21:45:41.702436       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_functional-384000_ab912da5-7dd7-4498-ba38-c651dbefa72a!

	I0912 21:45:41.702374       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"a85814d1-4607-4f83-8a07-55b59db42e1e", APIVersion:"v1", ResourceVersion:"401", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' functional-384000_ab912da5-7dd7-4498-ba38-c651dbefa72a became leader

	I0912 21:45:41.803122       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_functional-384000_ab912da5-7dd7-4498-ba38-c651dbefa72a!

	==> storage-provisioner [628809c637d4] <==

	I0912 21:46:28.604909       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0912 21:46:28.611424       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0912 21:46:28.611441       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I0912 21:46:46.022679       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0912 21:46:46.023571       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_functional-384000_64eebdb6-c768-46b4-9c9e-dd480559512b!

	I0912 21:46:46.023321       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"a85814d1-4607-4f83-8a07-55b59db42e1e", APIVersion:"v1", ResourceVersion:"597", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' functional-384000_64eebdb6-c768-46b4-9c9e-dd480559512b became leader

	I0912 21:46:46.129620       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_functional-384000_64eebdb6-c768-46b4-9c9e-dd480559512b!

	I0912 21:46:58.926577       1 controller.go:1332] provision "default/myclaim" class "standard": started

	I0912 21:46:58.926658       1 storage_provisioner.go:61] Provisioning volume {&StorageClass{ObjectMeta:{standard    20f175a1-6563-4f20-a718-574c59ccbe6a 297 0 2024-09-12 21:45:14 +0000 UTC <nil> <nil> map[addonmanager.kubernetes.io/mode:EnsureExists] map[kubectl.kubernetes.io/last-applied-configuration:{"apiVersion":"storage.k8s.io/v1","kind":"StorageClass","metadata":{"annotations":{"storageclass.kubernetes.io/is-default-class":"true"},"labels":{"addonmanager.kubernetes.io/mode":"EnsureExists"},"name":"standard"},"provisioner":"k8s.io/minikube-hostpath"}

	 storageclass.kubernetes.io/is-default-class:true] [] []  [{kubectl-client-side-apply Update storage.k8s.io/v1 2024-09-12 21:45:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubectl.kubernetes.io/last-applied-configuration":{},"f:storageclass.kubernetes.io/is-default-class":{}},"f:labels":{".":{},"f:addonmanager.kubernetes.io/mode":{}}},"f:provisioner":{},"f:reclaimPolicy":{},"f:volumeBindingMode":{}}}]},Provisioner:k8s.io/minikube-hostpath,Parameters:map[string]string{},ReclaimPolicy:*Delete,MountOptions:[],AllowVolumeExpansion:nil,VolumeBindingMode:*Immediate,AllowedTopologies:[]TopologySelectorTerm{},} pvc-e630469b-b373-49ad-bf87-0747ad7d96bb &PersistentVolumeClaim{ObjectMeta:{myclaim  default  e630469b-b373-49ad-bf87-0747ad7d96bb 652 0 2024-09-12 21:46:58 +0000 UTC <nil> <nil> map[] map[kubectl.kubernetes.io/last-applied-configuration:{"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"name":"myclaim","namespace":"default"},"spec":{"accessModes":["Rea

dWriteOnce"],"resources":{"requests":{"storage":"500Mi"}},"volumeMode":"Filesystem"}}

	 volume.beta.kubernetes.io/storage-provisioner:k8s.io/minikube-hostpath volume.kubernetes.io/storage-provisioner:k8s.io/minikube-hostpath] [] [kubernetes.io/pvc-protection]  [{kube-controller-manager Update v1 2024-09-12 21:46:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:volume.beta.kubernetes.io/storage-provisioner":{},"f:volume.kubernetes.io/storage-provisioner":{}}}}} {kubectl-client-side-apply Update v1 2024-09-12 21:46:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubectl.kubernetes.io/last-applied-configuration":{}}},"f:spec":{"f:accessModes":{},"f:resources":{"f:requests":{".":{},"f:storage":{}}},"f:volumeMode":{}}}}]},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{524288000 0} {<nil>} 500Mi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*standard,VolumeMode:*Filesystem,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:

ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},},} nil} to /tmp/hostpath-provisioner/default/myclaim

	I0912 21:46:58.927067       1 controller.go:1439] provision "default/myclaim" class "standard": volume "pvc-e630469b-b373-49ad-bf87-0747ad7d96bb" provisioned

	I0912 21:46:58.927137       1 controller.go:1456] provision "default/myclaim" class "standard": succeeded

	I0912 21:46:58.927158       1 volume_store.go:212] Trying to save persistentvolume "pvc-e630469b-b373-49ad-bf87-0747ad7d96bb"

	I0912 21:46:58.927423       1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"myclaim", UID:"e630469b-b373-49ad-bf87-0747ad7d96bb", APIVersion:"v1", ResourceVersion:"652", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/myclaim"

	I0912 21:46:58.931296       1 volume_store.go:219] persistentvolume "pvc-e630469b-b373-49ad-bf87-0747ad7d96bb" saved

	I0912 21:46:58.932633       1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"myclaim", UID:"e630469b-b373-49ad-bf87-0747ad7d96bb", APIVersion:"v1", ResourceVersion:"652", FieldPath:""}): type: 'Normal' reason: 'ProvisioningSucceeded' Successfully provisioned volume pvc-e630469b-b373-49ad-bf87-0747ad7d96bb

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.APIServer}} -p functional-384000 -n functional-384000

helpers_test.go:261: (dbg) Run:  kubectl --context functional-384000 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:272: non-running pods: busybox-mount

helpers_test.go:274: ======> post-mortem[TestFunctional/parallel/ServiceCmdConnect]: describe non-running pods <======

helpers_test.go:277: (dbg) Run:  kubectl --context functional-384000 describe pod busybox-mount

helpers_test.go:282: (dbg) kubectl --context functional-384000 describe pod busybox-mount:

-- stdout --

	Name:             busybox-mount

	Namespace:        default

	Priority:         0

	Service Account:  default

	Node:             functional-384000/192.168.105.4

	Start Time:       Thu, 12 Sep 2024 14:47:09 -0700

	Labels:           integration-test=busybox-mount

	Annotations:      <none>

	Status:           Succeeded

	IP:               10.244.0.8

	IPs:

	  IP:  10.244.0.8

	Containers:

	  mount-munger:

	    Container ID:  docker://4a3ede54c78a04fac3cf522aed39c015b409fd2c53a2e2df3faeaa01714b2540

	    Image:         gcr.io/k8s-minikube/busybox:1.28.4-glibc

	    Image ID:      docker-pullable://gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e

	    Port:          <none>

	    Host Port:     <none>

	    Command:

	      /bin/sh

	      -c

	      --

	    Args:

	      cat /mount-9p/created-by-test; echo test > /mount-9p/created-by-pod; rm /mount-9p/created-by-test-removed-by-pod; echo test > /mount-9p/created-by-pod-removed-by-test date >> /mount-9p/pod-dates

	    State:          Terminated

	      Reason:       Completed

	      Exit Code:    0

	      Started:      Thu, 12 Sep 2024 14:47:11 -0700

	      Finished:     Thu, 12 Sep 2024 14:47:11 -0700

	    Ready:          False

	    Restart Count:  0

	    Environment:    <none>

	    Mounts:

	      /mount-9p from test-volume (rw)

	      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-8xmf4 (ro)

	Conditions:

	  Type                        Status

	  PodReadyToStartContainers   False 

	  Initialized                 True 

	  Ready                       False 

	  ContainersReady             False 

	  PodScheduled                True 

	Volumes:

	  test-volume:

	    Type:          HostPath (bare host directory volume)

	    Path:          /mount-9p

	    HostPathType:  

	  kube-api-access-8xmf4:

	    Type:                    Projected (a volume that contains injected data from multiple sources)

	    TokenExpirationSeconds:  3607

	    ConfigMapName:           kube-root-ca.crt

	    ConfigMapOptional:       <nil>

	    DownwardAPI:             true

	QoS Class:                   BestEffort

	Node-Selectors:              <none>

	Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

	                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

	Events:

	  Type    Reason     Age   From               Message

	  ----    ------     ----  ----               -------

	  Normal  Scheduled  35s   default-scheduler  Successfully assigned default/busybox-mount to functional-384000

	  Normal  Pulling    35s   kubelet            Pulling image "gcr.io/k8s-minikube/busybox:1.28.4-glibc"

	  Normal  Pulled     34s   kubelet            Successfully pulled image "gcr.io/k8s-minikube/busybox:1.28.4-glibc" in 1.358s (1.358s including waiting). Image size: 3547125 bytes.

	  Normal  Created    34s   kubelet            Created container mount-munger

	  Normal  Started    34s   kubelet            Started container mount-munger

-- /stdout --

helpers_test.go:285: <<< TestFunctional/parallel/ServiceCmdConnect FAILED: end of post-mortem logs <<<

helpers_test.go:286: ---------------------/post-mortem---------------------------------

--- FAIL: TestFunctional/parallel/ServiceCmdConnect (29.19s)

=== RUN   TestMultiControlPlane/serial/StopSecondaryNode

ha_test.go:363: (dbg) Run:  out/minikube-darwin-arm64 -p ha-771000 node stop m02 -v=7 --alsologtostderr

E0912 14:52:03.004258    1784 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/functional-384000/client.crt: no such file or directory" logger="UnhandledError"

E0912 14:52:06.953790    1784 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/addons-094000/client.crt: no such file or directory" logger="UnhandledError"

ha_test.go:363: (dbg) Done: out/minikube-darwin-arm64 -p ha-771000 node stop m02 -v=7 --alsologtostderr: (12.188792625s)

ha_test.go:369: (dbg) Run:  out/minikube-darwin-arm64 -p ha-771000 status -v=7 --alsologtostderr

E0912 14:52:13.247474    1784 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/functional-384000/client.crt: no such file or directory" logger="UnhandledError"

E0912 14:52:33.730414    1784 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/functional-384000/client.crt: no such file or directory" logger="UnhandledError"

E0912 14:52:34.682053    1784 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/addons-094000/client.crt: no such file or directory" logger="UnhandledError"

E0912 14:53:14.692785    1784 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/functional-384000/client.crt: no such file or directory" logger="UnhandledError"

E0912 14:54:36.613928    1784 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/functional-384000/client.crt: no such file or directory" logger="UnhandledError"

ha_test.go:369: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-771000 status -v=7 --alsologtostderr: exit status 7 (2m55.978015541s)

-- stdout --

	ha-771000

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-771000-m02

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-771000-m03

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-771000-m04

	type: Worker

	host: Error

	kubelet: Nonexistent

-- /stdout --

** stderr ** 

	I0912 14:52:13.229945    3251 out.go:345] Setting OutFile to fd 1 ...

	I0912 14:52:13.230112    3251 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 14:52:13.230116    3251 out.go:358] Setting ErrFile to fd 2...

	I0912 14:52:13.230119    3251 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 14:52:13.230268    3251 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19616-1259/.minikube/bin

	I0912 14:52:13.230407    3251 out.go:352] Setting JSON to false

	I0912 14:52:13.230423    3251 mustload.go:65] Loading cluster: ha-771000

	I0912 14:52:13.230452    3251 notify.go:220] Checking for updates...

	I0912 14:52:13.230665    3251 config.go:182] Loaded profile config "ha-771000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I0912 14:52:13.230675    3251 status.go:255] checking status of ha-771000 ...

	I0912 14:52:13.231374    3251 status.go:330] ha-771000 host status = "Running" (err=<nil>)

	I0912 14:52:13.231380    3251 host.go:66] Checking if "ha-771000" exists ...

	I0912 14:52:13.231474    3251 host.go:66] Checking if "ha-771000" exists ...

	I0912 14:52:13.231586    3251 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0912 14:52:13.231595    3251 sshutil.go:53] new ssh client: &{IP:192.168.105.5 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/ha-771000/id_rsa Username:docker}

	W0912 14:52:39.155611    3251 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.5:22: connect: operation timed out

	W0912 14:52:39.155752    3251 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

	E0912 14:52:39.155789    3251 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

	I0912 14:52:39.155800    3251 status.go:257] ha-771000 status: &{Name:ha-771000 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0912 14:52:39.155818    3251 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

	I0912 14:52:39.155829    3251 status.go:255] checking status of ha-771000-m02 ...

	I0912 14:52:39.156240    3251 status.go:330] ha-771000-m02 host status = "Stopped" (err=<nil>)

	I0912 14:52:39.156250    3251 status.go:343] host is not running, skipping remaining checks

	I0912 14:52:39.156255    3251 status.go:257] ha-771000-m02 status: &{Name:ha-771000-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0912 14:52:39.156264    3251 status.go:255] checking status of ha-771000-m03 ...

	I0912 14:52:39.157483    3251 status.go:330] ha-771000-m03 host status = "Running" (err=<nil>)

	I0912 14:52:39.157495    3251 host.go:66] Checking if "ha-771000-m03" exists ...

	I0912 14:52:39.157753    3251 host.go:66] Checking if "ha-771000-m03" exists ...

	I0912 14:52:39.158012    3251 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0912 14:52:39.158025    3251 sshutil.go:53] new ssh client: &{IP:192.168.105.7 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/ha-771000-m03/id_rsa Username:docker}

	W0912 14:53:54.158778    3251 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.7:22: connect: operation timed out

	W0912 14:53:54.158823    3251 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.105.7:22: connect: operation timed out

	E0912 14:53:54.158832    3251 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.7:22: connect: operation timed out

	I0912 14:53:54.158836    3251 status.go:257] ha-771000-m03 status: &{Name:ha-771000-m03 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0912 14:53:54.158844    3251 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.105.7:22: connect: operation timed out

	I0912 14:53:54.158848    3251 status.go:255] checking status of ha-771000-m04 ...

	I0912 14:53:54.159510    3251 status.go:330] ha-771000-m04 host status = "Running" (err=<nil>)

	I0912 14:53:54.159517    3251 host.go:66] Checking if "ha-771000-m04" exists ...

	I0912 14:53:54.159631    3251 host.go:66] Checking if "ha-771000-m04" exists ...

	I0912 14:53:54.159748    3251 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0912 14:53:54.159754    3251 sshutil.go:53] new ssh client: &{IP:192.168.105.8 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/ha-771000-m04/id_rsa Username:docker}

	W0912 14:55:09.158815    3251 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.8:22: connect: operation timed out

	W0912 14:55:09.158865    3251 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.105.8:22: connect: operation timed out

	E0912 14:55:09.158876    3251 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.8:22: connect: operation timed out

	I0912 14:55:09.158880    3251 status.go:257] ha-771000-m04 status: &{Name:ha-771000-m04 Host:Error Kubelet:Nonexistent APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

	E0912 14:55:09.158890    3251 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.105.8:22: connect: operation timed out

** /stderr **

ha_test.go:378: status says not three hosts are running: args "out/minikube-darwin-arm64 -p ha-771000 status -v=7 --alsologtostderr": ha-771000

type: Control Plane

host: Error

kubelet: Nonexistent

apiserver: Nonexistent

kubeconfig: Configured

ha-771000-m02

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-771000-m03

type: Control Plane

host: Error

kubelet: Nonexistent

apiserver: Nonexistent

kubeconfig: Configured

ha-771000-m04

type: Worker

host: Error

kubelet: Nonexistent

ha_test.go:381: status says not three kubelets are running: args "out/minikube-darwin-arm64 -p ha-771000 status -v=7 --alsologtostderr": ha-771000

type: Control Plane

host: Error

kubelet: Nonexistent

apiserver: Nonexistent

kubeconfig: Configured

ha-771000-m02

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-771000-m03

type: Control Plane

host: Error

kubelet: Nonexistent

apiserver: Nonexistent

kubeconfig: Configured

ha-771000-m04

type: Worker

host: Error

kubelet: Nonexistent

ha_test.go:384: status says not two apiservers are running: args "out/minikube-darwin-arm64 -p ha-771000 status -v=7 --alsologtostderr": ha-771000

type: Control Plane

host: Error

kubelet: Nonexistent

apiserver: Nonexistent

kubeconfig: Configured

ha-771000-m02

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-771000-m03

type: Control Plane

host: Error

kubelet: Nonexistent

apiserver: Nonexistent

kubeconfig: Configured

ha-771000-m04

type: Worker

host: Error

kubelet: Nonexistent

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-771000 -n ha-771000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-771000 -n ha-771000: exit status 3 (25.961896042s)

-- stdout --

	Error

-- /stdout --

** stderr ** 

	E0912 14:55:35.120155    3283 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

	E0912 14:55:35.120165    3283 status.go:249] status error: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

** /stderr **

helpers_test.go:239: status error: exit status 3 (may be ok)

helpers_test.go:241: "ha-771000" host is not running, skipping log retrieval (state="Error")

--- FAIL: TestMultiControlPlane/serial/StopSecondaryNode (214.13s)

=== RUN   TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop

ha_test.go:390: (dbg) Run:  out/minikube-darwin-arm64 profile list --output json

ha_test.go:390: (dbg) Done: out/minikube-darwin-arm64 profile list --output json: (1m16.8352825s)

ha_test.go:413: expected profile "ha-771000" in json of 'profile list' to have "Degraded" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-771000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-771000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/19616/minikube-v1.34.0-1726156389-19616-arm64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726156396-19616@sha256:66b06a42534e914a5c8ad765d7508a93a34031939ec9a6b3a818ef0a444ff889\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"qemu2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\"

:1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.31.1\",\"ClusterName\":\"ha-771000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"192.168.105.254\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"192.168.105.5\",\"Port\":8443,\"K

ubernetesVersion\":\"v1.31.1\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m02\",\"IP\":\"192.168.105.6\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.1\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m03\",\"IP\":\"192.168.105.7\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.1\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m04\",\"IP\":\"192.168.105.8\",\"Port\":0,\"KubernetesVersion\":\"v1.31.1\",\"ContainerRuntime\":\"\",\"ControlPlane\":false,\"Worker\":true}],\"Addons\":{\"ambassador\":false,\"auto-pause\":false,\"cloud-spanner\":false,\"csi-hostpath-driver\":false,\"dashboard\":false,\"default-storageclass\":false,\"efk\":false,\"freshpod\":false,\"gcp-auth\":false,\"gvisor\":false,\"headlamp\":false,\"helm-tiller\":false,\"inaccel\":false,\"ingress\":false,\"ingress-dns\":false,\"inspektor-gadget\":false,\"istio\":false,\"istio-provisioner\":false,\"kong\":false,\"kubeflow\":false,\"kubevirt\

":false,\"logviewer\":false,\"metallb\":false,\"metrics-server\":false,\"nvidia-device-plugin\":false,\"nvidia-driver-installer\":false,\"nvidia-gpu-device-plugin\":false,\"olm\":false,\"pod-security-policy\":false,\"portainer\":false,\"registry\":false,\"registry-aliases\":false,\"registry-creds\":false,\"storage-provisioner\":false,\"storage-provisioner-gluster\":false,\"storage-provisioner-rancher\":false,\"volcano\":false,\"volumesnapshots\":false,\"yakd\":false},\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"socket_vmnet\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docke

r\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"/opt/socket_vmnet/bin/socket_vmnet_client\",\"SocketVMnetPath\":\"/var/run/socket_vmnet\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":true}]}"*. args: "out/minikube-darwin-arm64 profile list --output json"

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-771000 -n ha-771000

E0912 14:56:52.729581    1784 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/functional-384000/client.crt: no such file or directory" logger="UnhandledError"

E0912 14:57:06.946932    1784 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/addons-094000/client.crt: no such file or directory" logger="UnhandledError"

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-771000 -n ha-771000: exit status 3 (25.965916958s)

-- stdout --

	Error

-- /stdout --

** stderr ** 

	E0912 14:57:17.915606    3301 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

	E0912 14:57:17.915649    3301 status.go:249] status error: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

** /stderr **

helpers_test.go:239: status error: exit status 3 (may be ok)

helpers_test.go:241: "ha-771000" host is not running, skipping log retrieval (state="Error")

--- FAIL: TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop (102.80s)

=== RUN   TestMultiControlPlane/serial/RestartSecondaryNode

ha_test.go:420: (dbg) Run:  out/minikube-darwin-arm64 -p ha-771000 node start m02 -v=7 --alsologtostderr

E0912 14:57:20.452342    1784 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/functional-384000/client.crt: no such file or directory" logger="UnhandledError"

ha_test.go:420: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-771000 node start m02 -v=7 --alsologtostderr: exit status 80 (5.138915333s)

-- stdout --

	* Starting "ha-771000-m02" control-plane node in "ha-771000" cluster

	* Restarting existing qemu2 VM for "ha-771000-m02" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Restarting existing qemu2 VM for "ha-771000-m02" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0912 14:57:17.987707    3306 out.go:345] Setting OutFile to fd 1 ...

	I0912 14:57:17.988045    3306 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 14:57:17.988050    3306 out.go:358] Setting ErrFile to fd 2...

	I0912 14:57:17.988053    3306 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 14:57:17.988233    3306 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19616-1259/.minikube/bin

	I0912 14:57:17.988554    3306 mustload.go:65] Loading cluster: ha-771000

	I0912 14:57:17.988864    3306 config.go:182] Loaded profile config "ha-771000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	W0912 14:57:17.989198    3306 host.go:58] "ha-771000-m02" host status: Stopped

	I0912 14:57:17.993634    3306 out.go:177] * Starting "ha-771000-m02" control-plane node in "ha-771000" cluster

	I0912 14:57:17.997580    3306 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime docker

	I0912 14:57:17.997598    3306 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19616-1259/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4

	I0912 14:57:17.997606    3306 cache.go:56] Caching tarball of preloaded images

	I0912 14:57:17.997692    3306 preload.go:172] Found /Users/jenkins/minikube-integration/19616-1259/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0912 14:57:17.997699    3306 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on docker

	I0912 14:57:17.997776    3306 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/ha-771000/config.json ...

	I0912 14:57:17.998316    3306 start.go:360] acquireMachinesLock for ha-771000-m02: {Name:mk18104440c14407e7206cb5d92d4872e7d20daa Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0912 14:57:17.998370    3306 start.go:364] duration metric: took 38.375µs to acquireMachinesLock for "ha-771000-m02"

	I0912 14:57:17.998381    3306 start.go:96] Skipping create...Using existing machine configuration

	I0912 14:57:17.998387    3306 fix.go:54] fixHost starting: m02

	I0912 14:57:17.998563    3306 fix.go:112] recreateIfNeeded on ha-771000-m02: state=Stopped err=<nil>

	W0912 14:57:17.998570    3306 fix.go:138] unexpected machine state, will restart: <nil>

	I0912 14:57:18.003520    3306 out.go:177] * Restarting existing qemu2 VM for "ha-771000-m02" ...

	I0912 14:57:18.007581    3306 qemu.go:418] Using hvf for hardware acceleration

	I0912 14:57:18.007646    3306 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/ha-771000-m02/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/ha-771000-m02/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/ha-771000-m02/qemu.pid -device virtio-net-pci,netdev=net0,mac=d6:2b:60:fa:f0:99 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/ha-771000-m02/disk.qcow2

	I0912 14:57:18.011227    3306 main.go:141] libmachine: STDOUT: 

	I0912 14:57:18.011252    3306 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0912 14:57:18.011282    3306 fix.go:56] duration metric: took 12.895209ms for fixHost

	I0912 14:57:18.011286    3306 start.go:83] releasing machines lock for "ha-771000-m02", held for 12.911458ms

	W0912 14:57:18.011293    3306 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0912 14:57:18.011324    3306 out.go:270] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0912 14:57:18.011329    3306 start.go:729] Will try again in 5 seconds ...

	I0912 14:57:23.013477    3306 start.go:360] acquireMachinesLock for ha-771000-m02: {Name:mk18104440c14407e7206cb5d92d4872e7d20daa Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0912 14:57:23.013966    3306 start.go:364] duration metric: took 358.792µs to acquireMachinesLock for "ha-771000-m02"

	I0912 14:57:23.014095    3306 start.go:96] Skipping create...Using existing machine configuration

	I0912 14:57:23.014113    3306 fix.go:54] fixHost starting: m02

	I0912 14:57:23.014795    3306 fix.go:112] recreateIfNeeded on ha-771000-m02: state=Stopped err=<nil>

	W0912 14:57:23.014816    3306 fix.go:138] unexpected machine state, will restart: <nil>

	I0912 14:57:23.022208    3306 out.go:177] * Restarting existing qemu2 VM for "ha-771000-m02" ...

	I0912 14:57:23.026181    3306 qemu.go:418] Using hvf for hardware acceleration

	I0912 14:57:23.026371    3306 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/ha-771000-m02/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/ha-771000-m02/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/ha-771000-m02/qemu.pid -device virtio-net-pci,netdev=net0,mac=d6:2b:60:fa:f0:99 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/ha-771000-m02/disk.qcow2

	I0912 14:57:23.033167    3306 main.go:141] libmachine: STDOUT: 

	I0912 14:57:23.033226    3306 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0912 14:57:23.033322    3306 fix.go:56] duration metric: took 19.211833ms for fixHost

	I0912 14:57:23.033339    3306 start.go:83] releasing machines lock for "ha-771000-m02", held for 19.3555ms

	W0912 14:57:23.033519    3306 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p ha-771000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p ha-771000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0912 14:57:23.038289    3306 out.go:201] 

	W0912 14:57:23.042316    3306 out.go:270] X Exiting due to GUEST_NODE_PROVISION: provisioning host for node: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_NODE_PROVISION: provisioning host for node: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0912 14:57:23.042360    3306 out.go:270] * 

	* 

	W0912 14:57:23.048988    3306 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                         │

	│    * If the above advice does not help, please let us know:                                                             │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

	│                                                                                                                         │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

	│    * Please also attach the following file to the GitHub issue:                                                         │

	│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │

	│                                                                                                                         │

	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                         │

	│    * If the above advice does not help, please let us know:                                                             │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

	│                                                                                                                         │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

	│    * Please also attach the following file to the GitHub issue:                                                         │

	│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │

	│                                                                                                                         │

	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	I0912 14:57:23.052170    3306 out.go:201] 

** /stderr **

ha_test.go:422: I0912 14:57:17.987707    3306 out.go:345] Setting OutFile to fd 1 ...

I0912 14:57:17.988045    3306 out.go:392] TERM=,COLORTERM=, which probably does not support color

I0912 14:57:17.988050    3306 out.go:358] Setting ErrFile to fd 2...

I0912 14:57:17.988053    3306 out.go:392] TERM=,COLORTERM=, which probably does not support color

I0912 14:57:17.988233    3306 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19616-1259/.minikube/bin

I0912 14:57:17.988554    3306 mustload.go:65] Loading cluster: ha-771000

I0912 14:57:17.988864    3306 config.go:182] Loaded profile config "ha-771000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

W0912 14:57:17.989198    3306 host.go:58] "ha-771000-m02" host status: Stopped

I0912 14:57:17.993634    3306 out.go:177] * Starting "ha-771000-m02" control-plane node in "ha-771000" cluster

I0912 14:57:17.997580    3306 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime docker

I0912 14:57:17.997598    3306 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19616-1259/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4

I0912 14:57:17.997606    3306 cache.go:56] Caching tarball of preloaded images

I0912 14:57:17.997692    3306 preload.go:172] Found /Users/jenkins/minikube-integration/19616-1259/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4 in cache, skipping download

I0912 14:57:17.997699    3306 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on docker

I0912 14:57:17.997776    3306 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/ha-771000/config.json ...

I0912 14:57:17.998316    3306 start.go:360] acquireMachinesLock for ha-771000-m02: {Name:mk18104440c14407e7206cb5d92d4872e7d20daa Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

I0912 14:57:17.998370    3306 start.go:364] duration metric: took 38.375µs to acquireMachinesLock for "ha-771000-m02"

I0912 14:57:17.998381    3306 start.go:96] Skipping create...Using existing machine configuration

I0912 14:57:17.998387    3306 fix.go:54] fixHost starting: m02

I0912 14:57:17.998563    3306 fix.go:112] recreateIfNeeded on ha-771000-m02: state=Stopped err=<nil>

W0912 14:57:17.998570    3306 fix.go:138] unexpected machine state, will restart: <nil>

I0912 14:57:18.003520    3306 out.go:177] * Restarting existing qemu2 VM for "ha-771000-m02" ...

I0912 14:57:18.007581    3306 qemu.go:418] Using hvf for hardware acceleration

I0912 14:57:18.007646    3306 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/ha-771000-m02/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/ha-771000-m02/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/ha-771000-m02/qemu.pid -device virtio-net-pci,netdev=net0,mac=d6:2b:60:fa:f0:99 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/ha-771000-m02/disk.qcow2

I0912 14:57:18.011227    3306 main.go:141] libmachine: STDOUT: 

I0912 14:57:18.011252    3306 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

I0912 14:57:18.011282    3306 fix.go:56] duration metric: took 12.895209ms for fixHost

I0912 14:57:18.011286    3306 start.go:83] releasing machines lock for "ha-771000-m02", held for 12.911458ms

W0912 14:57:18.011293    3306 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

W0912 14:57:18.011324    3306 out.go:270] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

I0912 14:57:18.011329    3306 start.go:729] Will try again in 5 seconds ...

I0912 14:57:23.013477    3306 start.go:360] acquireMachinesLock for ha-771000-m02: {Name:mk18104440c14407e7206cb5d92d4872e7d20daa Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

I0912 14:57:23.013966    3306 start.go:364] duration metric: took 358.792µs to acquireMachinesLock for "ha-771000-m02"

I0912 14:57:23.014095    3306 start.go:96] Skipping create...Using existing machine configuration

I0912 14:57:23.014113    3306 fix.go:54] fixHost starting: m02

I0912 14:57:23.014795    3306 fix.go:112] recreateIfNeeded on ha-771000-m02: state=Stopped err=<nil>

W0912 14:57:23.014816    3306 fix.go:138] unexpected machine state, will restart: <nil>

I0912 14:57:23.022208    3306 out.go:177] * Restarting existing qemu2 VM for "ha-771000-m02" ...

I0912 14:57:23.026181    3306 qemu.go:418] Using hvf for hardware acceleration

I0912 14:57:23.026371    3306 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/ha-771000-m02/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/ha-771000-m02/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/ha-771000-m02/qemu.pid -device virtio-net-pci,netdev=net0,mac=d6:2b:60:fa:f0:99 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/ha-771000-m02/disk.qcow2

I0912 14:57:23.033167    3306 main.go:141] libmachine: STDOUT: 

I0912 14:57:23.033226    3306 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

I0912 14:57:23.033322    3306 fix.go:56] duration metric: took 19.211833ms for fixHost

I0912 14:57:23.033339    3306 start.go:83] releasing machines lock for "ha-771000-m02", held for 19.3555ms

W0912 14:57:23.033519    3306 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p ha-771000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

* Failed to start qemu2 VM. Running "minikube delete -p ha-771000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

I0912 14:57:23.038289    3306 out.go:201] 

W0912 14:57:23.042316    3306 out.go:270] X Exiting due to GUEST_NODE_PROVISION: provisioning host for node: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

X Exiting due to GUEST_NODE_PROVISION: provisioning host for node: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

W0912 14:57:23.042360    3306 out.go:270] * 

* 

W0912 14:57:23.048988    3306 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

│                                                                                                                         │

│    * If the above advice does not help, please let us know:                                                             │

│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

│                                                                                                                         │

│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

│    * Please also attach the following file to the GitHub issue:                                                         │

│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │

│                                                                                                                         │

╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

│                                                                                                                         │

│    * If the above advice does not help, please let us know:                                                             │

│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

│                                                                                                                         │

│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

│    * Please also attach the following file to the GitHub issue:                                                         │

│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │

│                                                                                                                         │

╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

I0912 14:57:23.052170    3306 out.go:201] 

ha_test.go:423: secondary control-plane node start returned an error. args "out/minikube-darwin-arm64 -p ha-771000 node start m02 -v=7 --alsologtostderr": exit status 80

ha_test.go:428: (dbg) Run:  out/minikube-darwin-arm64 -p ha-771000 status -v=7 --alsologtostderr

ha_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-771000 status -v=7 --alsologtostderr: exit status 7 (2m57.831785125s)

-- stdout --

	ha-771000

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-771000-m02

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-771000-m03

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-771000-m04

	type: Worker

	host: Error

	kubelet: Nonexistent

-- /stdout --

** stderr ** 

	I0912 14:57:23.119325    3313 out.go:345] Setting OutFile to fd 1 ...

	I0912 14:57:23.119527    3313 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 14:57:23.119531    3313 out.go:358] Setting ErrFile to fd 2...

	I0912 14:57:23.119534    3313 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 14:57:23.119705    3313 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19616-1259/.minikube/bin

	I0912 14:57:23.119861    3313 out.go:352] Setting JSON to false

	I0912 14:57:23.119876    3313 mustload.go:65] Loading cluster: ha-771000

	I0912 14:57:23.119917    3313 notify.go:220] Checking for updates...

	I0912 14:57:23.120172    3313 config.go:182] Loaded profile config "ha-771000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I0912 14:57:23.120181    3313 status.go:255] checking status of ha-771000 ...

	I0912 14:57:23.121044    3313 status.go:330] ha-771000 host status = "Running" (err=<nil>)

	I0912 14:57:23.121061    3313 host.go:66] Checking if "ha-771000" exists ...

	I0912 14:57:23.121183    3313 host.go:66] Checking if "ha-771000" exists ...

	I0912 14:57:23.121314    3313 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0912 14:57:23.121323    3313 sshutil.go:53] new ssh client: &{IP:192.168.105.5 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/ha-771000/id_rsa Username:docker}

	W0912 14:57:23.121522    3313 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.5:22: connect: host is down

	I0912 14:57:23.121540    3313 retry.go:31] will retry after 256.74177ms: dial tcp 192.168.105.5:22: connect: host is down

	W0912 14:57:23.380556    3313 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.5:22: connect: host is down

	I0912 14:57:23.380589    3313 retry.go:31] will retry after 522.2685ms: dial tcp 192.168.105.5:22: connect: host is down

	W0912 14:57:23.905439    3313 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.5:22: connect: host is down

	I0912 14:57:23.905516    3313 retry.go:31] will retry after 358.734549ms: dial tcp 192.168.105.5:22: connect: host is down

	W0912 14:57:24.266925    3313 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.5:22: connect: host is down

	I0912 14:57:24.267015    3313 retry.go:31] will retry after 680.454436ms: dial tcp 192.168.105.5:22: connect: host is down

	W0912 14:57:50.875518    3313 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.5:22: connect: operation timed out

	W0912 14:57:50.875588    3313 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

	E0912 14:57:50.875598    3313 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

	I0912 14:57:50.875603    3313 status.go:257] ha-771000 status: &{Name:ha-771000 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0912 14:57:50.875614    3313 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

	I0912 14:57:50.875617    3313 status.go:255] checking status of ha-771000-m02 ...

	I0912 14:57:50.875830    3313 status.go:330] ha-771000-m02 host status = "Stopped" (err=<nil>)

	I0912 14:57:50.875839    3313 status.go:343] host is not running, skipping remaining checks

	I0912 14:57:50.875841    3313 status.go:257] ha-771000-m02 status: &{Name:ha-771000-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0912 14:57:50.875846    3313 status.go:255] checking status of ha-771000-m03 ...

	I0912 14:57:50.876443    3313 status.go:330] ha-771000-m03 host status = "Running" (err=<nil>)

	I0912 14:57:50.876447    3313 host.go:66] Checking if "ha-771000-m03" exists ...

	I0912 14:57:50.876538    3313 host.go:66] Checking if "ha-771000-m03" exists ...

	I0912 14:57:50.876658    3313 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0912 14:57:50.876667    3313 sshutil.go:53] new ssh client: &{IP:192.168.105.7 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/ha-771000-m03/id_rsa Username:docker}

	W0912 14:59:05.876827    3313 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.7:22: connect: operation timed out

	W0912 14:59:05.876998    3313 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.105.7:22: connect: operation timed out

	E0912 14:59:05.877036    3313 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.7:22: connect: operation timed out

	I0912 14:59:05.877060    3313 status.go:257] ha-771000-m03 status: &{Name:ha-771000-m03 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0912 14:59:05.877113    3313 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.105.7:22: connect: operation timed out

	I0912 14:59:05.877135    3313 status.go:255] checking status of ha-771000-m04 ...

	I0912 14:59:05.880160    3313 status.go:330] ha-771000-m04 host status = "Running" (err=<nil>)

	I0912 14:59:05.880191    3313 host.go:66] Checking if "ha-771000-m04" exists ...

	I0912 14:59:05.880718    3313 host.go:66] Checking if "ha-771000-m04" exists ...

	I0912 14:59:05.881285    3313 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0912 14:59:05.881317    3313 sshutil.go:53] new ssh client: &{IP:192.168.105.8 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/ha-771000-m04/id_rsa Username:docker}

	W0912 15:00:20.881726    3313 sshutil.go:64] dial failure (will retry): dial tcp 192.168.105.8:22: connect: operation timed out

	W0912 15:00:20.881918    3313 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.105.8:22: connect: operation timed out

	E0912 15:00:20.881959    3313 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.8:22: connect: operation timed out

	I0912 15:00:20.881980    3313 status.go:257] ha-771000-m04 status: &{Name:ha-771000-m04 Host:Error Kubelet:Nonexistent APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

	E0912 15:00:20.882032    3313 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.105.8:22: connect: operation timed out

** /stderr **

ha_test.go:432: failed to run minikube status. args "out/minikube-darwin-arm64 -p ha-771000 status -v=7 --alsologtostderr" : exit status 7

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-771000 -n ha-771000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-771000 -n ha-771000: exit status 3 (25.993334166s)

-- stdout --

	Error

-- /stdout --

** stderr ** 

	E0912 15:00:46.877459    3658 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

	E0912 15:00:46.877498    3658 status.go:249] status error: NewSession: new client: new client: dial tcp 192.168.105.5:22: connect: operation timed out

** /stderr **

helpers_test.go:239: status error: exit status 3 (may be ok)

helpers_test.go:241: "ha-771000" host is not running, skipping log retrieval (state="Error")

--- FAIL: TestMultiControlPlane/serial/RestartSecondaryNode (208.97s)

=== RUN   TestMultiControlPlane/serial/RestartClusterKeepsNodes

ha_test.go:456: (dbg) Run:  out/minikube-darwin-arm64 node list -p ha-771000 -v=7 --alsologtostderr

ha_test.go:462: (dbg) Run:  out/minikube-darwin-arm64 stop -p ha-771000 -v=7 --alsologtostderr

E0912 15:02:06.938720    1784 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/addons-094000/client.crt: no such file or directory" logger="UnhandledError"

E0912 15:03:30.027700    1784 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/addons-094000/client.crt: no such file or directory" logger="UnhandledError"

ha_test.go:462: (dbg) Done: out/minikube-darwin-arm64 stop -p ha-771000 -v=7 --alsologtostderr: (3m49.029488333s)

ha_test.go:467: (dbg) Run:  out/minikube-darwin-arm64 start -p ha-771000 --wait=true -v=7 --alsologtostderr

ha_test.go:467: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p ha-771000 --wait=true -v=7 --alsologtostderr: exit status 80 (5.226799667s)

-- stdout --

	* [ha-771000] minikube v1.34.0 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19616

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19616-1259/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19616-1259/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on existing profile

	* Starting "ha-771000" primary control-plane node in "ha-771000" cluster

	* Restarting existing qemu2 VM for "ha-771000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Restarting existing qemu2 VM for "ha-771000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0912 15:05:55.449772    3830 out.go:345] Setting OutFile to fd 1 ...

	I0912 15:05:55.449935    3830 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:05:55.449943    3830 out.go:358] Setting ErrFile to fd 2...

	I0912 15:05:55.449946    3830 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:05:55.450127    3830 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19616-1259/.minikube/bin

	I0912 15:05:55.451417    3830 out.go:352] Setting JSON to false

	I0912 15:05:55.470691    3830 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":3919,"bootTime":1726174836,"procs":474,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0912 15:05:55.470761    3830 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0912 15:05:55.476479    3830 out.go:177] * [ha-771000] minikube v1.34.0 on Darwin 14.5 (arm64)

	I0912 15:05:55.484444    3830 out.go:177]   - MINIKUBE_LOCATION=19616

	I0912 15:05:55.484472    3830 notify.go:220] Checking for updates...

	I0912 15:05:55.492420    3830 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19616-1259/kubeconfig

	I0912 15:05:55.496467    3830 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0912 15:05:55.499501    3830 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0912 15:05:55.502485    3830 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19616-1259/.minikube

	I0912 15:05:55.505402    3830 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0912 15:05:55.508793    3830 config.go:182] Loaded profile config "ha-771000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I0912 15:05:55.508846    3830 driver.go:394] Setting default libvirt URI to qemu:///system

	I0912 15:05:55.513364    3830 out.go:177] * Using the qemu2 driver based on existing profile

	I0912 15:05:55.520456    3830 start.go:297] selected driver: qemu2

	I0912 15:05:55.520462    3830 start.go:901] validating driver "qemu2" against &{Name:ha-771000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19616/minikube-v1.34.0-1726156389-19616-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726156396-19616@sha256:66b06a42534e914a5c8ad765d7508a93a34031939ec9a6b3a818ef0a444ff889 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesV

ersion:v1.31.1 ClusterName:ha-771000 Namespace:default APIServerHAVIP:192.168.105.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.5 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.105.6 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.105.7 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.105.8 Port:0 KubernetesVersion:v1.31.1 ContainerRuntime: ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:

false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mou

nt9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0912 15:05:55.520537    3830 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0912 15:05:55.523359    3830 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0912 15:05:55.523391    3830 cni.go:84] Creating CNI manager for ""

	I0912 15:05:55.523396    3830 cni.go:136] multinode detected (4 nodes found), recommending kindnet

	I0912 15:05:55.523460    3830 start.go:340] cluster config:

	{Name:ha-771000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19616/minikube-v1.34.0-1726156389-19616-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726156396-19616@sha256:66b06a42534e914a5c8ad765d7508a93a34031939ec9a6b3a818ef0a444ff889 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:ha-771000 Namespace:default APIServerHAVIP:192.168.1

05.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.5 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.105.6 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.105.7 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.105.8 Port:0 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false

helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOpti

ons:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0912 15:05:55.527573    3830 iso.go:125] acquiring lock: {Name:mk3fa9c1c2a2731193a2e63235bbe8976497103e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0912 15:05:55.536420    3830 out.go:177] * Starting "ha-771000" primary control-plane node in "ha-771000" cluster

	I0912 15:05:55.540259    3830 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime docker

	I0912 15:05:55.540272    3830 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19616-1259/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4

	I0912 15:05:55.540277    3830 cache.go:56] Caching tarball of preloaded images

	I0912 15:05:55.540335    3830 preload.go:172] Found /Users/jenkins/minikube-integration/19616-1259/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0912 15:05:55.540340    3830 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on docker

	I0912 15:05:55.540410    3830 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/ha-771000/config.json ...

	I0912 15:05:55.540963    3830 start.go:360] acquireMachinesLock for ha-771000: {Name:mk18104440c14407e7206cb5d92d4872e7d20daa Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0912 15:05:55.540999    3830 start.go:364] duration metric: took 29.833µs to acquireMachinesLock for "ha-771000"

	I0912 15:05:55.541010    3830 start.go:96] Skipping create...Using existing machine configuration

	I0912 15:05:55.541015    3830 fix.go:54] fixHost starting: 

	I0912 15:05:55.541157    3830 fix.go:112] recreateIfNeeded on ha-771000: state=Stopped err=<nil>

	W0912 15:05:55.541164    3830 fix.go:138] unexpected machine state, will restart: <nil>

	I0912 15:05:55.545424    3830 out.go:177] * Restarting existing qemu2 VM for "ha-771000" ...

	I0912 15:05:55.552464    3830 qemu.go:418] Using hvf for hardware acceleration

	I0912 15:05:55.552512    3830 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/ha-771000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/ha-771000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/ha-771000/qemu.pid -device virtio-net-pci,netdev=net0,mac=b6:53:9f:15:39:bc -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/ha-771000/disk.qcow2

	I0912 15:05:55.554637    3830 main.go:141] libmachine: STDOUT: 

	I0912 15:05:55.554658    3830 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0912 15:05:55.554687    3830 fix.go:56] duration metric: took 13.672209ms for fixHost

	I0912 15:05:55.554691    3830 start.go:83] releasing machines lock for "ha-771000", held for 13.68825ms

	W0912 15:05:55.554698    3830 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0912 15:05:55.554734    3830 out.go:270] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0912 15:05:55.554739    3830 start.go:729] Will try again in 5 seconds ...

	I0912 15:06:00.556807    3830 start.go:360] acquireMachinesLock for ha-771000: {Name:mk18104440c14407e7206cb5d92d4872e7d20daa Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0912 15:06:00.557308    3830 start.go:364] duration metric: took 388.084µs to acquireMachinesLock for "ha-771000"

	I0912 15:06:00.557442    3830 start.go:96] Skipping create...Using existing machine configuration

	I0912 15:06:00.557463    3830 fix.go:54] fixHost starting: 

	I0912 15:06:00.558168    3830 fix.go:112] recreateIfNeeded on ha-771000: state=Stopped err=<nil>

	W0912 15:06:00.558195    3830 fix.go:138] unexpected machine state, will restart: <nil>

	I0912 15:06:00.562817    3830 out.go:177] * Restarting existing qemu2 VM for "ha-771000" ...

	I0912 15:06:00.570581    3830 qemu.go:418] Using hvf for hardware acceleration

	I0912 15:06:00.570750    3830 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/ha-771000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/ha-771000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/ha-771000/qemu.pid -device virtio-net-pci,netdev=net0,mac=b6:53:9f:15:39:bc -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/ha-771000/disk.qcow2

	I0912 15:06:00.580366    3830 main.go:141] libmachine: STDOUT: 

	I0912 15:06:00.580426    3830 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0912 15:06:00.580530    3830 fix.go:56] duration metric: took 23.071ms for fixHost

	I0912 15:06:00.580545    3830 start.go:83] releasing machines lock for "ha-771000", held for 23.209625ms

	W0912 15:06:00.580722    3830 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p ha-771000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p ha-771000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0912 15:06:00.588524    3830 out.go:201] 

	W0912 15:06:00.592803    3830 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0912 15:06:00.592842    3830 out.go:270] * 

	* 

	W0912 15:06:00.595385    3830 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0912 15:06:00.603731    3830 out.go:201] 

** /stderr **

ha_test.go:469: failed to run minikube start. args "out/minikube-darwin-arm64 node list -p ha-771000 -v=7 --alsologtostderr" : exit status 80

ha_test.go:472: (dbg) Run:  out/minikube-darwin-arm64 node list -p ha-771000

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-771000 -n ha-771000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-771000 -n ha-771000: exit status 7 (32.538167ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "ha-771000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiControlPlane/serial/RestartClusterKeepsNodes (234.42s)

=== RUN   TestMultiControlPlane/serial/DeleteSecondaryNode

ha_test.go:487: (dbg) Run:  out/minikube-darwin-arm64 -p ha-771000 node delete m03 -v=7 --alsologtostderr

ha_test.go:487: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-771000 node delete m03 -v=7 --alsologtostderr: exit status 83 (43.833375ms)

-- stdout --

	* The control-plane node ha-771000-m03 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p ha-771000"

-- /stdout --

** stderr ** 

	I0912 15:06:00.744316    3845 out.go:345] Setting OutFile to fd 1 ...

	I0912 15:06:00.744609    3845 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:06:00.744612    3845 out.go:358] Setting ErrFile to fd 2...

	I0912 15:06:00.744614    3845 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:06:00.744768    3845 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19616-1259/.minikube/bin

	I0912 15:06:00.744986    3845 mustload.go:65] Loading cluster: ha-771000

	I0912 15:06:00.745225    3845 config.go:182] Loaded profile config "ha-771000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	W0912 15:06:00.745543    3845 out.go:270] ! The control-plane node ha-771000 host is not running (will try others): state=Stopped

	! The control-plane node ha-771000 host is not running (will try others): state=Stopped

	W0912 15:06:00.745648    3845 out.go:270] ! The control-plane node ha-771000-m02 host is not running (will try others): state=Stopped

	! The control-plane node ha-771000-m02 host is not running (will try others): state=Stopped

	I0912 15:06:00.750986    3845 out.go:177] * The control-plane node ha-771000-m03 host is not running: state=Stopped

	I0912 15:06:00.753949    3845 out.go:177]   To start a cluster, run: "minikube start -p ha-771000"

** /stderr **

ha_test.go:489: node delete returned an error. args "out/minikube-darwin-arm64 -p ha-771000 node delete m03 -v=7 --alsologtostderr": exit status 83

ha_test.go:493: (dbg) Run:  out/minikube-darwin-arm64 -p ha-771000 status -v=7 --alsologtostderr

ha_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-771000 status -v=7 --alsologtostderr: exit status 7 (30.06575ms)

-- stdout --

	ha-771000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-771000-m02

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-771000-m03

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-771000-m04

	type: Worker

	host: Stopped

	kubelet: Stopped

-- /stdout --

** stderr ** 

	I0912 15:06:00.786923    3847 out.go:345] Setting OutFile to fd 1 ...

	I0912 15:06:00.787067    3847 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:06:00.787070    3847 out.go:358] Setting ErrFile to fd 2...

	I0912 15:06:00.787072    3847 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:06:00.787227    3847 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19616-1259/.minikube/bin

	I0912 15:06:00.787340    3847 out.go:352] Setting JSON to false

	I0912 15:06:00.787358    3847 mustload.go:65] Loading cluster: ha-771000

	I0912 15:06:00.787409    3847 notify.go:220] Checking for updates...

	I0912 15:06:00.787587    3847 config.go:182] Loaded profile config "ha-771000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I0912 15:06:00.787593    3847 status.go:255] checking status of ha-771000 ...

	I0912 15:06:00.787798    3847 status.go:330] ha-771000 host status = "Stopped" (err=<nil>)

	I0912 15:06:00.787801    3847 status.go:343] host is not running, skipping remaining checks

	I0912 15:06:00.787803    3847 status.go:257] ha-771000 status: &{Name:ha-771000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0912 15:06:00.787813    3847 status.go:255] checking status of ha-771000-m02 ...

	I0912 15:06:00.787901    3847 status.go:330] ha-771000-m02 host status = "Stopped" (err=<nil>)

	I0912 15:06:00.787904    3847 status.go:343] host is not running, skipping remaining checks

	I0912 15:06:00.787905    3847 status.go:257] ha-771000-m02 status: &{Name:ha-771000-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0912 15:06:00.787909    3847 status.go:255] checking status of ha-771000-m03 ...

	I0912 15:06:00.787994    3847 status.go:330] ha-771000-m03 host status = "Stopped" (err=<nil>)

	I0912 15:06:00.787996    3847 status.go:343] host is not running, skipping remaining checks

	I0912 15:06:00.787998    3847 status.go:257] ha-771000-m03 status: &{Name:ha-771000-m03 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0912 15:06:00.788002    3847 status.go:255] checking status of ha-771000-m04 ...

	I0912 15:06:00.788106    3847 status.go:330] ha-771000-m04 host status = "Stopped" (err=<nil>)

	I0912 15:06:00.788112    3847 status.go:343] host is not running, skipping remaining checks

	I0912 15:06:00.788114    3847 status.go:257] ha-771000-m04 status: &{Name:ha-771000-m04 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:495: failed to run minikube status. args "out/minikube-darwin-arm64 -p ha-771000 status -v=7 --alsologtostderr" : exit status 7

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-771000 -n ha-771000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-771000 -n ha-771000: exit status 7 (30.638459ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "ha-771000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiControlPlane/serial/DeleteSecondaryNode (0.10s)

=== RUN   TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete

ha_test.go:390: (dbg) Run:  out/minikube-darwin-arm64 profile list --output json

ha_test.go:413: expected profile "ha-771000" in json of 'profile list' to have "Degraded" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-771000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-771000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/19616/minikube-v1.34.0-1726156389-19616-arm64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726156396-19616@sha256:66b06a42534e914a5c8ad765d7508a93a34031939ec9a6b3a818ef0a444ff889\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"qemu2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\"

:1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.31.1\",\"ClusterName\":\"ha-771000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"192.168.105.254\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"192.168.105.5\",\"Port\":8443,\"K

ubernetesVersion\":\"v1.31.1\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m02\",\"IP\":\"192.168.105.6\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.1\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m03\",\"IP\":\"192.168.105.7\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.1\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m04\",\"IP\":\"192.168.105.8\",\"Port\":0,\"KubernetesVersion\":\"v1.31.1\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":false,\"Worker\":true}],\"Addons\":{\"ambassador\":false,\"auto-pause\":false,\"cloud-spanner\":false,\"csi-hostpath-driver\":false,\"dashboard\":false,\"default-storageclass\":false,\"efk\":false,\"freshpod\":false,\"gcp-auth\":false,\"gvisor\":false,\"headlamp\":false,\"helm-tiller\":false,\"inaccel\":false,\"ingress\":false,\"ingress-dns\":false,\"inspektor-gadget\":false,\"istio\":false,\"istio-provisioner\":false,\"kong\":false,\"kubeflow\":false,\"kub

evirt\":false,\"logviewer\":false,\"metallb\":false,\"metrics-server\":false,\"nvidia-device-plugin\":false,\"nvidia-driver-installer\":false,\"nvidia-gpu-device-plugin\":false,\"olm\":false,\"pod-security-policy\":false,\"portainer\":false,\"registry\":false,\"registry-aliases\":false,\"registry-creds\":false,\"storage-provisioner\":false,\"storage-provisioner-gluster\":false,\"storage-provisioner-rancher\":false,\"volcano\":false,\"volumesnapshots\":false,\"yakd\":false},\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"socket_vmnet\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\

"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"/opt/socket_vmnet/bin/socket_vmnet_client\",\"SocketVMnetPath\":\"/var/run/socket_vmnet\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":false}]}"*. args: "out/minikube-darwin-arm64 profile list --output json"

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-771000 -n ha-771000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-771000 -n ha-771000: exit status 7 (51.239417ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "ha-771000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete (1.02s)

=== RUN   TestMultiControlPlane/serial/StopCluster

ha_test.go:531: (dbg) Run:  out/minikube-darwin-arm64 -p ha-771000 stop -v=7 --alsologtostderr

E0912 15:06:52.712900    1784 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/functional-384000/client.crt: no such file or directory" logger="UnhandledError"

E0912 15:07:06.929756    1784 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/addons-094000/client.crt: no such file or directory" logger="UnhandledError"

E0912 15:08:15.797670    1784 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/functional-384000/client.crt: no such file or directory" logger="UnhandledError"

ha_test.go:531: (dbg) Done: out/minikube-darwin-arm64 -p ha-771000 stop -v=7 --alsologtostderr: (3m21.991261459s)

ha_test.go:537: (dbg) Run:  out/minikube-darwin-arm64 -p ha-771000 status -v=7 --alsologtostderr

ha_test.go:537: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p ha-771000 status -v=7 --alsologtostderr: exit status 7 (67.265958ms)

-- stdout --

	ha-771000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-771000-m02

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-771000-m03

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-771000-m04

	type: Worker

	host: Stopped

	kubelet: Stopped

-- /stdout --

** stderr ** 

	I0912 15:09:23.891412    3900 out.go:345] Setting OutFile to fd 1 ...

	I0912 15:09:23.891600    3900 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:09:23.891605    3900 out.go:358] Setting ErrFile to fd 2...

	I0912 15:09:23.891609    3900 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:09:23.891771    3900 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19616-1259/.minikube/bin

	I0912 15:09:23.891928    3900 out.go:352] Setting JSON to false

	I0912 15:09:23.891944    3900 mustload.go:65] Loading cluster: ha-771000

	I0912 15:09:23.891985    3900 notify.go:220] Checking for updates...

	I0912 15:09:23.892238    3900 config.go:182] Loaded profile config "ha-771000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I0912 15:09:23.892246    3900 status.go:255] checking status of ha-771000 ...

	I0912 15:09:23.892513    3900 status.go:330] ha-771000 host status = "Stopped" (err=<nil>)

	I0912 15:09:23.892517    3900 status.go:343] host is not running, skipping remaining checks

	I0912 15:09:23.892520    3900 status.go:257] ha-771000 status: &{Name:ha-771000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0912 15:09:23.892532    3900 status.go:255] checking status of ha-771000-m02 ...

	I0912 15:09:23.892657    3900 status.go:330] ha-771000-m02 host status = "Stopped" (err=<nil>)

	I0912 15:09:23.892661    3900 status.go:343] host is not running, skipping remaining checks

	I0912 15:09:23.892663    3900 status.go:257] ha-771000-m02 status: &{Name:ha-771000-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0912 15:09:23.892668    3900 status.go:255] checking status of ha-771000-m03 ...

	I0912 15:09:23.892788    3900 status.go:330] ha-771000-m03 host status = "Stopped" (err=<nil>)

	I0912 15:09:23.892792    3900 status.go:343] host is not running, skipping remaining checks

	I0912 15:09:23.892794    3900 status.go:257] ha-771000-m03 status: &{Name:ha-771000-m03 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0912 15:09:23.892798    3900 status.go:255] checking status of ha-771000-m04 ...

	I0912 15:09:23.892923    3900 status.go:330] ha-771000-m04 host status = "Stopped" (err=<nil>)

	I0912 15:09:23.892928    3900 status.go:343] host is not running, skipping remaining checks

	I0912 15:09:23.892930    3900 status.go:257] ha-771000-m04 status: &{Name:ha-771000-m04 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:543: status says not two control-plane nodes are present: args "out/minikube-darwin-arm64 -p ha-771000 status -v=7 --alsologtostderr": ha-771000

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-771000-m02

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-771000-m03

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-771000-m04

type: Worker

host: Stopped

kubelet: Stopped

ha_test.go:549: status says not three kubelets are stopped: args "out/minikube-darwin-arm64 -p ha-771000 status -v=7 --alsologtostderr": ha-771000

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-771000-m02

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-771000-m03

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-771000-m04

type: Worker

host: Stopped

kubelet: Stopped

ha_test.go:552: status says not two apiservers are stopped: args "out/minikube-darwin-arm64 -p ha-771000 status -v=7 --alsologtostderr": ha-771000

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-771000-m02

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-771000-m03

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-771000-m04

type: Worker

host: Stopped

kubelet: Stopped

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-771000 -n ha-771000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-771000 -n ha-771000: exit status 7 (32.199458ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "ha-771000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiControlPlane/serial/StopCluster (202.09s)

=== RUN   TestMultiControlPlane/serial/RestartCluster

ha_test.go:560: (dbg) Run:  out/minikube-darwin-arm64 start -p ha-771000 --wait=true -v=7 --alsologtostderr --driver=qemu2 

ha_test.go:560: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p ha-771000 --wait=true -v=7 --alsologtostderr --driver=qemu2 : exit status 80 (5.182181458s)

-- stdout --

	* [ha-771000] minikube v1.34.0 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19616

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19616-1259/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19616-1259/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on existing profile

	* Starting "ha-771000" primary control-plane node in "ha-771000" cluster

	* Restarting existing qemu2 VM for "ha-771000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Restarting existing qemu2 VM for "ha-771000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0912 15:09:23.954482    3904 out.go:345] Setting OutFile to fd 1 ...

	I0912 15:09:23.954611    3904 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:09:23.954615    3904 out.go:358] Setting ErrFile to fd 2...

	I0912 15:09:23.954617    3904 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:09:23.954774    3904 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19616-1259/.minikube/bin

	I0912 15:09:23.955766    3904 out.go:352] Setting JSON to false

	I0912 15:09:23.971650    3904 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":4127,"bootTime":1726174836,"procs":471,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0912 15:09:23.971725    3904 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0912 15:09:23.976912    3904 out.go:177] * [ha-771000] minikube v1.34.0 on Darwin 14.5 (arm64)

	I0912 15:09:23.983817    3904 out.go:177]   - MINIKUBE_LOCATION=19616

	I0912 15:09:23.983870    3904 notify.go:220] Checking for updates...

	I0912 15:09:23.990821    3904 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19616-1259/kubeconfig

	I0912 15:09:23.993793    3904 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0912 15:09:23.996886    3904 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0912 15:09:23.999845    3904 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19616-1259/.minikube

	I0912 15:09:24.002831    3904 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0912 15:09:24.006132    3904 config.go:182] Loaded profile config "ha-771000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I0912 15:09:24.006382    3904 driver.go:394] Setting default libvirt URI to qemu:///system

	I0912 15:09:24.010835    3904 out.go:177] * Using the qemu2 driver based on existing profile

	I0912 15:09:24.017816    3904 start.go:297] selected driver: qemu2

	I0912 15:09:24.017822    3904 start.go:901] validating driver "qemu2" against &{Name:ha-771000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19616/minikube-v1.34.0-1726156389-19616-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726156396-19616@sha256:66b06a42534e914a5c8ad765d7508a93a34031939ec9a6b3a818ef0a444ff889 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesV

ersion:v1.31.1 ClusterName:ha-771000 Namespace:default APIServerHAVIP:192.168.105.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.5 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.105.6 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.105.7 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.105.8 Port:0 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storage

class:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-ho

st Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0912 15:09:24.017921    3904 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0912 15:09:24.020168    3904 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0912 15:09:24.020211    3904 cni.go:84] Creating CNI manager for ""

	I0912 15:09:24.020216    3904 cni.go:136] multinode detected (4 nodes found), recommending kindnet

	I0912 15:09:24.020259    3904 start.go:340] cluster config:

	{Name:ha-771000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19616/minikube-v1.34.0-1726156389-19616-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726156396-19616@sha256:66b06a42534e914a5c8ad765d7508a93a34031939ec9a6b3a818ef0a444ff889 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:ha-771000 Namespace:default APIServerHAVIP:192.168.1

05.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.5 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.105.6 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.105.7 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.105.8 Port:0 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false

helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOpti

ons:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0912 15:09:24.023872    3904 iso.go:125] acquiring lock: {Name:mk3fa9c1c2a2731193a2e63235bbe8976497103e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0912 15:09:24.030834    3904 out.go:177] * Starting "ha-771000" primary control-plane node in "ha-771000" cluster

	I0912 15:09:24.034789    3904 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime docker

	I0912 15:09:24.034806    3904 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19616-1259/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4

	I0912 15:09:24.034816    3904 cache.go:56] Caching tarball of preloaded images

	I0912 15:09:24.034885    3904 preload.go:172] Found /Users/jenkins/minikube-integration/19616-1259/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0912 15:09:24.034892    3904 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on docker

	I0912 15:09:24.034963    3904 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/ha-771000/config.json ...

	I0912 15:09:24.035414    3904 start.go:360] acquireMachinesLock for ha-771000: {Name:mk18104440c14407e7206cb5d92d4872e7d20daa Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0912 15:09:24.035449    3904 start.go:364] duration metric: took 28.792µs to acquireMachinesLock for "ha-771000"

	I0912 15:09:24.035460    3904 start.go:96] Skipping create...Using existing machine configuration

	I0912 15:09:24.035464    3904 fix.go:54] fixHost starting: 

	I0912 15:09:24.035576    3904 fix.go:112] recreateIfNeeded on ha-771000: state=Stopped err=<nil>

	W0912 15:09:24.035584    3904 fix.go:138] unexpected machine state, will restart: <nil>

	I0912 15:09:24.039855    3904 out.go:177] * Restarting existing qemu2 VM for "ha-771000" ...

	I0912 15:09:24.046727    3904 qemu.go:418] Using hvf for hardware acceleration

	I0912 15:09:24.046770    3904 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/ha-771000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/ha-771000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/ha-771000/qemu.pid -device virtio-net-pci,netdev=net0,mac=b6:53:9f:15:39:bc -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/ha-771000/disk.qcow2

	I0912 15:09:24.048768    3904 main.go:141] libmachine: STDOUT: 

	I0912 15:09:24.048787    3904 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0912 15:09:24.048816    3904 fix.go:56] duration metric: took 13.351875ms for fixHost

	I0912 15:09:24.048820    3904 start.go:83] releasing machines lock for "ha-771000", held for 13.367292ms

	W0912 15:09:24.048827    3904 start.go:714] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0912 15:09:24.048864    3904 out.go:270] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0912 15:09:24.048869    3904 start.go:729] Will try again in 5 seconds ...

	I0912 15:09:29.050948    3904 start.go:360] acquireMachinesLock for ha-771000: {Name:mk18104440c14407e7206cb5d92d4872e7d20daa Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0912 15:09:29.051290    3904 start.go:364] duration metric: took 271.334µs to acquireMachinesLock for "ha-771000"

	I0912 15:09:29.051442    3904 start.go:96] Skipping create...Using existing machine configuration

	I0912 15:09:29.051459    3904 fix.go:54] fixHost starting: 

	I0912 15:09:29.052113    3904 fix.go:112] recreateIfNeeded on ha-771000: state=Stopped err=<nil>

	W0912 15:09:29.052139    3904 fix.go:138] unexpected machine state, will restart: <nil>

	I0912 15:09:29.056357    3904 out.go:177] * Restarting existing qemu2 VM for "ha-771000" ...

	I0912 15:09:29.067494    3904 qemu.go:418] Using hvf for hardware acceleration

	I0912 15:09:29.067745    3904 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/ha-771000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/ha-771000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/ha-771000/qemu.pid -device virtio-net-pci,netdev=net0,mac=b6:53:9f:15:39:bc -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/ha-771000/disk.qcow2

	I0912 15:09:29.076474    3904 main.go:141] libmachine: STDOUT: 

	I0912 15:09:29.076542    3904 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0912 15:09:29.076608    3904 fix.go:56] duration metric: took 25.151375ms for fixHost

	I0912 15:09:29.076623    3904 start.go:83] releasing machines lock for "ha-771000", held for 25.312875ms

	W0912 15:09:29.076819    3904 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p ha-771000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p ha-771000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0912 15:09:29.084484    3904 out.go:201] 

	W0912 15:09:29.088570    3904 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0912 15:09:29.088613    3904 out.go:270] * 

	* 

	W0912 15:09:29.091149    3904 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0912 15:09:29.100474    3904 out.go:201] 

** /stderr **

ha_test.go:562: failed to start cluster. args "out/minikube-darwin-arm64 start -p ha-771000 --wait=true -v=7 --alsologtostderr --driver=qemu2 " : exit status 80

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-771000 -n ha-771000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-771000 -n ha-771000: exit status 7 (69.949584ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "ha-771000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiControlPlane/serial/RestartCluster (5.25s)

=== RUN   TestMultiControlPlane/serial/DegradedAfterClusterRestart

ha_test.go:390: (dbg) Run:  out/minikube-darwin-arm64 profile list --output json

ha_test.go:413: expected profile "ha-771000" in json of 'profile list' to have "Degraded" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-771000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-771000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/19616/minikube-v1.34.0-1726156389-19616-arm64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726156396-19616@sha256:66b06a42534e914a5c8ad765d7508a93a34031939ec9a6b3a818ef0a444ff889\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"qemu2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\"

:1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.31.1\",\"ClusterName\":\"ha-771000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"192.168.105.254\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"192.168.105.5\",\"Port\":8443,\"K

ubernetesVersion\":\"v1.31.1\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m02\",\"IP\":\"192.168.105.6\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.1\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m03\",\"IP\":\"192.168.105.7\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.1\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m04\",\"IP\":\"192.168.105.8\",\"Port\":0,\"KubernetesVersion\":\"v1.31.1\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":false,\"Worker\":true}],\"Addons\":{\"ambassador\":false,\"auto-pause\":false,\"cloud-spanner\":false,\"csi-hostpath-driver\":false,\"dashboard\":false,\"default-storageclass\":false,\"efk\":false,\"freshpod\":false,\"gcp-auth\":false,\"gvisor\":false,\"headlamp\":false,\"helm-tiller\":false,\"inaccel\":false,\"ingress\":false,\"ingress-dns\":false,\"inspektor-gadget\":false,\"istio\":false,\"istio-provisioner\":false,\"kong\":false,\"kubeflow\":false,\"kub

evirt\":false,\"logviewer\":false,\"metallb\":false,\"metrics-server\":false,\"nvidia-device-plugin\":false,\"nvidia-driver-installer\":false,\"nvidia-gpu-device-plugin\":false,\"olm\":false,\"pod-security-policy\":false,\"portainer\":false,\"registry\":false,\"registry-aliases\":false,\"registry-creds\":false,\"storage-provisioner\":false,\"storage-provisioner-gluster\":false,\"storage-provisioner-rancher\":false,\"volcano\":false,\"volumesnapshots\":false,\"yakd\":false},\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"socket_vmnet\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\

"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"/opt/socket_vmnet/bin/socket_vmnet_client\",\"SocketVMnetPath\":\"/var/run/socket_vmnet\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":false}]}"*. args: "out/minikube-darwin-arm64 profile list --output json"

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-771000 -n ha-771000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-771000 -n ha-771000: exit status 7 (29.224958ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "ha-771000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiControlPlane/serial/DegradedAfterClusterRestart (0.08s)

=== RUN   TestMultiControlPlane/serial/AddSecondaryNode

ha_test.go:605: (dbg) Run:  out/minikube-darwin-arm64 node add -p ha-771000 --control-plane -v=7 --alsologtostderr

ha_test.go:605: (dbg) Non-zero exit: out/minikube-darwin-arm64 node add -p ha-771000 --control-plane -v=7 --alsologtostderr: exit status 83 (40.234792ms)

-- stdout --

	* The control-plane node ha-771000-m03 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p ha-771000"

-- /stdout --

** stderr ** 

	I0912 15:09:29.288326    3919 out.go:345] Setting OutFile to fd 1 ...

	I0912 15:09:29.288452    3919 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:09:29.288456    3919 out.go:358] Setting ErrFile to fd 2...

	I0912 15:09:29.288458    3919 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:09:29.288578    3919 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19616-1259/.minikube/bin

	I0912 15:09:29.288794    3919 mustload.go:65] Loading cluster: ha-771000

	I0912 15:09:29.289005    3919 config.go:182] Loaded profile config "ha-771000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	W0912 15:09:29.289307    3919 out.go:270] ! The control-plane node ha-771000 host is not running (will try others): state=Stopped

	! The control-plane node ha-771000 host is not running (will try others): state=Stopped

	W0912 15:09:29.289418    3919 out.go:270] ! The control-plane node ha-771000-m02 host is not running (will try others): state=Stopped

	! The control-plane node ha-771000-m02 host is not running (will try others): state=Stopped

	I0912 15:09:29.293257    3919 out.go:177] * The control-plane node ha-771000-m03 host is not running: state=Stopped

	I0912 15:09:29.296126    3919 out.go:177]   To start a cluster, run: "minikube start -p ha-771000"

** /stderr **

ha_test.go:607: failed to add control-plane node to current ha (multi-control plane) cluster. args "out/minikube-darwin-arm64 node add -p ha-771000 --control-plane -v=7 --alsologtostderr" : exit status 83

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ha-771000 -n ha-771000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p ha-771000 -n ha-771000: exit status 7 (29.675459ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "ha-771000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiControlPlane/serial/AddSecondaryNode (0.07s)

=== RUN   TestImageBuild/serial/Setup

image_test.go:69: (dbg) Run:  out/minikube-darwin-arm64 start -p image-377000 --driver=qemu2 

image_test.go:69: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p image-377000 --driver=qemu2 : exit status 80 (9.941215666s)

-- stdout --

	* [image-377000] minikube v1.34.0 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19616

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19616-1259/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19616-1259/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "image-377000" primary control-plane node in "image-377000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "image-377000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p image-377000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

image_test.go:70: failed to start minikube with args: "out/minikube-darwin-arm64 start -p image-377000 --driver=qemu2 " : exit status 80

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p image-377000 -n image-377000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p image-377000 -n image-377000: exit status 7 (67.231042ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "image-377000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestImageBuild/serial/Setup (10.01s)

=== RUN   TestJSONOutput/start/Command

json_output_test.go:63: (dbg) Run:  out/minikube-darwin-arm64 start -p json-output-722000 --output=json --user=testUser --memory=2200 --wait=true --driver=qemu2 

json_output_test.go:63: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p json-output-722000 --output=json --user=testUser --memory=2200 --wait=true --driver=qemu2 : exit status 80 (9.828638417s)

-- stdout --

	{"specversion":"1.0","id":"f74746b9-f0b6-4b5e-b17e-5b159ccfcd55","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-722000] minikube v1.34.0 on Darwin 14.5 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}

	{"specversion":"1.0","id":"b32b3068-512b-4761-a472-58b40fca99d6","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=19616"}}

	{"specversion":"1.0","id":"3f784e6d-11a9-4159-9bc8-3d2760f33bf3","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/Users/jenkins/minikube-integration/19616-1259/kubeconfig"}}

	{"specversion":"1.0","id":"01fce668-f06b-4df3-b4f3-42f5ffe073b7","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-darwin-arm64"}}

	{"specversion":"1.0","id":"30bb045d-9697-43fb-a8a9-4a3e52e09ebe","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}

	{"specversion":"1.0","id":"2088ef7a-8d31-4074-8bc2-bde398a908d6","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/Users/jenkins/minikube-integration/19616-1259/.minikube"}}

	{"specversion":"1.0","id":"c90cb864-95b5-4d81-b1ca-2cb987deb398","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}

	{"specversion":"1.0","id":"8ab97ed3-58aa-4888-ab05-a664287ac53e","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the qemu2 driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}

	{"specversion":"1.0","id":"2d501590-19ab-43a0-a3a3-d9b389c670c4","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Automatically selected the socket_vmnet network"}}

	{"specversion":"1.0","id":"1eebb5cd-1a55-41d0-9e01-a9451eebf887","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting \"json-output-722000\" primary control-plane node in \"json-output-722000\" cluster","name":"Starting Node","totalsteps":"19"}}

	{"specversion":"1.0","id":"01c38817-1220-49da-85a5-526f7a3fbe23","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"9","message":"Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...","name":"Creating VM","totalsteps":"19"}}

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	{"specversion":"1.0","id":"21a9e5ea-7847-448b-a468-aedc5efd8c80","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"9","message":"Deleting \"json-output-722000\" in qemu2 ...","name":"Creating VM","totalsteps":"19"}}

	{"specversion":"1.0","id":"e98a09d7-dcac-492c-9cab-6903765223f2","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"StartHost failed, but will try again: creating host: create: creating: Failed to connect to \"/var/run/socket_vmnet\": Connection refused: exit status 1"}}

	{"specversion":"1.0","id":"172c89e3-e8c0-4ac6-b23e-be4b8ffc46bb","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"9","message":"Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...","name":"Creating VM","totalsteps":"19"}}

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	{"specversion":"1.0","id":"222e41bd-6487-40cf-a064-550bac9e565f","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"Failed to start qemu2 VM. Running \"minikube delete -p json-output-722000\" may fix it: creating host: create: creating: Failed to connect to \"/var/run/socket_vmnet\": Connection refused: exit status 1"}}

	{"specversion":"1.0","id":"a6c9c9b5-13bd-4bd8-bb11-7958092cbe90","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"80","issues":"","message":"error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to \"/var/run/socket_vmnet\": Connection refused: exit status 1","name":"GUEST_PROVISION","url":""}}

	{"specversion":"1.0","id":"58edd775-b6d1-4677-b428-775fac2f3390","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"╭───────────────────────────────────────────────────────────────────────────────────────────╮\n│                                                                                           │\n│    If the above advice does not help, please let us know:                                 │\n│    https://github.com/kubernetes/minikube/issues/new/choose                               │\n│                                                                                           │\n│    Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │\n│

│\n╰───────────────────────────────────────────────────────────────────────────────────────────╯"}}

-- /stdout --

json_output_test.go:65: failed to clean up: args "out/minikube-darwin-arm64 start -p json-output-722000 --output=json --user=testUser --memory=2200 --wait=true --driver=qemu2 ": exit status 80

json_output_test.go:213: unable to marshal output: OUTPUT: 

json_output_test.go:70: converting to cloud events: invalid character 'O' looking for beginning of value

--- FAIL: TestJSONOutput/start/Command (9.83s)

=== RUN   TestJSONOutput/pause/Command

json_output_test.go:63: (dbg) Run:  out/minikube-darwin-arm64 pause -p json-output-722000 --output=json --user=testUser

json_output_test.go:63: (dbg) Non-zero exit: out/minikube-darwin-arm64 pause -p json-output-722000 --output=json --user=testUser: exit status 83 (75.484ms)

-- stdout --

	{"specversion":"1.0","id":"c2e733a7-ea2b-4f32-ad51-c905696e04a5","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"The control-plane node json-output-722000 host is not running: state=Stopped"}}

	{"specversion":"1.0","id":"30abf93d-57f1-49b8-b720-b240812e2f87","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"To start a cluster, run: \"minikube start -p json-output-722000\""}}

-- /stdout --

json_output_test.go:65: failed to clean up: args "out/minikube-darwin-arm64 pause -p json-output-722000 --output=json --user=testUser": exit status 83

--- FAIL: TestJSONOutput/pause/Command (0.08s)

=== RUN   TestJSONOutput/unpause/Command

json_output_test.go:63: (dbg) Run:  out/minikube-darwin-arm64 unpause -p json-output-722000 --output=json --user=testUser

json_output_test.go:63: (dbg) Non-zero exit: out/minikube-darwin-arm64 unpause -p json-output-722000 --output=json --user=testUser: exit status 83 (42.790042ms)

-- stdout --

	* The control-plane node json-output-722000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p json-output-722000"

-- /stdout --

json_output_test.go:65: failed to clean up: args "out/minikube-darwin-arm64 unpause -p json-output-722000 --output=json --user=testUser": exit status 83

json_output_test.go:213: unable to marshal output: * The control-plane node json-output-722000 host is not running: state=Stopped

json_output_test.go:70: converting to cloud events: invalid character '*' looking for beginning of value

--- FAIL: TestJSONOutput/unpause/Command (0.04s)

=== RUN   TestMinikubeProfile

minikube_profile_test.go:44: (dbg) Run:  out/minikube-darwin-arm64 start -p first-842000 --driver=qemu2 

minikube_profile_test.go:44: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p first-842000 --driver=qemu2 : exit status 80 (10.128636625s)

-- stdout --

	* [first-842000] minikube v1.34.0 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19616

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19616-1259/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19616-1259/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "first-842000" primary control-plane node in "first-842000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "first-842000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p first-842000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

minikube_profile_test.go:46: test pre-condition failed. args "out/minikube-darwin-arm64 start -p first-842000 --driver=qemu2 ": exit status 80

panic.go:626: *** TestMinikubeProfile FAILED at 2024-09-12 15:10:03.665737 -0700 PDT m=+2524.120055876

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p second-843000 -n second-843000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p second-843000 -n second-843000: exit status 85 (79.750917ms)

-- stdout --

	* Profile "second-843000" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p second-843000"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "second-843000" host is not running, skipping log retrieval (state="* Profile \"second-843000\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p second-843000\"")

helpers_test.go:175: Cleaning up "second-843000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p second-843000

panic.go:626: *** TestMinikubeProfile FAILED at 2024-09-12 15:10:03.849352 -0700 PDT m=+2524.303674959

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p first-842000 -n first-842000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p first-842000 -n first-842000: exit status 7 (29.649959ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "first-842000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "first-842000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p first-842000

--- FAIL: TestMinikubeProfile (10.42s)

=== RUN   TestMountStart/serial/StartWithMountFirst

mount_start_test.go:98: (dbg) Run:  out/minikube-darwin-arm64 start -p mount-start-1-349000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=qemu2 

mount_start_test.go:98: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p mount-start-1-349000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=qemu2 : exit status 80 (10.039140666s)

-- stdout --

	* [mount-start-1-349000] minikube v1.34.0 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19616

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19616-1259/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19616-1259/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting minikube without Kubernetes in cluster mount-start-1-349000

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "mount-start-1-349000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p mount-start-1-349000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

mount_start_test.go:100: failed to start minikube with args: "out/minikube-darwin-arm64 start -p mount-start-1-349000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=qemu2 " : exit status 80

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p mount-start-1-349000 -n mount-start-1-349000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p mount-start-1-349000 -n mount-start-1-349000: exit status 7 (69.327208ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "mount-start-1-349000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMountStart/serial/StartWithMountFirst (10.11s)

=== RUN   TestMultiNode/serial/FreshStart2Nodes

multinode_test.go:96: (dbg) Run:  out/minikube-darwin-arm64 start -p multinode-323000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=qemu2 

multinode_test.go:96: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p multinode-323000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=qemu2 : exit status 80 (9.941943375s)

-- stdout --

	* [multinode-323000] minikube v1.34.0 on Darwin 14.5 (arm64)

	  - MINIKUBE_LOCATION=19616

	  - KUBECONFIG=/Users/jenkins/minikube-integration/19616-1259/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19616-1259/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting "multinode-323000" primary control-plane node in "multinode-323000" cluster

	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "multinode-323000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0912 15:10:14.274955    4072 out.go:345] Setting OutFile to fd 1 ...

	I0912 15:10:14.275085    4072 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:10:14.275089    4072 out.go:358] Setting ErrFile to fd 2...

	I0912 15:10:14.275091    4072 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:10:14.275215    4072 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19616-1259/.minikube/bin

	I0912 15:10:14.276324    4072 out.go:352] Setting JSON to false

	I0912 15:10:14.292221    4072 start.go:129] hostinfo: {"hostname":"MacOS-M1-Agent-2.local","uptime":4178,"bootTime":1726174836,"procs":473,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.5","kernelVersion":"23.5.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"6baf25a2-d406-53a7-bb3a-d7da7f56bb59"}

	W0912 15:10:14.292286    4072 start.go:137] gopshost.Virtualization returned error: not implemented yet

	I0912 15:10:14.299714    4072 out.go:177] * [multinode-323000] minikube v1.34.0 on Darwin 14.5 (arm64)

	I0912 15:10:14.308517    4072 out.go:177]   - MINIKUBE_LOCATION=19616

	I0912 15:10:14.308580    4072 notify.go:220] Checking for updates...

	I0912 15:10:14.316406    4072 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/19616-1259/kubeconfig

	I0912 15:10:14.319511    4072 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0912 15:10:14.322474    4072 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0912 15:10:14.325457    4072 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19616-1259/.minikube

	I0912 15:10:14.328436    4072 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0912 15:10:14.331605    4072 driver.go:394] Setting default libvirt URI to qemu:///system

	I0912 15:10:14.336430    4072 out.go:177] * Using the qemu2 driver based on user configuration

	I0912 15:10:14.343503    4072 start.go:297] selected driver: qemu2

	I0912 15:10:14.343517    4072 start.go:901] validating driver "qemu2" against <nil>

	I0912 15:10:14.343524    4072 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0912 15:10:14.345697    4072 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0912 15:10:14.349383    4072 out.go:177] * Automatically selected the socket_vmnet network

	I0912 15:10:14.352482    4072 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0912 15:10:14.352498    4072 cni.go:84] Creating CNI manager for ""

	I0912 15:10:14.352502    4072 cni.go:136] multinode detected (0 nodes found), recommending kindnet

	I0912 15:10:14.352508    4072 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni

	I0912 15:10:14.352537    4072 start.go:340] cluster config:

	{Name:multinode-323000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726156396-19616@sha256:66b06a42534e914a5c8ad765d7508a93a34031939ec9a6b3a818ef0a444ff889 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:multinode-323000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRu

ntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vm

net_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0912 15:10:14.356104    4072 iso.go:125] acquiring lock: {Name:mk3fa9c1c2a2731193a2e63235bbe8976497103e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0912 15:10:14.362441    4072 out.go:177] * Starting "multinode-323000" primary control-plane node in "multinode-323000" cluster

	I0912 15:10:14.366457    4072 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime docker

	I0912 15:10:14.366480    4072 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19616-1259/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4

	I0912 15:10:14.366487    4072 cache.go:56] Caching tarball of preloaded images

	I0912 15:10:14.366536    4072 preload.go:172] Found /Users/jenkins/minikube-integration/19616-1259/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0912 15:10:14.366542    4072 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on docker

	I0912 15:10:14.366737    4072 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/multinode-323000/config.json ...

	I0912 15:10:14.366748    4072 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/multinode-323000/config.json: {Name:mk1b9bbf567cb445a84cb15e944d17a5783c446a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0912 15:10:14.367125    4072 start.go:360] acquireMachinesLock for multinode-323000: {Name:mk18104440c14407e7206cb5d92d4872e7d20daa Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0912 15:10:14.367167    4072 start.go:364] duration metric: took 34.167µs to acquireMachinesLock for "multinode-323000"

	I0912 15:10:14.367181    4072 start.go:93] Provisioning new machine with config: &{Name:multinode-323000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19616/minikube-v1.34.0-1726156389-19616-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726156396-19616@sha256:66b06a42534e914a5c8ad765d7508a93a34031939ec9a6b3a818ef0a444ff889 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{K

ubernetesVersion:v1.31.1 ClusterName:multinode-323000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[

] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0912 15:10:14.367220    4072 start.go:125] createHost starting for "" (driver="qemu2")

	I0912 15:10:14.375479    4072 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0912 15:10:14.393219    4072 start.go:159] libmachine.API.Create for "multinode-323000" (driver="qemu2")

	I0912 15:10:14.393242    4072 client.go:168] LocalClient.Create starting

	I0912 15:10:14.393303    4072 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19616-1259/.minikube/certs/ca.pem

	I0912 15:10:14.393334    4072 main.go:141] libmachine: Decoding PEM data...

	I0912 15:10:14.393354    4072 main.go:141] libmachine: Parsing certificate...

	I0912 15:10:14.393387    4072 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19616-1259/.minikube/certs/cert.pem

	I0912 15:10:14.393416    4072 main.go:141] libmachine: Decoding PEM data...

	I0912 15:10:14.393422    4072 main.go:141] libmachine: Parsing certificate...

	I0912 15:10:14.393752    4072 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19616-1259/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19616-1259/.minikube/cache/iso/arm64/minikube-v1.34.0-1726156389-19616-arm64.iso...

	I0912 15:10:14.553973    4072 main.go:141] libmachine: Creating SSH key...

	I0912 15:10:14.744912    4072 main.go:141] libmachine: Creating Disk image...

	I0912 15:10:14.744919    4072 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0912 15:10:14.745184    4072 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/multinode-323000/disk.qcow2.raw /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/multinode-323000/disk.qcow2

	I0912 15:10:14.754929    4072 main.go:141] libmachine: STDOUT: 

	I0912 15:10:14.754949    4072 main.go:141] libmachine: STDERR: 

	I0912 15:10:14.755009    4072 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/multinode-323000/disk.qcow2 +20000M

	I0912 15:10:14.762949    4072 main.go:141] libmachine: STDOUT: Image resized.

	I0912 15:10:14.762974    4072 main.go:141] libmachine: STDERR: 

	I0912 15:10:14.762985    4072 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/multinode-323000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/multinode-323000/disk.qcow2

	I0912 15:10:14.762989    4072 main.go:141] libmachine: Starting QEMU VM...

	I0912 15:10:14.763000    4072 qemu.go:418] Using hvf for hardware acceleration

	I0912 15:10:14.763030    4072 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/multinode-323000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/multinode-323000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/multinode-323000/qemu.pid -device virtio-net-pci,netdev=net0,mac=d6:8f:d6:6f:b2:96 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/multinode-323000/disk.qcow2

	I0912 15:10:14.764736    4072 main.go:141] libmachine: STDOUT: 

	I0912 15:10:14.764751    4072 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0912 15:10:14.764769    4072 client.go:171] duration metric: took 371.533791ms to LocalClient.Create

	I0912 15:10:16.766899    4072 start.go:128] duration metric: took 2.399724542s to createHost

	I0912 15:10:16.766945    4072 start.go:83] releasing machines lock for "multinode-323000", held for 2.399833708s

	W0912 15:10:16.767006    4072 start.go:714] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0912 15:10:16.779280    4072 out.go:177] * Deleting "multinode-323000" in qemu2 ...

	W0912 15:10:16.815288    4072 out.go:270] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0912 15:10:16.815307    4072 start.go:729] Will try again in 5 seconds ...

	I0912 15:10:21.817419    4072 start.go:360] acquireMachinesLock for multinode-323000: {Name:mk18104440c14407e7206cb5d92d4872e7d20daa Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0912 15:10:21.817853    4072 start.go:364] duration metric: took 311.792µs to acquireMachinesLock for "multinode-323000"

	I0912 15:10:21.817982    4072 start.go:93] Provisioning new machine with config: &{Name:multinode-323000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19616/minikube-v1.34.0-1726156389-19616-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726156396-19616@sha256:66b06a42534e914a5c8ad765d7508a93a34031939ec9a6b3a818ef0a444ff889 Memory:2200 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{K

ubernetesVersion:v1.31.1 ClusterName:multinode-323000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[

] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0912 15:10:21.818226    4072 start.go:125] createHost starting for "" (driver="qemu2")

	I0912 15:10:21.829702    4072 out.go:235] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0912 15:10:21.880215    4072 start.go:159] libmachine.API.Create for "multinode-323000" (driver="qemu2")

	I0912 15:10:21.880266    4072 client.go:168] LocalClient.Create starting

	I0912 15:10:21.880378    4072 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19616-1259/.minikube/certs/ca.pem

	I0912 15:10:21.880439    4072 main.go:141] libmachine: Decoding PEM data...

	I0912 15:10:21.880458    4072 main.go:141] libmachine: Parsing certificate...

	I0912 15:10:21.880538    4072 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19616-1259/.minikube/certs/cert.pem

	I0912 15:10:21.880586    4072 main.go:141] libmachine: Decoding PEM data...

	I0912 15:10:21.880602    4072 main.go:141] libmachine: Parsing certificate...

	I0912 15:10:21.881309    4072 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/19616-1259/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19616-1259/.minikube/cache/iso/arm64/minikube-v1.34.0-1726156389-19616-arm64.iso...

	I0912 15:10:22.052543    4072 main.go:141] libmachine: Creating SSH key...

	I0912 15:10:22.120048    4072 main.go:141] libmachine: Creating Disk image...

	I0912 15:10:22.120054    4072 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0912 15:10:22.120295    4072 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/multinode-323000/disk.qcow2.raw /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/multinode-323000/disk.qcow2

	I0912 15:10:22.129466    4072 main.go:141] libmachine: STDOUT: 

	I0912 15:10:22.129485    4072 main.go:141] libmachine: STDERR: 

	I0912 15:10:22.129542    4072 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/multinode-323000/disk.qcow2 +20000M

	I0912 15:10:22.137281    4072 main.go:141] libmachine: STDOUT: Image resized.

	I0912 15:10:22.137297    4072 main.go:141] libmachine: STDERR: 

	I0912 15:10:22.137308    4072 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/multinode-323000/disk.qcow2.raw and /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/multinode-323000/disk.qcow2

	I0912 15:10:22.137312    4072 main.go:141] libmachine: Starting QEMU VM...

	I0912 15:10:22.137322    4072 qemu.go:418] Using hvf for hardware acceleration

	I0912 15:10:22.137348    4072 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/multinode-323000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/19616-1259/.minikube/machines/multinode-323000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/multinode-323000/qemu.pid -device virtio-net-pci,netdev=net0,mac=f2:71:6a:de:60:70 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/19616-1259/.minikube/machines/multinode-323000/disk.qcow2

	I0912 15:10:22.138965    4072 main.go:141] libmachine: STDOUT: 

	I0912 15:10:22.138984    4072 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0912 15:10:22.139002    4072 client.go:171] duration metric: took 258.737959ms to LocalClient.Create

	I0912 15:10:24.141132    4072 start.go:128] duration metric: took 2.322931667s to createHost

	I0912 15:10:24.141180    4072 start.go:83] releasing machines lock for "multinode-323000", held for 2.323364958s

	W0912 15:10:24.141590    4072 out.go:270] * Failed to start qemu2 VM. Running "minikube delete -p multinode-323000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p multinode-323000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0912 15:10:24.150711    4072 out.go:201] 

	W0912 15:10:24.160856    4072 out.go:270] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0912 15:10:24.160905    4072 out.go:270] * 

	* 

	W0912 15:10:24.163489    4072 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0912 15:10:24.175725    4072 out.go:201] 

** /stderr **

multinode_test.go:98: failed to start cluster. args "out/minikube-darwin-arm64 start -p multinode-323000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=qemu2 " : exit status 80

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-323000 -n multinode-323000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-323000 -n multinode-323000: exit status 7 (68.578375ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-323000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/FreshStart2Nodes (10.01s)

=== RUN   TestMultiNode/serial/DeployApp2Nodes

multinode_test.go:493: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-323000 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml

multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-323000 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml: exit status 1 (131.5735ms)

** stderr ** 

	error: cluster "multinode-323000" does not exist

** /stderr **

multinode_test.go:495: failed to create busybox deployment to multinode cluster

multinode_test.go:498: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-323000 -- rollout status deployment/busybox

multinode_test.go:498: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-323000 -- rollout status deployment/busybox: exit status 1 (58.447375ms)

** stderr ** 

	error: no server found for cluster "multinode-323000"

** /stderr **

multinode_test.go:500: failed to deploy busybox to multinode cluster

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-323000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-323000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (58.22825ms)

** stderr ** 

	error: no server found for cluster "multinode-323000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-323000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-323000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (103.665625ms)

** stderr ** 

	error: no server found for cluster "multinode-323000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-323000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-323000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (106.35475ms)

** stderr ** 

	error: no server found for cluster "multinode-323000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-323000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-323000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (103.937667ms)

** stderr ** 

	error: no server found for cluster "multinode-323000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-323000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-323000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (103.770958ms)

** stderr ** 

	error: no server found for cluster "multinode-323000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-323000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-323000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (103.837958ms)

** stderr ** 

	error: no server found for cluster "multinode-323000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-323000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-323000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (102.504583ms)

** stderr ** 

	error: no server found for cluster "multinode-323000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-323000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-323000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (103.244125ms)

** stderr ** 

	error: no server found for cluster "multinode-323000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-323000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-323000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (104.833875ms)

** stderr ** 

	error: no server found for cluster "multinode-323000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-323000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-323000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (103.819625ms)

** stderr ** 

	error: no server found for cluster "multinode-323000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

E0912 15:11:52.704539    1784 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/functional-384000/client.crt: no such file or directory" logger="UnhandledError"

E0912 15:12:06.921291    1784 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /Users/jenkins/minikube-integration/19616-1259/.minikube/profiles/addons-094000/client.crt: no such file or directory" logger="UnhandledError"

multinode_test.go:505: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-323000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-323000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (106.764583ms)

** stderr ** 

	error: no server found for cluster "multinode-323000"

** /stderr **

multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:524: failed to resolve pod IPs: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:528: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-323000 -- get pods -o jsonpath='{.items[*].metadata.name}'

multinode_test.go:528: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-323000 -- get pods -o jsonpath='{.items[*].metadata.name}': exit status 1 (57.156584ms)

** stderr ** 

	error: no server found for cluster "multinode-323000"

** /stderr **

multinode_test.go:530: failed get Pod names

multinode_test.go:536: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-323000 -- exec  -- nslookup kubernetes.io

multinode_test.go:536: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-323000 -- exec  -- nslookup kubernetes.io: exit status 1 (56.900625ms)

** stderr ** 

	error: no server found for cluster "multinode-323000"

** /stderr **

multinode_test.go:538: Pod  could not resolve 'kubernetes.io': exit status 1

multinode_test.go:546: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-323000 -- exec  -- nslookup kubernetes.default

multinode_test.go:546: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-323000 -- exec  -- nslookup kubernetes.default: exit status 1 (56.281167ms)

** stderr ** 

	error: no server found for cluster "multinode-323000"

** /stderr **

multinode_test.go:548: Pod  could not resolve 'kubernetes.default': exit status 1

multinode_test.go:554: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-323000 -- exec  -- nslookup kubernetes.default.svc.cluster.local

multinode_test.go:554: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-323000 -- exec  -- nslookup kubernetes.default.svc.cluster.local: exit status 1 (56.029875ms)

** stderr ** 

	error: no server found for cluster "multinode-323000"

** /stderr **

multinode_test.go:556: Pod  could not resolve local service (kubernetes.default.svc.cluster.local): exit status 1

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-323000 -n multinode-323000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-323000 -n multinode-323000: exit status 7 (29.37975ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-323000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/DeployApp2Nodes (104.44s)

=== RUN   TestMultiNode/serial/PingHostFrom2Pods

multinode_test.go:564: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-323000 -- get pods -o jsonpath='{.items[*].metadata.name}'

multinode_test.go:564: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-323000 -- get pods -o jsonpath='{.items[*].metadata.name}': exit status 1 (56.553083ms)

** stderr ** 

	error: no server found for cluster "multinode-323000"

** /stderr **

multinode_test.go:566: failed to get Pod names: exit status 1

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-323000 -n multinode-323000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-323000 -n multinode-323000: exit status 7 (29.262291ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-323000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/PingHostFrom2Pods (0.09s)

=== RUN   TestMultiNode/serial/AddNode

multinode_test.go:121: (dbg) Run:  out/minikube-darwin-arm64 node add -p multinode-323000 -v 3 --alsologtostderr

multinode_test.go:121: (dbg) Non-zero exit: out/minikube-darwin-arm64 node add -p multinode-323000 -v 3 --alsologtostderr: exit status 83 (42.244541ms)

-- stdout --

	* The control-plane node multinode-323000 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p multinode-323000"

-- /stdout --

** stderr ** 

	I0912 15:12:08.815934    4155 out.go:345] Setting OutFile to fd 1 ...

	I0912 15:12:08.816082    4155 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:12:08.816085    4155 out.go:358] Setting ErrFile to fd 2...

	I0912 15:12:08.816088    4155 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:12:08.816209    4155 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19616-1259/.minikube/bin

	I0912 15:12:08.816463    4155 mustload.go:65] Loading cluster: multinode-323000

	I0912 15:12:08.816636    4155 config.go:182] Loaded profile config "multinode-323000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I0912 15:12:08.821321    4155 out.go:177] * The control-plane node multinode-323000 host is not running: state=Stopped

	I0912 15:12:08.825238    4155 out.go:177]   To start a cluster, run: "minikube start -p multinode-323000"

** /stderr **

multinode_test.go:123: failed to add node to current cluster. args "out/minikube-darwin-arm64 node add -p multinode-323000 -v 3 --alsologtostderr" : exit status 83

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-323000 -n multinode-323000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-323000 -n multinode-323000: exit status 7 (29.225875ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-323000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/AddNode (0.07s)

=== RUN   TestMultiNode/serial/MultiNodeLabels

multinode_test.go:221: (dbg) Run:  kubectl --context multinode-323000 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]"

multinode_test.go:221: (dbg) Non-zero exit: kubectl --context multinode-323000 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]": exit status 1 (28.569208ms)

** stderr ** 

	Error in configuration: context was not found for specified context: multinode-323000

** /stderr **

multinode_test.go:223: failed to 'kubectl get nodes' with args "kubectl --context multinode-323000 get nodes -o \"jsonpath=[{range .items[*]}{.metadata.labels},{end}]\"": exit status 1

multinode_test.go:230: failed to decode json from label list: args "kubectl --context multinode-323000 get nodes -o \"jsonpath=[{range .items[*]}{.metadata.labels},{end}]\"": unexpected end of JSON input

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-323000 -n multinode-323000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-323000 -n multinode-323000: exit status 7 (29.483666ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-323000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/MultiNodeLabels (0.06s)

=== RUN   TestMultiNode/serial/ProfileList

multinode_test.go:143: (dbg) Run:  out/minikube-darwin-arm64 profile list --output json

multinode_test.go:166: expected profile "multinode-323000" in json of 'profile list' include 3 nodes but have 1 nodes. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"multinode-323000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"multinode-323000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/19616/minikube-v1.34.0-1726156389-19616-arm64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726156396-19616@sha256:66b06a42534e914a5c8ad765d7508a93a34031939ec9a6b3a818ef0a444ff889\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"qemu2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNU

MACount\":1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.31.1\",\"ClusterName\":\"multinode-323000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVer

sion\":\"v1.31.1\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"socket_vmnet\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"/opt/socket_vmnet/bin/socket_vmnet_client\",\"SocketVMnetPath\":\"/var/run/socket_vmnet\",\"StaticIP\":

\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":false}]}"*. args: "out/minikube-darwin-arm64 profile list --output json"

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-323000 -n multinode-323000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-323000 -n multinode-323000: exit status 7 (30.085458ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-323000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/ProfileList (0.08s)

=== RUN   TestMultiNode/serial/CopyFile

multinode_test.go:184: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-323000 status --output json --alsologtostderr

multinode_test.go:184: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-323000 status --output json --alsologtostderr: exit status 7 (29.636375ms)

-- stdout --

	{"Name":"multinode-323000","Host":"Stopped","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Stopped","Worker":false}

-- /stdout --

** stderr ** 

	I0912 15:12:09.021521    4167 out.go:345] Setting OutFile to fd 1 ...

	I0912 15:12:09.021661    4167 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:12:09.021664    4167 out.go:358] Setting ErrFile to fd 2...

	I0912 15:12:09.021667    4167 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:12:09.021785    4167 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19616-1259/.minikube/bin

	I0912 15:12:09.021900    4167 out.go:352] Setting JSON to true

	I0912 15:12:09.021915    4167 mustload.go:65] Loading cluster: multinode-323000

	I0912 15:12:09.021968    4167 notify.go:220] Checking for updates...

	I0912 15:12:09.022102    4167 config.go:182] Loaded profile config "multinode-323000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I0912 15:12:09.022109    4167 status.go:255] checking status of multinode-323000 ...

	I0912 15:12:09.022325    4167 status.go:330] multinode-323000 host status = "Stopped" (err=<nil>)

	I0912 15:12:09.022329    4167 status.go:343] host is not running, skipping remaining checks

	I0912 15:12:09.022331    4167 status.go:257] multinode-323000 status: &{Name:multinode-323000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

multinode_test.go:191: failed to decode json from status: args "out/minikube-darwin-arm64 -p multinode-323000 status --output json --alsologtostderr": json: cannot unmarshal object into Go value of type []cmd.Status

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-323000 -n multinode-323000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-323000 -n multinode-323000: exit status 7 (29.394291ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-323000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/CopyFile (0.06s)

=== RUN   TestMultiNode/serial/StopNode

multinode_test.go:248: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-323000 node stop m03

multinode_test.go:248: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-323000 node stop m03: exit status 85 (45.931666ms)

-- stdout --

-- /stdout --

** stderr ** 

	X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                         │

	│    * If the above advice does not help, please let us know:                                                             │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

	│                                                                                                                         │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

	│    * Please also attach the following file to the GitHub issue:                                                         │

	│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_295f67d8757edd996fe5c1e7ccde72c355ccf4dc_0.log    │

	│                                                                                                                         │

	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

multinode_test.go:250: node stop returned an error. args "out/minikube-darwin-arm64 -p multinode-323000 node stop m03": exit status 85

multinode_test.go:254: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-323000 status

multinode_test.go:254: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-323000 status: exit status 7 (29.5075ms)

-- stdout --

	multinode-323000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

multinode_test.go:261: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-323000 status --alsologtostderr

multinode_test.go:261: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-323000 status --alsologtostderr: exit status 7 (29.230125ms)

-- stdout --

	multinode-323000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I0912 15:12:09.156294    4175 out.go:345] Setting OutFile to fd 1 ...

	I0912 15:12:09.156414    4175 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:12:09.156418    4175 out.go:358] Setting ErrFile to fd 2...

	I0912 15:12:09.156420    4175 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:12:09.156545    4175 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19616-1259/.minikube/bin

	I0912 15:12:09.156681    4175 out.go:352] Setting JSON to false

	I0912 15:12:09.156693    4175 mustload.go:65] Loading cluster: multinode-323000

	I0912 15:12:09.156742    4175 notify.go:220] Checking for updates...

	I0912 15:12:09.156957    4175 config.go:182] Loaded profile config "multinode-323000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I0912 15:12:09.156964    4175 status.go:255] checking status of multinode-323000 ...

	I0912 15:12:09.157178    4175 status.go:330] multinode-323000 host status = "Stopped" (err=<nil>)

	I0912 15:12:09.157182    4175 status.go:343] host is not running, skipping remaining checks

	I0912 15:12:09.157184    4175 status.go:257] multinode-323000 status: &{Name:multinode-323000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

multinode_test.go:267: incorrect number of running kubelets: args "out/minikube-darwin-arm64 -p multinode-323000 status --alsologtostderr": multinode-323000

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-323000 -n multinode-323000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-323000 -n multinode-323000: exit status 7 (30.006416ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-323000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/StopNode (0.14s)

=== RUN   TestMultiNode/serial/StartAfterStop

multinode_test.go:282: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-323000 node start m03 -v=7 --alsologtostderr

multinode_test.go:282: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-323000 node start m03 -v=7 --alsologtostderr: exit status 85 (44.839084ms)

-- stdout --

-- /stdout --

** stderr ** 

	I0912 15:12:09.216193    4179 out.go:345] Setting OutFile to fd 1 ...

	I0912 15:12:09.216468    4179 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:12:09.216471    4179 out.go:358] Setting ErrFile to fd 2...

	I0912 15:12:09.216473    4179 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:12:09.216613    4179 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19616-1259/.minikube/bin

	I0912 15:12:09.216856    4179 mustload.go:65] Loading cluster: multinode-323000

	I0912 15:12:09.217055    4179 config.go:182] Loaded profile config "multinode-323000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I0912 15:12:09.221241    4179 out.go:201] 

	W0912 15:12:09.224266    4179 out.go:270] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03

	X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03

	W0912 15:12:09.224271    4179 out.go:270] * 

	* 

	W0912 15:12:09.225885    4179 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                         │

	│    * If the above advice does not help, please let us know:                                                             │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

	│                                                                                                                         │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

	│    * Please also attach the following file to the GitHub issue:                                                         │

	│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │

	│                                                                                                                         │

	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                         │

	│    * If the above advice does not help, please let us know:                                                             │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

	│                                                                                                                         │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

	│    * Please also attach the following file to the GitHub issue:                                                         │

	│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │

	│                                                                                                                         │

	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	I0912 15:12:09.227387    4179 out.go:201] 

** /stderr **

multinode_test.go:284: I0912 15:12:09.216193    4179 out.go:345] Setting OutFile to fd 1 ...

I0912 15:12:09.216468    4179 out.go:392] TERM=,COLORTERM=, which probably does not support color

I0912 15:12:09.216471    4179 out.go:358] Setting ErrFile to fd 2...

I0912 15:12:09.216473    4179 out.go:392] TERM=,COLORTERM=, which probably does not support color

I0912 15:12:09.216613    4179 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19616-1259/.minikube/bin

I0912 15:12:09.216856    4179 mustload.go:65] Loading cluster: multinode-323000

I0912 15:12:09.217055    4179 config.go:182] Loaded profile config "multinode-323000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

I0912 15:12:09.221241    4179 out.go:201] 

W0912 15:12:09.224266    4179 out.go:270] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03

X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03

W0912 15:12:09.224271    4179 out.go:270] * 

* 

W0912 15:12:09.225885    4179 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

│                                                                                                                         │

│    * If the above advice does not help, please let us know:                                                             │

│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

│                                                                                                                         │

│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

│    * Please also attach the following file to the GitHub issue:                                                         │

│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │

│                                                                                                                         │

╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

│                                                                                                                         │

│    * If the above advice does not help, please let us know:                                                             │

│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

│                                                                                                                         │

│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

│    * Please also attach the following file to the GitHub issue:                                                         │

│    * - /var/folders/vk/m7_4p8zn1574p4fs17hx47100000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │

│                                                                                                                         │

╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

I0912 15:12:09.227387    4179 out.go:201] 

multinode_test.go:285: node start returned an error. args "out/minikube-darwin-arm64 -p multinode-323000 node start m03 -v=7 --alsologtostderr": exit status 85

multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-323000 status -v=7 --alsologtostderr

multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-323000 status -v=7 --alsologtostderr: exit status 7 (29.544542ms)

-- stdout --

	multinode-323000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I0912 15:12:09.261236    4181 out.go:345] Setting OutFile to fd 1 ...

	I0912 15:12:09.261360    4181 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:12:09.261364    4181 out.go:358] Setting ErrFile to fd 2...

	I0912 15:12:09.261366    4181 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:12:09.261483    4181 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19616-1259/.minikube/bin

	I0912 15:12:09.261613    4181 out.go:352] Setting JSON to false

	I0912 15:12:09.261624    4181 mustload.go:65] Loading cluster: multinode-323000

	I0912 15:12:09.261670    4181 notify.go:220] Checking for updates...

	I0912 15:12:09.261822    4181 config.go:182] Loaded profile config "multinode-323000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I0912 15:12:09.261829    4181 status.go:255] checking status of multinode-323000 ...

	I0912 15:12:09.262026    4181 status.go:330] multinode-323000 host status = "Stopped" (err=<nil>)

	I0912 15:12:09.262029    4181 status.go:343] host is not running, skipping remaining checks

	I0912 15:12:09.262031    4181 status.go:257] multinode-323000 status: &{Name:multinode-323000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-323000 status -v=7 --alsologtostderr

multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-323000 status -v=7 --alsologtostderr: exit status 7 (72.405ms)

-- stdout --

	multinode-323000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I0912 15:12:10.303954    4183 out.go:345] Setting OutFile to fd 1 ...

	I0912 15:12:10.304130    4183 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:12:10.304134    4183 out.go:358] Setting ErrFile to fd 2...

	I0912 15:12:10.304137    4183 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:12:10.304293    4183 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19616-1259/.minikube/bin

	I0912 15:12:10.304436    4183 out.go:352] Setting JSON to false

	I0912 15:12:10.304452    4183 mustload.go:65] Loading cluster: multinode-323000

	I0912 15:12:10.304500    4183 notify.go:220] Checking for updates...

	I0912 15:12:10.304720    4183 config.go:182] Loaded profile config "multinode-323000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I0912 15:12:10.304730    4183 status.go:255] checking status of multinode-323000 ...

	I0912 15:12:10.305032    4183 status.go:330] multinode-323000 host status = "Stopped" (err=<nil>)

	I0912 15:12:10.305036    4183 status.go:343] host is not running, skipping remaining checks

	I0912 15:12:10.305039    4183 status.go:257] multinode-323000 status: &{Name:multinode-323000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-323000 status -v=7 --alsologtostderr

multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-323000 status -v=7 --alsologtostderr: exit status 7 (74.106958ms)

-- stdout --

	multinode-323000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I0912 15:12:12.202899    4185 out.go:345] Setting OutFile to fd 1 ...

	I0912 15:12:12.203094    4185 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:12:12.203098    4185 out.go:358] Setting ErrFile to fd 2...

	I0912 15:12:12.203101    4185 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:12:12.203304    4185 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19616-1259/.minikube/bin

	I0912 15:12:12.203484    4185 out.go:352] Setting JSON to false

	I0912 15:12:12.203500    4185 mustload.go:65] Loading cluster: multinode-323000

	I0912 15:12:12.203544    4185 notify.go:220] Checking for updates...

	I0912 15:12:12.203757    4185 config.go:182] Loaded profile config "multinode-323000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I0912 15:12:12.203766    4185 status.go:255] checking status of multinode-323000 ...

	I0912 15:12:12.204075    4185 status.go:330] multinode-323000 host status = "Stopped" (err=<nil>)

	I0912 15:12:12.204080    4185 status.go:343] host is not running, skipping remaining checks

	I0912 15:12:12.204083    4185 status.go:257] multinode-323000 status: &{Name:multinode-323000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-323000 status -v=7 --alsologtostderr

multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-323000 status -v=7 --alsologtostderr: exit status 7 (70.330291ms)

-- stdout --

	multinode-323000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I0912 15:12:14.825931    4190 out.go:345] Setting OutFile to fd 1 ...

	I0912 15:12:14.826107    4190 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:12:14.826115    4190 out.go:358] Setting ErrFile to fd 2...

	I0912 15:12:14.826118    4190 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:12:14.826305    4190 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19616-1259/.minikube/bin

	I0912 15:12:14.826464    4190 out.go:352] Setting JSON to false

	I0912 15:12:14.826479    4190 mustload.go:65] Loading cluster: multinode-323000

	I0912 15:12:14.826512    4190 notify.go:220] Checking for updates...

	I0912 15:12:14.826774    4190 config.go:182] Loaded profile config "multinode-323000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I0912 15:12:14.826782    4190 status.go:255] checking status of multinode-323000 ...

	I0912 15:12:14.827079    4190 status.go:330] multinode-323000 host status = "Stopped" (err=<nil>)

	I0912 15:12:14.827084    4190 status.go:343] host is not running, skipping remaining checks

	I0912 15:12:14.827087    4190 status.go:257] multinode-323000 status: &{Name:multinode-323000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-323000 status -v=7 --alsologtostderr

multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-323000 status -v=7 --alsologtostderr: exit status 7 (75.349833ms)

-- stdout --

	multinode-323000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I0912 15:12:18.691345    4192 out.go:345] Setting OutFile to fd 1 ...

	I0912 15:12:18.691554    4192 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:12:18.691558    4192 out.go:358] Setting ErrFile to fd 2...

	I0912 15:12:18.691561    4192 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:12:18.691720    4192 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19616-1259/.minikube/bin

	I0912 15:12:18.691878    4192 out.go:352] Setting JSON to false

	I0912 15:12:18.691893    4192 mustload.go:65] Loading cluster: multinode-323000

	I0912 15:12:18.691936    4192 notify.go:220] Checking for updates...

	I0912 15:12:18.692139    4192 config.go:182] Loaded profile config "multinode-323000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I0912 15:12:18.692147    4192 status.go:255] checking status of multinode-323000 ...

	I0912 15:12:18.692422    4192 status.go:330] multinode-323000 host status = "Stopped" (err=<nil>)

	I0912 15:12:18.692427    4192 status.go:343] host is not running, skipping remaining checks

	I0912 15:12:18.692430    4192 status.go:257] multinode-323000 status: &{Name:multinode-323000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-323000 status -v=7 --alsologtostderr

multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-323000 status -v=7 --alsologtostderr: exit status 7 (73.856917ms)

-- stdout --

	multinode-323000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I0912 15:12:25.842537    4194 out.go:345] Setting OutFile to fd 1 ...

	I0912 15:12:25.842718    4194 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:12:25.842722    4194 out.go:358] Setting ErrFile to fd 2...

	I0912 15:12:25.842726    4194 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:12:25.842904    4194 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19616-1259/.minikube/bin

	I0912 15:12:25.843050    4194 out.go:352] Setting JSON to false

	I0912 15:12:25.843065    4194 mustload.go:65] Loading cluster: multinode-323000

	I0912 15:12:25.843098    4194 notify.go:220] Checking for updates...

	I0912 15:12:25.843328    4194 config.go:182] Loaded profile config "multinode-323000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I0912 15:12:25.843337    4194 status.go:255] checking status of multinode-323000 ...

	I0912 15:12:25.843644    4194 status.go:330] multinode-323000 host status = "Stopped" (err=<nil>)

	I0912 15:12:25.843648    4194 status.go:343] host is not running, skipping remaining checks

	I0912 15:12:25.843651    4194 status.go:257] multinode-323000 status: &{Name:multinode-323000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-323000 status -v=7 --alsologtostderr

multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-323000 status -v=7 --alsologtostderr: exit status 7 (71.810833ms)

-- stdout --

	multinode-323000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I0912 15:12:32.371275    4196 out.go:345] Setting OutFile to fd 1 ...

	I0912 15:12:32.371460    4196 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:12:32.371464    4196 out.go:358] Setting ErrFile to fd 2...

	I0912 15:12:32.371468    4196 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:12:32.371627    4196 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19616-1259/.minikube/bin

	I0912 15:12:32.371785    4196 out.go:352] Setting JSON to false

	I0912 15:12:32.371803    4196 mustload.go:65] Loading cluster: multinode-323000

	I0912 15:12:32.371834    4196 notify.go:220] Checking for updates...

	I0912 15:12:32.372083    4196 config.go:182] Loaded profile config "multinode-323000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I0912 15:12:32.372091    4196 status.go:255] checking status of multinode-323000 ...

	I0912 15:12:32.372353    4196 status.go:330] multinode-323000 host status = "Stopped" (err=<nil>)

	I0912 15:12:32.372358    4196 status.go:343] host is not running, skipping remaining checks

	I0912 15:12:32.372361    4196 status.go:257] multinode-323000 status: &{Name:multinode-323000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-323000 status -v=7 --alsologtostderr

multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-323000 status -v=7 --alsologtostderr: exit status 7 (73.732541ms)

-- stdout --

	multinode-323000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I0912 15:12:38.333416    4198 out.go:345] Setting OutFile to fd 1 ...

	I0912 15:12:38.333634    4198 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:12:38.333638    4198 out.go:358] Setting ErrFile to fd 2...

	I0912 15:12:38.333641    4198 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:12:38.333862    4198 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19616-1259/.minikube/bin

	I0912 15:12:38.334026    4198 out.go:352] Setting JSON to false

	I0912 15:12:38.334045    4198 mustload.go:65] Loading cluster: multinode-323000

	I0912 15:12:38.334077    4198 notify.go:220] Checking for updates...

	I0912 15:12:38.334315    4198 config.go:182] Loaded profile config "multinode-323000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I0912 15:12:38.334325    4198 status.go:255] checking status of multinode-323000 ...

	I0912 15:12:38.334606    4198 status.go:330] multinode-323000 host status = "Stopped" (err=<nil>)

	I0912 15:12:38.334611    4198 status.go:343] host is not running, skipping remaining checks

	I0912 15:12:38.334614    4198 status.go:257] multinode-323000 status: &{Name:multinode-323000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-323000 status -v=7 --alsologtostderr

multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-323000 status -v=7 --alsologtostderr: exit status 7 (72.366958ms)

-- stdout --

	multinode-323000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I0912 15:12:55.321241    4206 out.go:345] Setting OutFile to fd 1 ...

	I0912 15:12:55.321677    4206 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:12:55.321683    4206 out.go:358] Setting ErrFile to fd 2...

	I0912 15:12:55.321687    4206 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I0912 15:12:55.321945    4206 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19616-1259/.minikube/bin

	I0912 15:12:55.322164    4206 out.go:352] Setting JSON to false

	I0912 15:12:55.322178    4206 mustload.go:65] Loading cluster: multinode-323000

	I0912 15:12:55.322325    4206 notify.go:220] Checking for updates...

	I0912 15:12:55.322747    4206 config.go:182] Loaded profile config "multinode-323000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.1

	I0912 15:12:55.322759    4206 status.go:255] checking status of multinode-323000 ...

	I0912 15:12:55.323050    4206 status.go:330] multinode-323000 host status = "Stopped" (err=<nil>)

	I0912 15:12:55.323056    4206 status.go:343] host is not running, skipping remaining checks

	I0912 15:12:55.323059    4206 status.go:257] multinode-323000 status: &{Name:multinode-323000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

multinode_test.go:294: failed to run minikube status. args "out/minikube-darwin-arm64 -p multinode-323000 status -v=7 --alsologtostderr" : exit status 7

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-323000 -n multinode-323000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-323000 -n multinode-323000: exit status 7 (31.980541ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-323000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/StartAfterStop (46.17s)