=== RUN   TestDownloadOnly/v1.16.0/json-events

aaa_download_only_test.go:69: (dbg) Run:  out/minikube-darwin-arm64 start -o=json --download-only -p download-only-819000 --force --alsologtostderr --kubernetes-version=v1.16.0 --container-runtime=docker --driver=qemu2 

aaa_download_only_test.go:69: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -o=json --download-only -p download-only-819000 --force --alsologtostderr --kubernetes-version=v1.16.0 --container-runtime=docker --driver=qemu2 : exit status 40 (35.657077834s)

-- stdout --

	{"specversion":"1.0","id":"3d750825-b11b-4b12-8e04-8c621cc788e8","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[download-only-819000] minikube v1.30.1 on Darwin 13.3.1 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}

	{"specversion":"1.0","id":"a7ba4a69-f665-4c28-8a6b-52f6226e84b9","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=16543"}}

	{"specversion":"1.0","id":"e4f79a31-40dd-4f37-9323-23e6888abdb3","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/Users/jenkins/minikube-integration/16543-1012/kubeconfig"}}

	{"specversion":"1.0","id":"c1995b4e-ccc8-4f78-8d4c-f17ff21ea8da","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-darwin-arm64"}}

	{"specversion":"1.0","id":"e77d1d44-c8d7-43ff-b766-85de269c4c7c","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}

	{"specversion":"1.0","id":"ed007353-3bb2-496f-b025-a52925e45c12","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/Users/jenkins/minikube-integration/16543-1012/.minikube"}}

	{"specversion":"1.0","id":"3cf3be1b-e861-4b19-89c9-c2e1e77c83a2","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.warning","datacontenttype":"application/json","data":{"message":"minikube skips various validations when --force is supplied; this may lead to unexpected behavior"}}

	{"specversion":"1.0","id":"b3d4a129-58b6-41c0-a06e-23ae7560870d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the qemu2 driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}

	{"specversion":"1.0","id":"75c27f40-e739-4979-bda7-ec0c7ed3b0a6","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Automatically selected the socket_vmnet network"}}

	{"specversion":"1.0","id":"2535989e-6fec-4d54-80c8-7f5d688aab50","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Downloading VM boot image ...","name":"Selecting Driver","totalsteps":"19"}}

	{"specversion":"1.0","id":"e1c700c2-abf5-4f8e-9d81-60cdc74b4fa3","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting control plane node download-only-819000 in cluster download-only-819000","name":"Starting Node","totalsteps":"19"}}

	{"specversion":"1.0","id":"e1828de7-28fe-4348-8835-40ed4eee4724","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Downloading Kubernetes v1.16.0 preload ...","name":"Starting Node","totalsteps":"19"}}

	{"specversion":"1.0","id":"a602f21b-7c76-4456-8564-ee11b09074ed","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"40","issues":"","message":"Failed to cache kubectl: download failed: https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl.sha1: getter: \u0026{Ctx:context.Background Src:https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl.sha1 Dst:/Users/jenkins/minikube-integration/16543-1012/.minikube/cache/darwin/arm64/v1.16.0/kubectl.download Pwd: Mode:2 Umask:---------- Detectors:[0x107b9e1b8 0x107b9e1b8 0x107b9e1b8 0x107b9e1b8 0x107b9e1b8 0x107b9e1b8 0x107b9e1b8] Decompressors:map[bz2:0x14000056a28 gz:0x14000056a80 tar:0x14000056a30 tar.bz2:0x14000056a40 tar.gz:0x14000056a50 tar.xz:0x14000056a60 tar.zst:0x14000056a70 tbz2:0x14000056a40 tgz:0x140000

56a50 txz:0x14000056a60 tzst:0x14000056a70 xz:0x14000056a88 zip:0x14000056a90 zst:0x14000056aa0] Getters:map[file:0x140005a2c70 http:0x140009d6190 https:0x140009d61e0] Dir:false ProgressListener:\u003cnil\u003e Insecure:false DisableSymlinks:false Options:[]}: invalid checksum: Error downloading checksum file: bad response code: 404","name":"INET_CACHE_KUBECTL","url":""}}

	{"specversion":"1.0","id":"7f05ff83-5f22-47a5-8b66-d8b8dcf7ba52","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"╭───────────────────────────────────────────────────────────────────────────────────────────╮\n│                                                                                           │\n│    If the above advice does not help, please let us know:                                 │\n│    https://github.com/kubernetes/minikube/issues/new/choose                               │\n│                                                                                           │\n│    Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │\n│

│\n╰───────────────────────────────────────────────────────────────────────────────────────────╯"}}

-- /stdout --

** stderr ** 

	I0520 08:03:43.095340    1442 out.go:296] Setting OutFile to fd 1 ...

	I0520 08:03:43.095468    1442 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0520 08:03:43.095471    1442 out.go:309] Setting ErrFile to fd 2...

	I0520 08:03:43.095473    1442 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0520 08:03:43.095576    1442 root.go:336] Updating PATH: /Users/jenkins/minikube-integration/16543-1012/.minikube/bin

	W0520 08:03:43.095700    1442 root.go:312] Error reading config file at /Users/jenkins/minikube-integration/16543-1012/.minikube/config/config.json: open /Users/jenkins/minikube-integration/16543-1012/.minikube/config/config.json: no such file or directory

	I0520 08:03:43.096871    1442 out.go:303] Setting JSON to true

	I0520 08:03:43.113839    1442 start.go:125] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":194,"bootTime":1684594829,"procs":411,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"13.3.1","kernelVersion":"22.4.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}

	W0520 08:03:43.113901    1442 start.go:133] gopshost.Virtualization returned error: not implemented yet

	I0520 08:03:43.119826    1442 out.go:97] [download-only-819000] minikube v1.30.1 on Darwin 13.3.1 (arm64)

	I0520 08:03:43.119967    1442 notify.go:220] Checking for updates...

	I0520 08:03:43.122768    1442 out.go:169] MINIKUBE_LOCATION=16543

	W0520 08:03:43.120062    1442 preload.go:295] Failed to list preload files: open /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/preloaded-tarball: no such file or directory

	I0520 08:03:43.131853    1442 out.go:169] KUBECONFIG=/Users/jenkins/minikube-integration/16543-1012/kubeconfig

	I0520 08:03:43.135793    1442 out.go:169] MINIKUBE_BIN=out/minikube-darwin-arm64

	I0520 08:03:43.138802    1442 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0520 08:03:43.141847    1442 out.go:169] MINIKUBE_HOME=/Users/jenkins/minikube-integration/16543-1012/.minikube

	W0520 08:03:43.147820    1442 out.go:272] minikube skips various validations when --force is supplied; this may lead to unexpected behavior

	I0520 08:03:43.148040    1442 driver.go:375] Setting default libvirt URI to qemu:///system

	I0520 08:03:43.152875    1442 out.go:97] Using the qemu2 driver based on user configuration

	I0520 08:03:43.152898    1442 start.go:295] selected driver: qemu2

	I0520 08:03:43.152913    1442 start.go:870] validating driver "qemu2" against <nil>

	I0520 08:03:43.152960    1442 start_flags.go:305] no existing cluster config was found, will generate one from the flags 

	I0520 08:03:43.156798    1442 out.go:169] Automatically selected the socket_vmnet network

	I0520 08:03:43.162273    1442 start_flags.go:382] Using suggested 4000MB memory alloc based on sys=16384MB, container=0MB

	I0520 08:03:43.162343    1442 start_flags.go:897] Wait components to verify : map[apiserver:true system_pods:true]

	I0520 08:03:43.162367    1442 cni.go:84] Creating CNI manager for ""

	I0520 08:03:43.162383    1442 cni.go:161] CNI unnecessary in this configuration, recommending no CNI

	I0520 08:03:43.162388    1442 start_flags.go:319] config:

	{Name:download-only-819000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684523789-16533@sha256:ed200ff6d686f303885e8aaf964442d08018856d63a8e23f7acdc068766ea82b Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:download-only-819000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRun

time:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}

	I0520 08:03:43.162551    1442 iso.go:125] acquiring lock: {Name:mkf05a14b47e9b67445252fbb4917f3bcb37f054 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0520 08:03:43.166848    1442 out.go:97] Downloading VM boot image ...

	I0520 08:03:43.166864    1442 download.go:107] Downloading: https://storage.googleapis.com/minikube-builds/iso/16506/minikube-v1.30.1-1684174510-16506-arm64.iso?checksum=file:https://storage.googleapis.com/minikube-builds/iso/16506/minikube-v1.30.1-1684174510-16506-arm64.iso.sha256 -> /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/iso/arm64/minikube-v1.30.1-1684174510-16506-arm64.iso

	I0520 08:03:58.666525    1442 out.go:97] Starting control plane node download-only-819000 in cluster download-only-819000

	I0520 08:03:58.666550    1442 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker

	I0520 08:03:58.783564    1442 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.16.0/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4

	I0520 08:03:58.783651    1442 cache.go:57] Caching tarball of preloaded images

	I0520 08:03:58.783907    1442 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker

	I0520 08:03:58.790013    1442 out.go:97] Downloading Kubernetes v1.16.0 preload ...

	I0520 08:03:58.790024    1442 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4 ...

	I0520 08:03:59.004399    1442 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.16.0/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4?checksum=md5:a000baffb0664b293d602f95ed25caa6 -> /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4

	I0520 08:04:17.309003    1442 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4 ...

	I0520 08:04:17.309128    1442 preload.go:256] verifying checksum of /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4 ...

	I0520 08:04:17.955488    1442 cache.go:60] Finished verifying existence of preloaded tar for  v1.16.0 on docker

	I0520 08:04:17.955663    1442 profile.go:148] Saving config to /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/download-only-819000/config.json ...

	I0520 08:04:17.955687    1442 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/download-only-819000/config.json: {Name:mkac2b33f86d40d978ccd26f5df89d7fe7d6cc30 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0520 08:04:17.955943    1442 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker

	I0520 08:04:17.956121    1442 download.go:107] Downloading: https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl.sha1 -> /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/darwin/arm64/v1.16.0/kubectl

	I0520 08:04:18.678505    1442 out.go:169] 

	W0520 08:04:18.683611    1442 out_reason.go:110] Failed to cache kubectl: download failed: https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl.sha1: getter: &{Ctx:context.Background Src:https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl.sha1 Dst:/Users/jenkins/minikube-integration/16543-1012/.minikube/cache/darwin/arm64/v1.16.0/kubectl.download Pwd: Mode:2 Umask:---------- Detectors:[0x107b9e1b8 0x107b9e1b8 0x107b9e1b8 0x107b9e1b8 0x107b9e1b8 0x107b9e1b8 0x107b9e1b8] Decompressors:map[bz2:0x14000056a28 gz:0x14000056a80 tar:0x14000056a30 tar.bz2:0x14000056a40 tar.gz:0x14000056a50 tar.xz:0x14000056a60 tar.zst:0x14000056a70 tbz2:0x14000056a40 tgz:0x14000056a50 txz:0x14000056a60 tzst:0x14000056a70 xz:0x14000056a88 zip:0x14000056a90 zst:0x14000056aa0] Getters:map[file:0x140005a2c70 http:0x140009d6190 https:0x140009d61e0] Dir:false ProgressListener

:<nil> Insecure:false DisableSymlinks:false Options:[]}: invalid checksum: Error downloading checksum file: bad response code: 404

	W0520 08:04:18.683645    1442 out_reason.go:110] 

	W0520 08:04:18.691481    1442 out.go:229] ╭───────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                           │

	│    If the above advice does not help, please let us know:                                 │

	│    https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                           │

	│    Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                           │

	╰───────────────────────────────────────────────────────────────────────────────────────────╯

	I0520 08:04:18.696487    1442 out.go:169] 

** /stderr **

aaa_download_only_test.go:71: failed to download only. args: ["start" "-o=json" "--download-only" "-p" "download-only-819000" "--force" "--alsologtostderr" "--kubernetes-version=v1.16.0" "--container-runtime=docker" "--driver=qemu2" ""] exit status 40

--- FAIL: TestDownloadOnly/v1.16.0/json-events (35.66s)

=== RUN   TestDownloadOnly/v1.16.0/kubectl

aaa_download_only_test.go:160: expected the file for binary exist at "/Users/jenkins/minikube-integration/16543-1012/.minikube/cache/darwin/arm64/v1.16.0/kubectl" but got error stat /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/darwin/arm64/v1.16.0/kubectl: no such file or directory

--- FAIL: TestDownloadOnly/v1.16.0/kubectl (0.00s)

=== RUN   TestOffline

=== PAUSE TestOffline

=== CONT  TestOffline

aab_offline_test.go:55: (dbg) Run:  out/minikube-darwin-arm64 start -p offline-docker-820000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=qemu2 

aab_offline_test.go:55: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p offline-docker-820000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=qemu2 : exit status 80 (9.872031583s)

-- stdout --

	* [offline-docker-820000] minikube v1.30.1 on Darwin 13.3.1 (arm64)

	  - MINIKUBE_LOCATION=16543

	  - KUBECONFIG=/Users/jenkins/minikube-integration/16543-1012/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/16543-1012/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting control plane node offline-docker-820000 in cluster offline-docker-820000

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "offline-docker-820000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0520 08:18:31.470117    3207 out.go:296] Setting OutFile to fd 1 ...

	I0520 08:18:31.470244    3207 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0520 08:18:31.470247    3207 out.go:309] Setting ErrFile to fd 2...

	I0520 08:18:31.470249    3207 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0520 08:18:31.470318    3207 root.go:336] Updating PATH: /Users/jenkins/minikube-integration/16543-1012/.minikube/bin

	I0520 08:18:31.471363    3207 out.go:303] Setting JSON to false

	I0520 08:18:31.488608    3207 start.go:125] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":1082,"bootTime":1684594829,"procs":449,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"13.3.1","kernelVersion":"22.4.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}

	W0520 08:18:31.488693    3207 start.go:133] gopshost.Virtualization returned error: not implemented yet

	I0520 08:18:31.493760    3207 out.go:177] * [offline-docker-820000] minikube v1.30.1 on Darwin 13.3.1 (arm64)

	I0520 08:18:31.501691    3207 notify.go:220] Checking for updates...

	I0520 08:18:31.505462    3207 out.go:177]   - MINIKUBE_LOCATION=16543

	I0520 08:18:31.508708    3207 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/16543-1012/kubeconfig

	I0520 08:18:31.511687    3207 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0520 08:18:31.514757    3207 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0520 08:18:31.517683    3207 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/16543-1012/.minikube

	I0520 08:18:31.520776    3207 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0520 08:18:31.524033    3207 config.go:182] Loaded profile config "multinode-046000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.27.2

	I0520 08:18:31.524064    3207 driver.go:375] Setting default libvirt URI to qemu:///system

	I0520 08:18:31.527659    3207 out.go:177] * Using the qemu2 driver based on user configuration

	I0520 08:18:31.534649    3207 start.go:295] selected driver: qemu2

	I0520 08:18:31.534658    3207 start.go:870] validating driver "qemu2" against <nil>

	I0520 08:18:31.534665    3207 start.go:881] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0520 08:18:31.536447    3207 start_flags.go:305] no existing cluster config was found, will generate one from the flags 

	I0520 08:18:31.539583    3207 out.go:177] * Automatically selected the socket_vmnet network

	I0520 08:18:31.542775    3207 start_flags.go:915] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0520 08:18:31.542792    3207 cni.go:84] Creating CNI manager for ""

	I0520 08:18:31.542801    3207 cni.go:157] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0520 08:18:31.542805    3207 start_flags.go:314] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0520 08:18:31.542813    3207 start_flags.go:319] config:

	{Name:offline-docker-820000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684523789-16533@sha256:ed200ff6d686f303885e8aaf964442d08018856d63a8e23f7acdc068766ea82b Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.2 ClusterName:offline-docker-820000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerR

untime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}

	I0520 08:18:31.542895    3207 iso.go:125] acquiring lock: {Name:mkf05a14b47e9b67445252fbb4917f3bcb37f054 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0520 08:18:31.548646    3207 out.go:177] * Starting control plane node offline-docker-820000 in cluster offline-docker-820000

	I0520 08:18:31.552675    3207 preload.go:132] Checking if preload exists for k8s version v1.27.2 and runtime docker

	I0520 08:18:31.552705    3207 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.2-docker-overlay2-arm64.tar.lz4

	I0520 08:18:31.552713    3207 cache.go:57] Caching tarball of preloaded images

	I0520 08:18:31.552789    3207 preload.go:174] Found /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0520 08:18:31.552794    3207 cache.go:60] Finished verifying existence of preloaded tar for  v1.27.2 on docker

	I0520 08:18:31.552860    3207 profile.go:148] Saving config to /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/offline-docker-820000/config.json ...

	I0520 08:18:31.552871    3207 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/offline-docker-820000/config.json: {Name:mk208e6468b2f2ba25166a25a87763b965d48467 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0520 08:18:31.553049    3207 cache.go:195] Successfully downloaded all kic artifacts

	I0520 08:18:31.553059    3207 start.go:364] acquiring machines lock for offline-docker-820000: {Name:mk270c257f49033ffda3b70fea9b877c78314aa8 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0520 08:18:31.553084    3207 start.go:368] acquired machines lock for "offline-docker-820000" in 20.75µs

	I0520 08:18:31.553097    3207 start.go:93] Provisioning new machine with config: &{Name:offline-docker-820000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/16506/minikube-v1.30.1-1684174510-16506-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684523789-16533@sha256:ed200ff6d686f303885e8aaf964442d08018856d63a8e23f7acdc068766ea82b Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne

tesConfig:{KubernetesVersion:v1.27.2 ClusterName:offline-docker-820000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP

: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:} &{Name: IP: Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0520 08:18:31.553121    3207 start.go:125] createHost starting for "" (driver="qemu2")

	I0520 08:18:31.571678    3207 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0520 08:18:31.586101    3207 start.go:159] libmachine.API.Create for "offline-docker-820000" (driver="qemu2")

	I0520 08:18:31.586127    3207 client.go:168] LocalClient.Create starting

	I0520 08:18:31.586190    3207 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/ca.pem

	I0520 08:18:31.586213    3207 main.go:141] libmachine: Decoding PEM data...

	I0520 08:18:31.586224    3207 main.go:141] libmachine: Parsing certificate...

	I0520 08:18:31.586276    3207 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/cert.pem

	I0520 08:18:31.586291    3207 main.go:141] libmachine: Decoding PEM data...

	I0520 08:18:31.586301    3207 main.go:141] libmachine: Parsing certificate...

	I0520 08:18:31.586618    3207 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/16543-1012/.minikube/cache/iso/arm64/minikube-v1.30.1-1684174510-16506-arm64.iso...

	I0520 08:18:31.698699    3207 main.go:141] libmachine: Creating SSH key...

	I0520 08:18:31.853254    3207 main.go:141] libmachine: Creating Disk image...

	I0520 08:18:31.853270    3207 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0520 08:18:31.853496    3207 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/offline-docker-820000/disk.qcow2.raw /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/offline-docker-820000/disk.qcow2

	I0520 08:18:31.867847    3207 main.go:141] libmachine: STDOUT: 

	I0520 08:18:31.867872    3207 main.go:141] libmachine: STDERR: 

	I0520 08:18:31.867942    3207 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/offline-docker-820000/disk.qcow2 +20000M

	I0520 08:18:31.875762    3207 main.go:141] libmachine: STDOUT: Image resized.

	I0520 08:18:31.875782    3207 main.go:141] libmachine: STDERR: 

	I0520 08:18:31.875815    3207 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/offline-docker-820000/disk.qcow2.raw and /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/offline-docker-820000/disk.qcow2

	I0520 08:18:31.875824    3207 main.go:141] libmachine: Starting QEMU VM...

	I0520 08:18:31.875864    3207 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/Cellar/qemu/7.2.0/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/offline-docker-820000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/offline-docker-820000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/offline-docker-820000/qemu.pid -device virtio-net-pci,netdev=net0,mac=7e:29:bf:ad:b4:50 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/offline-docker-820000/disk.qcow2

	I0520 08:18:31.877593    3207 main.go:141] libmachine: STDOUT: 

	I0520 08:18:31.877606    3207 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0520 08:18:31.877627    3207 client.go:171] LocalClient.Create took 291.493458ms

	I0520 08:18:33.879413    3207 start.go:128] duration metric: createHost completed in 2.326286084s

	I0520 08:18:33.879437    3207 start.go:83] releasing machines lock for "offline-docker-820000", held for 2.326353292s

	W0520 08:18:33.879474    3207 start.go:687] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0520 08:18:33.890271    3207 out.go:177] * Deleting "offline-docker-820000" in qemu2 ...

	W0520 08:18:33.901891    3207 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0520 08:18:33.901902    3207 start.go:702] Will try again in 5 seconds ...

	I0520 08:18:38.904124    3207 start.go:364] acquiring machines lock for offline-docker-820000: {Name:mk270c257f49033ffda3b70fea9b877c78314aa8 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0520 08:18:38.904597    3207 start.go:368] acquired machines lock for "offline-docker-820000" in 376.417µs

	I0520 08:18:38.904731    3207 start.go:93] Provisioning new machine with config: &{Name:offline-docker-820000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/16506/minikube-v1.30.1-1684174510-16506-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684523789-16533@sha256:ed200ff6d686f303885e8aaf964442d08018856d63a8e23f7acdc068766ea82b Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne

tesConfig:{KubernetesVersion:v1.27.2 ClusterName:offline-docker-820000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP

: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:} &{Name: IP: Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0520 08:18:38.905076    3207 start.go:125] createHost starting for "" (driver="qemu2")

	I0520 08:18:38.914796    3207 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0520 08:18:38.961906    3207 start.go:159] libmachine.API.Create for "offline-docker-820000" (driver="qemu2")

	I0520 08:18:38.961952    3207 client.go:168] LocalClient.Create starting

	I0520 08:18:38.962143    3207 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/ca.pem

	I0520 08:18:38.962209    3207 main.go:141] libmachine: Decoding PEM data...

	I0520 08:18:38.962230    3207 main.go:141] libmachine: Parsing certificate...

	I0520 08:18:38.962316    3207 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/cert.pem

	I0520 08:18:38.962351    3207 main.go:141] libmachine: Decoding PEM data...

	I0520 08:18:38.962366    3207 main.go:141] libmachine: Parsing certificate...

	I0520 08:18:38.962954    3207 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/16543-1012/.minikube/cache/iso/arm64/minikube-v1.30.1-1684174510-16506-arm64.iso...

	I0520 08:18:39.096409    3207 main.go:141] libmachine: Creating SSH key...

	I0520 08:18:39.260547    3207 main.go:141] libmachine: Creating Disk image...

	I0520 08:18:39.260560    3207 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0520 08:18:39.260740    3207 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/offline-docker-820000/disk.qcow2.raw /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/offline-docker-820000/disk.qcow2

	I0520 08:18:39.269594    3207 main.go:141] libmachine: STDOUT: 

	I0520 08:18:39.269612    3207 main.go:141] libmachine: STDERR: 

	I0520 08:18:39.269656    3207 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/offline-docker-820000/disk.qcow2 +20000M

	I0520 08:18:39.276788    3207 main.go:141] libmachine: STDOUT: Image resized.

	I0520 08:18:39.276799    3207 main.go:141] libmachine: STDERR: 

	I0520 08:18:39.276814    3207 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/offline-docker-820000/disk.qcow2.raw and /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/offline-docker-820000/disk.qcow2

	I0520 08:18:39.276821    3207 main.go:141] libmachine: Starting QEMU VM...

	I0520 08:18:39.276865    3207 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/Cellar/qemu/7.2.0/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/offline-docker-820000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/offline-docker-820000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/offline-docker-820000/qemu.pid -device virtio-net-pci,netdev=net0,mac=2a:a2:7d:32:8c:2a -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/offline-docker-820000/disk.qcow2

	I0520 08:18:39.278359    3207 main.go:141] libmachine: STDOUT: 

	I0520 08:18:39.278370    3207 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0520 08:18:39.278381    3207 client.go:171] LocalClient.Create took 316.424084ms

	I0520 08:18:41.280460    3207 start.go:128] duration metric: createHost completed in 2.37537025s

	I0520 08:18:41.280484    3207 start.go:83] releasing machines lock for "offline-docker-820000", held for 2.375870958s

	W0520 08:18:41.280700    3207 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p offline-docker-820000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p offline-docker-820000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0520 08:18:41.289849    3207 out.go:177] 

	W0520 08:18:41.293775    3207 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0520 08:18:41.293782    3207 out.go:239] * 

	* 

	W0520 08:18:41.294566    3207 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0520 08:18:41.303747    3207 out.go:177] 

** /stderr **

aab_offline_test.go:58: out/minikube-darwin-arm64 start -p offline-docker-820000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=qemu2  failed: exit status 80

panic.go:522: *** TestOffline FAILED at 2023-05-20 08:18:41.31448 -0700 PDT m=+898.303305293

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p offline-docker-820000 -n offline-docker-820000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p offline-docker-820000 -n offline-docker-820000: exit status 7 (33.932834ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "offline-docker-820000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "offline-docker-820000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p offline-docker-820000

--- FAIL: TestOffline (10.01s)

=== RUN   TestAddons/Setup

addons_test.go:88: (dbg) Run:  out/minikube-darwin-arm64 start -p addons-862000 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --driver=qemu2  --addons=ingress --addons=ingress-dns

addons_test.go:88: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p addons-862000 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --driver=qemu2  --addons=ingress --addons=ingress-dns: exit status 80 (44.804565417s)

-- stdout --

	* [addons-862000] minikube v1.30.1 on Darwin 13.3.1 (arm64)

	  - MINIKUBE_LOCATION=16543

	  - KUBECONFIG=/Users/jenkins/minikube-integration/16543-1012/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/16543-1012/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting control plane node addons-862000 in cluster addons-862000

	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	* Preparing Kubernetes v1.27.2 on Docker 20.10.23 ...

	  - Generating certificates and keys ...

	  - Booting up control plane ...

	  - Configuring RBAC rules ...

	* Configuring bridge CNI (Container Networking Interface) ...

	  - Using image docker.io/registry:2.8.1

	  - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.2

	  - Using image gcr.io/google_containers/kube-registry-proxy:0.4

	* Verifying ingress addon...

	* Verifying csi-hostpath-driver addon...

-- /stdout --

** stderr ** 

	I0520 08:04:36.692014    1530 out.go:296] Setting OutFile to fd 1 ...

	I0520 08:04:36.692153    1530 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0520 08:04:36.692156    1530 out.go:309] Setting ErrFile to fd 2...

	I0520 08:04:36.692159    1530 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0520 08:04:36.692226    1530 root.go:336] Updating PATH: /Users/jenkins/minikube-integration/16543-1012/.minikube/bin

	I0520 08:04:36.693259    1530 out.go:303] Setting JSON to false

	I0520 08:04:36.708313    1530 start.go:125] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":247,"bootTime":1684594829,"procs":398,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"13.3.1","kernelVersion":"22.4.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}

	W0520 08:04:36.708381    1530 start.go:133] gopshost.Virtualization returned error: not implemented yet

	I0520 08:04:36.713250    1530 out.go:177] * [addons-862000] minikube v1.30.1 on Darwin 13.3.1 (arm64)

	I0520 08:04:36.724282    1530 out.go:177]   - MINIKUBE_LOCATION=16543

	I0520 08:04:36.720270    1530 notify.go:220] Checking for updates...

	I0520 08:04:36.731263    1530 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/16543-1012/kubeconfig

	I0520 08:04:36.735287    1530 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0520 08:04:36.736390    1530 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0520 08:04:36.744262    1530 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/16543-1012/.minikube

	I0520 08:04:36.751206    1530 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0520 08:04:36.755382    1530 driver.go:375] Setting default libvirt URI to qemu:///system

	I0520 08:04:36.759171    1530 out.go:177] * Using the qemu2 driver based on user configuration

	I0520 08:04:36.766208    1530 start.go:295] selected driver: qemu2

	I0520 08:04:36.766214    1530 start.go:870] validating driver "qemu2" against <nil>

	I0520 08:04:36.766220    1530 start.go:881] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0520 08:04:36.768244    1530 start_flags.go:305] no existing cluster config was found, will generate one from the flags 

	I0520 08:04:36.771248    1530 out.go:177] * Automatically selected the socket_vmnet network

	I0520 08:04:36.774360    1530 start_flags.go:915] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0520 08:04:36.774379    1530 cni.go:84] Creating CNI manager for ""

	I0520 08:04:36.774385    1530 cni.go:157] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0520 08:04:36.774389    1530 start_flags.go:314] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0520 08:04:36.774396    1530 start_flags.go:319] config:

	{Name:addons-862000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684523789-16533@sha256:ed200ff6d686f303885e8aaf964442d08018856d63a8e23f7acdc068766ea82b Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.2 ClusterName:addons-862000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CR

ISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}

	I0520 08:04:36.774470    1530 iso.go:125] acquiring lock: {Name:mkf05a14b47e9b67445252fbb4917f3bcb37f054 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0520 08:04:36.783213    1530 out.go:177] * Starting control plane node addons-862000 in cluster addons-862000

	I0520 08:04:36.787242    1530 preload.go:132] Checking if preload exists for k8s version v1.27.2 and runtime docker

	I0520 08:04:36.787276    1530 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.2-docker-overlay2-arm64.tar.lz4

	I0520 08:04:36.787286    1530 cache.go:57] Caching tarball of preloaded images

	I0520 08:04:36.787338    1530 preload.go:174] Found /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0520 08:04:36.787344    1530 cache.go:60] Finished verifying existence of preloaded tar for  v1.27.2 on docker

	I0520 08:04:36.787564    1530 profile.go:148] Saving config to /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/addons-862000/config.json ...

	I0520 08:04:36.787580    1530 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/addons-862000/config.json: {Name:mkcbd7ff58d615780328dec3987ea9d1c56c3333 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0520 08:04:36.787807    1530 cache.go:195] Successfully downloaded all kic artifacts

	I0520 08:04:36.787819    1530 start.go:364] acquiring machines lock for addons-862000: {Name:mk270c257f49033ffda3b70fea9b877c78314aa8 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0520 08:04:36.787901    1530 start.go:368] acquired machines lock for "addons-862000" in 76.334µs

	I0520 08:04:36.787918    1530 start.go:93] Provisioning new machine with config: &{Name:addons-862000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/16506/minikube-v1.30.1-1684174510-16506-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684523789-16533@sha256:ed200ff6d686f303885e8aaf964442d08018856d63a8e23f7acdc068766ea82b Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi

g:{KubernetesVersion:v1.27.2 ClusterName:addons-862000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262

144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:} &{Name: IP: Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0520 08:04:36.787949    1530 start.go:125] createHost starting for "" (driver="qemu2")

	I0520 08:04:36.796266    1530 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	I0520 08:04:37.162435    1530 start.go:159] libmachine.API.Create for "addons-862000" (driver="qemu2")

	I0520 08:04:37.162463    1530 client.go:168] LocalClient.Create starting

	I0520 08:04:37.162608    1530 main.go:141] libmachine: Creating CA: /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/ca.pem

	I0520 08:04:37.282973    1530 main.go:141] libmachine: Creating client certificate: /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/cert.pem

	I0520 08:04:37.658425    1530 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/16543-1012/.minikube/cache/iso/arm64/minikube-v1.30.1-1684174510-16506-arm64.iso...

	I0520 08:04:37.988944    1530 main.go:141] libmachine: Creating SSH key...

	I0520 08:04:38.050262    1530 main.go:141] libmachine: Creating Disk image...

	I0520 08:04:38.050271    1530 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0520 08:04:38.050502    1530 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/addons-862000/disk.qcow2.raw /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/addons-862000/disk.qcow2

	I0520 08:04:38.132087    1530 main.go:141] libmachine: STDOUT: 

	I0520 08:04:38.132118    1530 main.go:141] libmachine: STDERR: 

	I0520 08:04:38.132178    1530 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/addons-862000/disk.qcow2 +20000M

	I0520 08:04:38.139601    1530 main.go:141] libmachine: STDOUT: Image resized.

	I0520 08:04:38.139614    1530 main.go:141] libmachine: STDERR: 

	I0520 08:04:38.139632    1530 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/addons-862000/disk.qcow2.raw and /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/addons-862000/disk.qcow2

	I0520 08:04:38.139637    1530 main.go:141] libmachine: Starting QEMU VM...

	I0520 08:04:38.139685    1530 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt -cpu host -drive file=/opt/homebrew/Cellar/qemu/7.2.0/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 4000 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/addons-862000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/addons-862000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/addons-862000/qemu.pid -device virtio-net-pci,netdev=net0,mac=36:b1:60:c3:d2:35 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/addons-862000/disk.qcow2

	I0520 08:04:38.278993    1530 main.go:141] libmachine: STDOUT: 

	I0520 08:04:38.279014    1530 main.go:141] libmachine: STDERR: 

	I0520 08:04:38.279019    1530 main.go:141] libmachine: Attempt 0

	I0520 08:04:38.279034    1530 main.go:141] libmachine: Searching for 36:b1:60:c3:d2:35 in /var/db/dhcpd_leases ...

	I0520 08:04:40.280234    1530 main.go:141] libmachine: Attempt 1

	I0520 08:04:40.280378    1530 main.go:141] libmachine: Searching for 36:b1:60:c3:d2:35 in /var/db/dhcpd_leases ...

	I0520 08:04:42.281519    1530 main.go:141] libmachine: Attempt 2

	I0520 08:04:42.281545    1530 main.go:141] libmachine: Searching for 36:b1:60:c3:d2:35 in /var/db/dhcpd_leases ...

	I0520 08:04:44.282604    1530 main.go:141] libmachine: Attempt 3

	I0520 08:04:44.282616    1530 main.go:141] libmachine: Searching for 36:b1:60:c3:d2:35 in /var/db/dhcpd_leases ...

	I0520 08:04:46.283681    1530 main.go:141] libmachine: Attempt 4

	I0520 08:04:46.283711    1530 main.go:141] libmachine: Searching for 36:b1:60:c3:d2:35 in /var/db/dhcpd_leases ...

	I0520 08:04:48.284842    1530 main.go:141] libmachine: Attempt 5

	I0520 08:04:48.284889    1530 main.go:141] libmachine: Searching for 36:b1:60:c3:d2:35 in /var/db/dhcpd_leases ...

	I0520 08:04:50.286131    1530 main.go:141] libmachine: Attempt 6

	I0520 08:04:50.286204    1530 main.go:141] libmachine: Searching for 36:b1:60:c3:d2:35 in /var/db/dhcpd_leases ...

	I0520 08:04:50.286680    1530 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I0520 08:04:50.286780    1530 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:36:b1:60:c3:d2:35 ID:1,36:b1:60:c3:d2:35 Lease:0x646a3311}

	I0520 08:04:50.286805    1530 main.go:141] libmachine: Found match: 36:b1:60:c3:d2:35

	I0520 08:04:50.286886    1530 main.go:141] libmachine: IP: 192.168.105.2

	I0520 08:04:50.287056    1530 main.go:141] libmachine: Waiting for VM to start (ssh -p 22 docker@192.168.105.2)...

	I0520 08:04:52.307461    1530 machine.go:88] provisioning docker machine ...

	I0520 08:04:52.307562    1530 buildroot.go:166] provisioning hostname "addons-862000"

	I0520 08:04:52.308415    1530 main.go:141] libmachine: Using SSH client type: native

	I0520 08:04:52.309462    1530 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1047f46d0] 0x1047f7130 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0520 08:04:52.309480    1530 main.go:141] libmachine: About to run SSH command:

	sudo hostname addons-862000 && echo "addons-862000" | sudo tee /etc/hostname

	I0520 08:04:52.405463    1530 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-862000

	I0520 08:04:52.405571    1530 main.go:141] libmachine: Using SSH client type: native

	I0520 08:04:52.406079    1530 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1047f46d0] 0x1047f7130 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0520 08:04:52.406093    1530 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\saddons-862000' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-862000/g' /etc/hosts;

				else 

					echo '127.0.1.1 addons-862000' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0520 08:04:52.484459    1530 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0520 08:04:52.484479    1530 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/16543-1012/.minikube CaCertPath:/Users/jenkins/minikube-integration/16543-1012/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/16543-1012/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/16543-1012/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/16543-1012/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/16543-1012/.minikube}

	I0520 08:04:52.484504    1530 buildroot.go:174] setting up certificates

	I0520 08:04:52.484534    1530 provision.go:83] configureAuth start

	I0520 08:04:52.484540    1530 provision.go:138] copyHostCerts

	I0520 08:04:52.484707    1530 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/16543-1012/.minikube/ca.pem (1082 bytes)

	I0520 08:04:52.485820    1530 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/16543-1012/.minikube/cert.pem (1123 bytes)

	I0520 08:04:52.486159    1530 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/16543-1012/.minikube/key.pem (1679 bytes)

	I0520 08:04:52.486430    1530 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/16543-1012/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/16543-1012/.minikube/certs/ca-key.pem org=jenkins.addons-862000 san=[192.168.105.2 192.168.105.2 localhost 127.0.0.1 minikube addons-862000]

	I0520 08:04:52.578073    1530 provision.go:172] copyRemoteCerts

	I0520 08:04:52.578149    1530 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0520 08:04:52.578166    1530 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/addons-862000/id_rsa Username:docker}

	I0520 08:04:52.613828    1530 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0520 08:04:52.621127    1530 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/server.pem --> /etc/docker/server.pem (1216 bytes)

	I0520 08:04:52.628198    1530 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0520 08:04:52.635304    1530 provision.go:86] duration metric: configureAuth took 150.764167ms

	I0520 08:04:52.635312    1530 buildroot.go:189] setting minikube options for container-runtime

	I0520 08:04:52.635673    1530 config.go:182] Loaded profile config "addons-862000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.27.2

	I0520 08:04:52.635708    1530 main.go:141] libmachine: Using SSH client type: native

	I0520 08:04:52.635918    1530 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1047f46d0] 0x1047f7130 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0520 08:04:52.635923    1530 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0520 08:04:52.700111    1530 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I0520 08:04:52.700119    1530 buildroot.go:70] root file system type: tmpfs

	I0520 08:04:52.700173    1530 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I0520 08:04:52.700221    1530 main.go:141] libmachine: Using SSH client type: native

	I0520 08:04:52.700462    1530 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1047f46d0] 0x1047f7130 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0520 08:04:52.700503    1530 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %s "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0520 08:04:52.771521    1530 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0520 08:04:52.771582    1530 main.go:141] libmachine: Using SSH client type: native

	I0520 08:04:52.771848    1530 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1047f46d0] 0x1047f7130 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0520 08:04:52.771861    1530 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0520 08:04:53.104177    1530 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory

	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.

	I0520 08:04:53.104191    1530 machine.go:91] provisioned docker machine in 796.700458ms

	I0520 08:04:53.104197    1530 client.go:171] LocalClient.Create took 15.941758s

	I0520 08:04:53.104215    1530 start.go:167] duration metric: libmachine.API.Create for "addons-862000" took 15.941811959s

	I0520 08:04:53.104219    1530 start.go:300] post-start starting for "addons-862000" (driver="qemu2")

	I0520 08:04:53.104222    1530 start.go:328] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0520 08:04:53.104287    1530 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0520 08:04:53.104298    1530 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/addons-862000/id_rsa Username:docker}

	I0520 08:04:53.140639    1530 ssh_runner.go:195] Run: cat /etc/os-release

	I0520 08:04:53.142026    1530 info.go:137] Remote host: Buildroot 2021.02.12

	I0520 08:04:53.142039    1530 filesync.go:126] Scanning /Users/jenkins/minikube-integration/16543-1012/.minikube/addons for local assets ...

	I0520 08:04:53.142116    1530 filesync.go:126] Scanning /Users/jenkins/minikube-integration/16543-1012/.minikube/files for local assets ...

	I0520 08:04:53.142143    1530 start.go:303] post-start completed in 37.921208ms

	I0520 08:04:53.142530    1530 profile.go:148] Saving config to /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/addons-862000/config.json ...

	I0520 08:04:53.142692    1530 start.go:128] duration metric: createHost completed in 16.354766875s

	I0520 08:04:53.142745    1530 main.go:141] libmachine: Using SSH client type: native

	I0520 08:04:53.142985    1530 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1047f46d0] 0x1047f7130 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0520 08:04:53.142997    1530 main.go:141] libmachine: About to run SSH command:

	date +%s.%N

	I0520 08:04:53.207330    1530 main.go:141] libmachine: SSH cmd err, output: <nil>: 1684595093.449783169

	I0520 08:04:53.207337    1530 fix.go:207] guest clock: 1684595093.449783169

	I0520 08:04:53.207340    1530 fix.go:220] Guest: 2023-05-20 08:04:53.449783169 -0700 PDT Remote: 2023-05-20 08:04:53.142696 -0700 PDT m=+16.468728126 (delta=307.087169ms)

	I0520 08:04:53.207350    1530 fix.go:191] guest clock delta is within tolerance: 307.087169ms

	I0520 08:04:53.207353    1530 start.go:83] releasing machines lock for "addons-862000", held for 16.41947525s

	I0520 08:04:53.207621    1530 ssh_runner.go:195] Run: cat /version.json

	I0520 08:04:53.207636    1530 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/addons-862000/id_rsa Username:docker}

	I0520 08:04:53.207639    1530 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0520 08:04:53.207673    1530 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/addons-862000/id_rsa Username:docker}

	I0520 08:04:53.285271    1530 ssh_runner.go:195] Run: systemctl --version

	I0520 08:04:53.287345    1530 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0520 08:04:53.289302    1530 cni.go:208] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0520 08:04:53.289335    1530 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0520 08:04:53.294577    1530 cni.go:261] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0520 08:04:53.294598    1530 preload.go:132] Checking if preload exists for k8s version v1.27.2 and runtime docker

	I0520 08:04:53.294670    1530 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0520 08:04:53.306341    1530 docker.go:633] Got preloaded images: 

	I0520 08:04:53.306350    1530 docker.go:639] registry.k8s.io/kube-apiserver:v1.27.2 wasn't preloaded

	I0520 08:04:53.306404    1530 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I0520 08:04:53.309834    1530 ssh_runner.go:195] Run: which lz4

	I0520 08:04:53.311263    1530 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4

	I0520 08:04:53.312564    1530 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I0520 08:04:53.312578    1530 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.2-docker-overlay2-arm64.tar.lz4 --> /preloaded.tar.lz4 (343635669 bytes)

	I0520 08:04:54.621671    1530 docker.go:597] Took 1.310454 seconds to copy over tarball

	I0520 08:04:54.621728    1530 ssh_runner.go:195] Run: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4

	I0520 08:04:55.748735    1530 ssh_runner.go:235] Completed: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4: (1.126987917s)

	I0520 08:04:55.748757    1530 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I0520 08:04:55.763774    1530 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I0520 08:04:55.767193    1530 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2629 bytes)

	I0520 08:04:55.772816    1530 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0520 08:04:55.838184    1530 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0520 08:04:57.736685    1530 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.898482708s)

	I0520 08:04:57.736712    1530 start.go:481] detecting cgroup driver to use...

	I0520 08:04:57.736819    1530 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0520 08:04:57.742793    1530 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"

	I0520 08:04:57.747058    1530 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I0520 08:04:57.750305    1530 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...

	I0520 08:04:57.750336    1530 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I0520 08:04:57.753452    1530 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0520 08:04:57.756200    1530 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I0520 08:04:57.759225    1530 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0520 08:04:57.762593    1530 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0520 08:04:57.766224    1530 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I0520 08:04:57.769387    1530 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0520 08:04:57.772105    1530 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0520 08:04:57.775126    1530 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0520 08:04:57.833336    1530 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I0520 08:04:57.842674    1530 start.go:481] detecting cgroup driver to use...

	I0520 08:04:57.842737    1530 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0520 08:04:57.849274    1530 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0520 08:04:57.854131    1530 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0520 08:04:57.860020    1530 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0520 08:04:57.864576    1530 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0520 08:04:57.868869    1530 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I0520 08:04:57.906638    1530 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0520 08:04:57.911972    1530 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0520 08:04:57.917186    1530 ssh_runner.go:195] Run: which cri-dockerd

	I0520 08:04:57.918418    1530 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I0520 08:04:57.921032    1530 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)

	I0520 08:04:57.925403    1530 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I0520 08:04:57.989186    1530 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I0520 08:04:58.048854    1530 docker.go:532] configuring docker to use "cgroupfs" as cgroup driver...

	I0520 08:04:58.048867    1530 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (144 bytes)

	I0520 08:04:58.054486    1530 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0520 08:04:58.117123    1530 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0520 08:04:59.273494    1530 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.156353667s)

	I0520 08:04:59.273560    1530 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I0520 08:04:59.333742    1530 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I0520 08:04:59.388895    1530 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I0520 08:04:59.456178    1530 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0520 08:04:59.517680    1530 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I0520 08:04:59.524376    1530 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0520 08:04:59.590163    1530 ssh_runner.go:195] Run: sudo systemctl restart cri-docker

	I0520 08:04:59.614393    1530 start.go:528] Will wait 60s for socket path /var/run/cri-dockerd.sock

	I0520 08:04:59.614485    1530 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0520 08:04:59.617434    1530 start.go:549] Will wait 60s for crictl version

	I0520 08:04:59.617464    1530 ssh_runner.go:195] Run: which crictl

	I0520 08:04:59.618901    1530 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0520 08:04:59.636700    1530 start.go:565] Version:  0.1.0

	RuntimeName:  docker

	RuntimeVersion:  20.10.23

	RuntimeApiVersion:  v1alpha2

	I0520 08:04:59.636779    1530 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0520 08:04:59.645835    1530 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0520 08:04:59.660513    1530 out.go:204] * Preparing Kubernetes v1.27.2 on Docker 20.10.23 ...

	I0520 08:04:59.660690    1530 ssh_runner.go:195] Run: grep 192.168.105.1	host.minikube.internal$ /etc/hosts

	I0520 08:04:59.662257    1530 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.105.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0520 08:04:59.666344    1530 preload.go:132] Checking if preload exists for k8s version v1.27.2 and runtime docker

	I0520 08:04:59.666385    1530 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0520 08:04:59.675123    1530 docker.go:633] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.27.2

	registry.k8s.io/kube-controller-manager:v1.27.2

	registry.k8s.io/kube-scheduler:v1.27.2

	registry.k8s.io/kube-proxy:v1.27.2

	registry.k8s.io/coredns/coredns:v1.10.1

	registry.k8s.io/etcd:3.5.7-0

	registry.k8s.io/pause:3.9

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I0520 08:04:59.675133    1530 docker.go:563] Images already preloaded, skipping extraction

	I0520 08:04:59.675190    1530 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0520 08:04:59.682655    1530 docker.go:633] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.27.2

	registry.k8s.io/kube-controller-manager:v1.27.2

	registry.k8s.io/kube-scheduler:v1.27.2

	registry.k8s.io/kube-proxy:v1.27.2

	registry.k8s.io/coredns/coredns:v1.10.1

	registry.k8s.io/etcd:3.5.7-0

	registry.k8s.io/pause:3.9

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I0520 08:04:59.682664    1530 cache_images.go:84] Images are preloaded, skipping loading

	I0520 08:04:59.682729    1530 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I0520 08:04:59.692609    1530 cni.go:84] Creating CNI manager for ""

	I0520 08:04:59.692618    1530 cni.go:157] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0520 08:04:59.692640    1530 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I0520 08:04:59.692650    1530 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.105.2 APIServerPort:8443 KubernetesVersion:v1.27.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-862000 NodeName:addons-862000 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.105.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.105.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/ku

bernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I0520 08:04:59.692725    1530 kubeadm.go:181] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.105.2

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/cri-dockerd.sock

	  name: "addons-862000"

	  kubeletExtraArgs:

	    node-ip: 192.168.105.2

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.105.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.27.2

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%"

	  nodefs.inodesFree: "0%"

	  imagefs.available: "0%"

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0520 08:04:59.692761    1530 kubeadm.go:971] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.27.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/cri-dockerd.sock --hostname-override=addons-862000 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.105.2

	[Install]

	 config:

	{KubernetesVersion:v1.27.2 ClusterName:addons-862000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I0520 08:04:59.692830    1530 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.27.2

	I0520 08:04:59.695719    1530 binaries.go:44] Found k8s binaries, skipping transfer

	I0520 08:04:59.695757    1530 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0520 08:04:59.698780    1530 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (375 bytes)

	I0520 08:04:59.703975    1530 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0520 08:04:59.708896    1530 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2099 bytes)

	I0520 08:04:59.714197    1530 ssh_runner.go:195] Run: grep 192.168.105.2	control-plane.minikube.internal$ /etc/hosts

	I0520 08:04:59.715597    1530 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.105.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0520 08:04:59.719309    1530 certs.go:56] Setting up /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/addons-862000 for IP: 192.168.105.2

	I0520 08:04:59.719319    1530 certs.go:190] acquiring lock for shared ca certs: {Name:mk455286e32296d088c043e2094c607a8fa5e5c4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0520 08:04:59.719475    1530 certs.go:204] generating minikubeCA CA: /Users/jenkins/minikube-integration/16543-1012/.minikube/ca.key

	I0520 08:04:59.919677    1530 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/16543-1012/.minikube/ca.crt ...

	I0520 08:04:59.919686    1530 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16543-1012/.minikube/ca.crt: {Name:mkde11e542647abf155a6ecaf11a93b8ae50f134 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0520 08:04:59.920011    1530 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/16543-1012/.minikube/ca.key ...

	I0520 08:04:59.920015    1530 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16543-1012/.minikube/ca.key: {Name:mke7ad8e5188ed19b1593564e03e68cdcec673ab Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0520 08:04:59.920136    1530 certs.go:204] generating proxyClientCA CA: /Users/jenkins/minikube-integration/16543-1012/.minikube/proxy-client-ca.key

	I0520 08:05:00.077432    1530 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/16543-1012/.minikube/proxy-client-ca.crt ...

	I0520 08:05:00.077444    1530 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16543-1012/.minikube/proxy-client-ca.crt: {Name:mk0ec5866cff87615bf4188c616a6f3db04cff41 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0520 08:05:00.077758    1530 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/16543-1012/.minikube/proxy-client-ca.key ...

	I0520 08:05:00.077761    1530 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16543-1012/.minikube/proxy-client-ca.key: {Name:mkee8707f153ff3a4b1b2ef28edde187d552f48c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0520 08:05:00.077916    1530 certs.go:319] generating minikube-user signed cert: /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/addons-862000/client.key

	I0520 08:05:00.077942    1530 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/addons-862000/client.crt with IP's: []

	I0520 08:05:00.237745    1530 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/addons-862000/client.crt ...

	I0520 08:05:00.237758    1530 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/addons-862000/client.crt: {Name:mk5e3ac0f803b899c82bad996a1ac17533715dd1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0520 08:05:00.237995    1530 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/addons-862000/client.key ...

	I0520 08:05:00.237998    1530 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/addons-862000/client.key: {Name:mk038bef07dae25d8a0196e7bbe1c46212e3f1c3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0520 08:05:00.238118    1530 certs.go:319] generating minikube signed cert: /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/addons-862000/apiserver.key.96055969

	I0520 08:05:00.238133    1530 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/addons-862000/apiserver.crt.96055969 with IP's: [192.168.105.2 10.96.0.1 127.0.0.1 10.0.0.1]

	I0520 08:05:00.271454    1530 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/addons-862000/apiserver.crt.96055969 ...

	I0520 08:05:00.271458    1530 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/addons-862000/apiserver.crt.96055969: {Name:mk58cbd6c1dc9f2995a2dc2a3284ba9c44bd31d5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0520 08:05:00.271584    1530 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/addons-862000/apiserver.key.96055969 ...

	I0520 08:05:00.271587    1530 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/addons-862000/apiserver.key.96055969: {Name:mkcc7c4eeeab6e6cc2f8cf3b4feacdb0d9c5a87e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0520 08:05:00.271687    1530 certs.go:337] copying /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/addons-862000/apiserver.crt.96055969 -> /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/addons-862000/apiserver.crt

	I0520 08:05:00.271778    1530 certs.go:341] copying /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/addons-862000/apiserver.key.96055969 -> /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/addons-862000/apiserver.key

	I0520 08:05:00.271854    1530 certs.go:319] generating aggregator signed cert: /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/addons-862000/proxy-client.key

	I0520 08:05:00.271864    1530 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/addons-862000/proxy-client.crt with IP's: []

	I0520 08:05:00.404503    1530 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/addons-862000/proxy-client.crt ...

	I0520 08:05:00.404506    1530 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/addons-862000/proxy-client.crt: {Name:mk99417ac74e72598f653edd528374db6ab44984 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0520 08:05:00.404634    1530 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/addons-862000/proxy-client.key ...

	I0520 08:05:00.404637    1530 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/addons-862000/proxy-client.key: {Name:mkb551147fa83b52e694954f6b7eb27ac94a34b1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0520 08:05:00.404883    1530 certs.go:437] found cert: /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/Users/jenkins/minikube-integration/16543-1012/.minikube/certs/ca-key.pem (1675 bytes)

	I0520 08:05:00.405359    1530 certs.go:437] found cert: /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/Users/jenkins/minikube-integration/16543-1012/.minikube/certs/ca.pem (1082 bytes)

	I0520 08:05:00.405395    1530 certs.go:437] found cert: /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/Users/jenkins/minikube-integration/16543-1012/.minikube/certs/cert.pem (1123 bytes)

	I0520 08:05:00.405635    1530 certs.go:437] found cert: /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/Users/jenkins/minikube-integration/16543-1012/.minikube/certs/key.pem (1679 bytes)

	I0520 08:05:00.406074    1530 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/addons-862000/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I0520 08:05:00.414201    1530 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/addons-862000/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0520 08:05:00.421463    1530 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/addons-862000/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0520 08:05:00.428273    1530 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/addons-862000/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I0520 08:05:00.435175    1530 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0520 08:05:00.442709    1530 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I0520 08:05:00.450026    1530 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0520 08:05:00.456740    1530 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I0520 08:05:00.463363    1530 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0520 08:05:00.470493    1530 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0520 08:05:00.476389    1530 ssh_runner.go:195] Run: openssl version

	I0520 08:05:00.478221    1530 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0520 08:05:00.481159    1530 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0520 08:05:00.482524    1530 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 May 20 15:04 /usr/share/ca-certificates/minikubeCA.pem

	I0520 08:05:00.482544    1530 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0520 08:05:00.484313    1530 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0520 08:05:00.487417    1530 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd

	I0520 08:05:00.488693    1530 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory

	I0520 08:05:00.488732    1530 kubeadm.go:404] StartCluster: {Name:addons-862000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/16506/minikube-v1.30.1-1684174510-16506-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684523789-16533@sha256:ed200ff6d686f303885e8aaf964442d08018856d63a8e23f7acdc068766ea82b Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v

1.27.2 ClusterName:addons-862000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.105.2 Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 Mount

Options:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}

	I0520 08:05:00.488795    1530 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0520 08:05:00.496274    1530 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0520 08:05:00.499373    1530 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0520 08:05:00.502414    1530 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0520 08:05:00.505128    1530 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0520 08:05:00.505143    1530 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.27.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"

	I0520 08:05:00.527165    1530 kubeadm.go:322] [init] Using Kubernetes version: v1.27.2

	I0520 08:05:00.527195    1530 kubeadm.go:322] [preflight] Running pre-flight checks

	I0520 08:05:00.590268    1530 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster

	I0520 08:05:00.590319    1530 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I0520 08:05:00.590383    1530 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	I0520 08:05:00.650426    1530 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I0520 08:05:00.654601    1530 out.go:204]   - Generating certificates and keys ...

	I0520 08:05:00.654671    1530 kubeadm.go:322] [certs] Using existing ca certificate authority

	I0520 08:05:00.654709    1530 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk

	I0520 08:05:00.929707    1530 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key

	I0520 08:05:01.106245    1530 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key

	I0520 08:05:01.435687    1530 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key

	I0520 08:05:01.536194    1530 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key

	I0520 08:05:01.669100    1530 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key

	I0520 08:05:01.669183    1530 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [addons-862000 localhost] and IPs [192.168.105.2 127.0.0.1 ::1]

	I0520 08:05:01.725093    1530 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key

	I0520 08:05:01.725172    1530 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [addons-862000 localhost] and IPs [192.168.105.2 127.0.0.1 ::1]

	I0520 08:05:01.781342    1530 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key

	I0520 08:05:01.874443    1530 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key

	I0520 08:05:02.169828    1530 kubeadm.go:322] [certs] Generating "sa" key and public key

	I0520 08:05:02.169865    1530 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I0520 08:05:02.455021    1530 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file

	I0520 08:05:02.515614    1530 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I0520 08:05:02.627148    1530 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I0520 08:05:02.692534    1530 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I0520 08:05:02.699203    1530 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I0520 08:05:02.699310    1530 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I0520 08:05:02.699394    1530 kubeadm.go:322] [kubelet-start] Starting the kubelet

	I0520 08:05:02.790449    1530 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I0520 08:05:02.797604    1530 out.go:204]   - Booting up control plane ...

	I0520 08:05:02.797676    1530 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I0520 08:05:02.797716    1530 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I0520 08:05:02.797752    1530 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I0520 08:05:02.797795    1530 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I0520 08:05:02.797870    1530 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	I0520 08:05:06.800071    1530 kubeadm.go:322] [apiclient] All control plane components are healthy after 4.006033 seconds

	I0520 08:05:06.800310    1530 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I0520 08:05:06.815060    1530 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I0520 08:05:07.330762    1530 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs

	I0520 08:05:07.330859    1530 kubeadm.go:322] [mark-control-plane] Marking the node addons-862000 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I0520 08:05:07.838342    1530 kubeadm.go:322] [bootstrap-token] Using token: gv038d.wrz44hy6c2yn94zw

	I0520 08:05:07.842016    1530 out.go:204]   - Configuring RBAC rules ...

	I0520 08:05:07.842082    1530 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I0520 08:05:07.843113    1530 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I0520 08:05:07.847521    1530 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I0520 08:05:07.849703    1530 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I0520 08:05:07.851195    1530 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I0520 08:05:07.852602    1530 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I0520 08:05:07.857403    1530 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I0520 08:05:08.032972    1530 kubeadm.go:322] [addons] Applied essential addon: CoreDNS

	I0520 08:05:08.245768    1530 kubeadm.go:322] [addons] Applied essential addon: kube-proxy

	I0520 08:05:08.246121    1530 kubeadm.go:322] 

	I0520 08:05:08.246155    1530 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!

	I0520 08:05:08.246160    1530 kubeadm.go:322] 

	I0520 08:05:08.246204    1530 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:

	I0520 08:05:08.246210    1530 kubeadm.go:322] 

	I0520 08:05:08.246226    1530 kubeadm.go:322]   mkdir -p $HOME/.kube

	I0520 08:05:08.246258    1530 kubeadm.go:322]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I0520 08:05:08.246300    1530 kubeadm.go:322]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I0520 08:05:08.246305    1530 kubeadm.go:322] 

	I0520 08:05:08.246334    1530 kubeadm.go:322] Alternatively, if you are the root user, you can run:

	I0520 08:05:08.246341    1530 kubeadm.go:322] 

	I0520 08:05:08.246365    1530 kubeadm.go:322]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I0520 08:05:08.246367    1530 kubeadm.go:322] 

	I0520 08:05:08.246392    1530 kubeadm.go:322] You should now deploy a pod network to the cluster.

	I0520 08:05:08.246426    1530 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I0520 08:05:08.246468    1530 kubeadm.go:322]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I0520 08:05:08.246474    1530 kubeadm.go:322] 

	I0520 08:05:08.246519    1530 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities

	I0520 08:05:08.246563    1530 kubeadm.go:322] and service account keys on each node and then running the following as root:

	I0520 08:05:08.246568    1530 kubeadm.go:322] 

	I0520 08:05:08.246605    1530 kubeadm.go:322]   kubeadm join control-plane.minikube.internal:8443 --token gv038d.wrz44hy6c2yn94zw \

	I0520 08:05:08.246660    1530 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:c637a44edb20ebaef1a3cd8bd36bb27010137a6bac525a779e19218d8d4ae1e6 \

	I0520 08:05:08.246671    1530 kubeadm.go:322] 	--control-plane 

	I0520 08:05:08.246675    1530 kubeadm.go:322] 

	I0520 08:05:08.246711    1530 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:

	I0520 08:05:08.246715    1530 kubeadm.go:322] 

	I0520 08:05:08.246752    1530 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token gv038d.wrz44hy6c2yn94zw \

	I0520 08:05:08.246810    1530 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:c637a44edb20ebaef1a3cd8bd36bb27010137a6bac525a779e19218d8d4ae1e6 

	I0520 08:05:08.246933    1530 kubeadm.go:322] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I0520 08:05:08.247019    1530 kubeadm.go:322] W0520 15:05:00.832709    1292 images.go:80] could not find officially supported version of etcd for Kubernetes v1.27.2, falling back to the nearest etcd version (3.5.7-0)

	I0520 08:05:08.247109    1530 kubeadm.go:322] W0520 15:05:03.034607    1292 images.go:80] could not find officially supported version of etcd for Kubernetes v1.27.2, falling back to the nearest etcd version (3.5.7-0)

	I0520 08:05:08.247115    1530 cni.go:84] Creating CNI manager for ""

	I0520 08:05:08.247123    1530 cni.go:157] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0520 08:05:08.254631    1530 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...

	I0520 08:05:08.258471    1530 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d

	I0520 08:05:08.261641    1530 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)

	I0520 08:05:08.266443    1530 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0520 08:05:08.266484    1530 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:05:08.266525    1530 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl label nodes minikube.k8s.io/version=v1.30.1 minikube.k8s.io/commit=24686ce6bbd657e092eb3c3fd6be64c1b7241033 minikube.k8s.io/name=addons-862000 minikube.k8s.io/updated_at=2023_05_20T08_05_08_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:05:08.329671    1530 ops.go:34] apiserver oom_adj: -16

	I0520 08:05:08.329674    1530 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:05:08.864441    1530 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:05:09.364467    1530 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:05:09.864544    1530 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:05:10.364553    1530 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:05:10.864715    1530 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:05:11.364682    1530 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:05:11.864792    1530 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:05:12.364705    1530 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:05:12.864530    1530 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:05:13.364759    1530 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:05:13.863782    1530 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:05:14.364517    1530 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:05:14.864530    1530 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:05:15.364493    1530 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:05:15.864563    1530 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:05:16.364498    1530 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:05:16.864559    1530 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:05:17.364513    1530 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:05:17.863680    1530 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:05:18.364500    1530 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:05:18.864512    1530 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:05:19.364514    1530 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:05:19.864509    1530 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:05:20.364527    1530 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:05:20.864536    1530 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:05:21.364441    1530 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:05:21.397366    1530 kubeadm.go:1076] duration metric: took 13.130935417s to wait for elevateKubeSystemPrivileges.

	I0520 08:05:21.397380    1530 kubeadm.go:406] StartCluster complete in 20.908685542s

	I0520 08:05:21.397408    1530 settings.go:142] acquiring lock: {Name:mk59154b06c6365bdac4601706e783ce490a045a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0520 08:05:21.397590    1530 settings.go:150] Updating kubeconfig:  /Users/jenkins/minikube-integration/16543-1012/kubeconfig

	I0520 08:05:21.397759    1530 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16543-1012/kubeconfig: {Name:mkf6fa7fb711448995f7c2c1a6e60e631893d6a3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0520 08:05:21.397974    1530 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.27.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0520 08:05:21.398027    1530 addons.go:496] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:true]

	I0520 08:05:21.398071    1530 addons.go:66] Setting volumesnapshots=true in profile "addons-862000"

	I0520 08:05:21.398075    1530 addons.go:66] Setting ingress=true in profile "addons-862000"

	I0520 08:05:21.398078    1530 addons.go:228] Setting addon volumesnapshots=true in "addons-862000"

	I0520 08:05:21.398084    1530 addons.go:228] Setting addon ingress=true in "addons-862000"

	I0520 08:05:21.398084    1530 addons.go:66] Setting csi-hostpath-driver=true in profile "addons-862000"

	I0520 08:05:21.398110    1530 addons.go:228] Setting addon csi-hostpath-driver=true in "addons-862000"

	I0520 08:05:21.398111    1530 addons.go:66] Setting metrics-server=true in profile "addons-862000"

	I0520 08:05:21.398119    1530 host.go:66] Checking if "addons-862000" exists ...

	I0520 08:05:21.398119    1530 host.go:66] Checking if "addons-862000" exists ...

	I0520 08:05:21.398126    1530 addons.go:228] Setting addon metrics-server=true in "addons-862000"

	I0520 08:05:21.398132    1530 addons.go:66] Setting storage-provisioner=true in profile "addons-862000"

	I0520 08:05:21.398136    1530 addons.go:228] Setting addon storage-provisioner=true in "addons-862000"

	I0520 08:05:21.398145    1530 host.go:66] Checking if "addons-862000" exists ...

	I0520 08:05:21.398152    1530 addons.go:66] Setting ingress-dns=true in profile "addons-862000"

	I0520 08:05:21.398156    1530 addons.go:228] Setting addon ingress-dns=true in "addons-862000"

	I0520 08:05:21.398142    1530 addons.go:66] Setting cloud-spanner=true in profile "addons-862000"

	I0520 08:05:21.398175    1530 host.go:66] Checking if "addons-862000" exists ...

	I0520 08:05:21.398178    1530 addons.go:66] Setting inspektor-gadget=true in profile "addons-862000"

	I0520 08:05:21.398183    1530 addons.go:228] Setting addon inspektor-gadget=true in "addons-862000"

	I0520 08:05:21.398193    1530 host.go:66] Checking if "addons-862000" exists ...

	I0520 08:05:21.398169    1530 addons.go:66] Setting registry=true in profile "addons-862000"

	I0520 08:05:21.398235    1530 addons.go:228] Setting addon registry=true in "addons-862000"

	I0520 08:05:21.398148    1530 host.go:66] Checking if "addons-862000" exists ...

	I0520 08:05:21.398214    1530 addons.go:228] Setting addon cloud-spanner=true in "addons-862000"

	I0520 08:05:21.398282    1530 host.go:66] Checking if "addons-862000" exists ...

	I0520 08:05:21.398127    1530 host.go:66] Checking if "addons-862000" exists ...

	I0520 08:05:21.398283    1530 host.go:66] Checking if "addons-862000" exists ...

	I0520 08:05:21.398220    1530 addons.go:66] Setting gcp-auth=true in profile "addons-862000"

	I0520 08:05:21.398217    1530 addons.go:66] Setting default-storageclass=true in profile "addons-862000"

	I0520 08:05:21.398456    1530 mustload.go:65] Loading cluster: addons-862000

	I0520 08:05:21.398460    1530 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-862000"

	I0520 08:05:21.398803    1530 config.go:182] Loaded profile config "addons-862000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.27.2

	I0520 08:05:21.398816    1530 config.go:182] Loaded profile config "addons-862000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.27.2

	I0520 08:05:21.402994    1530 out.go:177] 

	W0520 08:05:21.399160    1530 host.go:54] host status for "addons-862000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/addons-862000/monitor: connect: connection refused

	W0520 08:05:21.399191    1530 host.go:54] host status for "addons-862000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/addons-862000/monitor: connect: connection refused

	W0520 08:05:21.399223    1530 host.go:54] host status for "addons-862000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/addons-862000/monitor: connect: connection refused

	W0520 08:05:21.399226    1530 host.go:54] host status for "addons-862000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/addons-862000/monitor: connect: connection refused

	W0520 08:05:21.399259    1530 host.go:54] host status for "addons-862000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/addons-862000/monitor: connect: connection refused

	W0520 08:05:21.399346    1530 host.go:54] host status for "addons-862000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/addons-862000/monitor: connect: connection refused

	W0520 08:05:21.399443    1530 host.go:54] host status for "addons-862000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/addons-862000/monitor: connect: connection refused

	W0520 08:05:21.399583    1530 host.go:54] host status for "addons-862000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/addons-862000/monitor: connect: connection refused

	W0520 08:05:21.406095    1530 addons.go:274] "addons-862000" is not running, setting metrics-server=true and skipping enablement (err=<nil>)

	W0520 08:05:21.406109    1530 addons.go:274] "addons-862000" is not running, setting ingress=true and skipping enablement (err=<nil>)

	W0520 08:05:21.406120    1530 addons.go:274] "addons-862000" is not running, setting volumesnapshots=true and skipping enablement (err=<nil>)

	W0520 08:05:21.406129    1530 addons.go:274] "addons-862000" is not running, setting cloud-spanner=true and skipping enablement (err=<nil>)

	W0520 08:05:21.406130    1530 addons_storage_classes.go:55] "addons-862000" is not running, writing default-storageclass=true to disk and skipping enablement

	W0520 08:05:21.406134    1530 addons.go:274] "addons-862000" is not running, setting storage-provisioner=true and skipping enablement (err=<nil>)

	W0520 08:05:21.406138    1530 addons.go:274] "addons-862000" is not running, setting csi-hostpath-driver=true and skipping enablement (err=<nil>)

	W0520 08:05:21.406151    1530 addons.go:274] "addons-862000" is not running, setting inspektor-gadget=true and skipping enablement (err=<nil>)

	W0520 08:05:21.406165    1530 out.go:239] X Exiting due to GUEST_STATUS: Unable to get machine status: state: connect: dial unix /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/addons-862000/monitor: connect: connection refused

	I0520 08:05:21.409987    1530 out.go:177]   - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.2

	I0520 08:05:21.413049    1530 out.go:177]   - Using image docker.io/registry:2.8.1

	X Exiting due to GUEST_STATUS: Unable to get machine status: state: connect: dial unix /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/addons-862000/monitor: connect: connection refused

	I0520 08:05:21.413063    1530 addons.go:464] Verifying addon ingress=true in "addons-862000"

	I0520 08:05:21.413057    1530 addons.go:228] Setting addon default-storageclass=true in "addons-862000"

	I0520 08:05:21.413065    1530 addons.go:464] Verifying addon csi-hostpath-driver=true in "addons-862000"

	I0520 08:05:21.413054    1530 addons.go:464] Verifying addon metrics-server=true in "addons-862000"

	W0520 08:05:21.413073    1530 out.go:239] * 

	* 

	I0520 08:05:21.430988    1530 host.go:66] Checking if "addons-862000" exists ...

	I0520 08:05:21.431031    1530 out.go:177]   - Using image gcr.io/google_containers/kube-registry-proxy:0.4

	I0520 08:05:21.435034    1530 addons.go:420] installing /etc/kubernetes/addons/ingress-dns-pod.yaml

	W0520 08:05:21.435482    1530 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0520 08:05:21.440997    1530 out.go:177] * Verifying ingress addon...

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0520 08:05:21.441762    1530 addons.go:420] installing /etc/kubernetes/addons/storageclass.yaml

	I0520 08:05:21.445557    1530 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.27.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.105.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.27.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0520 08:05:21.446467    1530 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)

	I0520 08:05:21.446471    1530 out.go:177] * Verifying csi-hostpath-driver addon...

	I0520 08:05:21.448961    1530 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/addons-862000/id_rsa Username:docker}

	I0520 08:05:21.448977    1530 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0520 08:05:21.449022    1530 addons.go:420] installing /etc/kubernetes/addons/registry-rc.yaml

	I0520 08:05:21.455052    1530 out.go:177] 

	I0520 08:05:21.458193    1530 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/addons-862000/id_rsa Username:docker}

	I0520 08:05:21.458603    1530 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...

	I0520 08:05:21.464022    1530 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (798 bytes)

	I0520 08:05:21.464031    1530 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/addons-862000/id_rsa Username:docker}

** /stderr **

addons_test.go:90: out/minikube-darwin-arm64 start -p addons-862000 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --driver=qemu2  --addons=ingress --addons=ingress-dns failed: exit status 80

--- FAIL: TestAddons/Setup (44.81s)

=== RUN   TestCertOptions

=== PAUSE TestCertOptions

=== CONT  TestCertOptions

cert_options_test.go:49: (dbg) Run:  out/minikube-darwin-arm64 start -p cert-options-149000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=qemu2 

cert_options_test.go:49: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p cert-options-149000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=qemu2 : exit status 80 (9.76264525s)

-- stdout --

	* [cert-options-149000] minikube v1.30.1 on Darwin 13.3.1 (arm64)

	  - MINIKUBE_LOCATION=16543

	  - KUBECONFIG=/Users/jenkins/minikube-integration/16543-1012/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/16543-1012/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting control plane node cert-options-149000 in cluster cert-options-149000

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "cert-options-149000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p cert-options-149000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

cert_options_test.go:51: failed to start minikube with args: "out/minikube-darwin-arm64 start -p cert-options-149000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=qemu2 " : exit status 80

cert_options_test.go:60: (dbg) Run:  out/minikube-darwin-arm64 -p cert-options-149000 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"

cert_options_test.go:60: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p cert-options-149000 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt": exit status 89 (78.719083ms)

-- stdout --

	* The control plane node must be running for this command

	  To start a cluster, run: "minikube start -p cert-options-149000"

-- /stdout --

cert_options_test.go:62: failed to read apiserver cert inside minikube. args "out/minikube-darwin-arm64 -p cert-options-149000 ssh \"openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt\"": exit status 89

cert_options_test.go:69: apiserver cert does not include 127.0.0.1 in SAN.

cert_options_test.go:69: apiserver cert does not include 192.168.15.15 in SAN.

cert_options_test.go:69: apiserver cert does not include localhost in SAN.

cert_options_test.go:69: apiserver cert does not include www.google.com in SAN.

cert_options_test.go:88: (dbg) Run:  kubectl --context cert-options-149000 config view

cert_options_test.go:93: Kubeconfig apiserver server port incorrect. Output of 

'kubectl config view' = "\n-- stdout --\n\tapiVersion: v1\n\tclusters: null\n\tcontexts: null\n\tcurrent-context: \"\"\n\tkind: Config\n\tpreferences: {}\n\tusers: null\n\n-- /stdout --"

cert_options_test.go:100: (dbg) Run:  out/minikube-darwin-arm64 ssh -p cert-options-149000 -- "sudo cat /etc/kubernetes/admin.conf"

cert_options_test.go:100: (dbg) Non-zero exit: out/minikube-darwin-arm64 ssh -p cert-options-149000 -- "sudo cat /etc/kubernetes/admin.conf": exit status 89 (38.949417ms)

-- stdout --

	* The control plane node must be running for this command

	  To start a cluster, run: "minikube start -p cert-options-149000"

-- /stdout --

cert_options_test.go:102: failed to SSH to minikube with args: "out/minikube-darwin-arm64 ssh -p cert-options-149000 -- \"sudo cat /etc/kubernetes/admin.conf\"" : exit status 89

cert_options_test.go:106: Internal minikube kubeconfig (admin.conf) does not contains the right api port. 

-- stdout --

	* The control plane node must be running for this command

	  To start a cluster, run: "minikube start -p cert-options-149000"

-- /stdout --

cert_options_test.go:109: *** TestCertOptions FAILED at 2023-05-20 08:19:11.467727 -0700 PDT m=+928.456603918

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p cert-options-149000 -n cert-options-149000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p cert-options-149000 -n cert-options-149000: exit status 7 (29.096917ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "cert-options-149000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "cert-options-149000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p cert-options-149000

--- FAIL: TestCertOptions (10.05s)

=== RUN   TestCertExpiration

=== PAUSE TestCertExpiration

=== CONT  TestCertExpiration

cert_options_test.go:123: (dbg) Run:  out/minikube-darwin-arm64 start -p cert-expiration-950000 --memory=2048 --cert-expiration=3m --driver=qemu2 

cert_options_test.go:123: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p cert-expiration-950000 --memory=2048 --cert-expiration=3m --driver=qemu2 : exit status 80 (9.895563917s)

-- stdout --

	* [cert-expiration-950000] minikube v1.30.1 on Darwin 13.3.1 (arm64)

	  - MINIKUBE_LOCATION=16543

	  - KUBECONFIG=/Users/jenkins/minikube-integration/16543-1012/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/16543-1012/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting control plane node cert-expiration-950000 in cluster cert-expiration-950000

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "cert-expiration-950000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p cert-expiration-950000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

cert_options_test.go:125: failed to start minikube with args: "out/minikube-darwin-arm64 start -p cert-expiration-950000 --memory=2048 --cert-expiration=3m --driver=qemu2 " : exit status 80

E0520 08:19:07.452260    1437 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/functional-537000/client.crt: no such file or directory

cert_options_test.go:131: (dbg) Run:  out/minikube-darwin-arm64 start -p cert-expiration-950000 --memory=2048 --cert-expiration=8760h --driver=qemu2 

cert_options_test.go:131: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p cert-expiration-950000 --memory=2048 --cert-expiration=8760h --driver=qemu2 : exit status 80 (5.229569792s)

-- stdout --

	* [cert-expiration-950000] minikube v1.30.1 on Darwin 13.3.1 (arm64)

	  - MINIKUBE_LOCATION=16543

	  - KUBECONFIG=/Users/jenkins/minikube-integration/16543-1012/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/16543-1012/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on existing profile

	* Starting control plane node cert-expiration-950000 in cluster cert-expiration-950000

	* Restarting existing qemu2 VM for "cert-expiration-950000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Restarting existing qemu2 VM for "cert-expiration-950000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p cert-expiration-950000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

cert_options_test.go:133: failed to start minikube after cert expiration: "out/minikube-darwin-arm64 start -p cert-expiration-950000 --memory=2048 --cert-expiration=8760h --driver=qemu2 " : exit status 80

cert_options_test.go:136: minikube start output did not warn about expired certs: 

-- stdout --

	* [cert-expiration-950000] minikube v1.30.1 on Darwin 13.3.1 (arm64)

	  - MINIKUBE_LOCATION=16543

	  - KUBECONFIG=/Users/jenkins/minikube-integration/16543-1012/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/16543-1012/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on existing profile

	* Starting control plane node cert-expiration-950000 in cluster cert-expiration-950000

	* Restarting existing qemu2 VM for "cert-expiration-950000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Restarting existing qemu2 VM for "cert-expiration-950000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p cert-expiration-950000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

cert_options_test.go:138: *** TestCertExpiration FAILED at 2023-05-20 08:22:11.575407 -0700 PDT m=+1108.562849668

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p cert-expiration-950000 -n cert-expiration-950000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p cert-expiration-950000 -n cert-expiration-950000: exit status 7 (70.029042ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "cert-expiration-950000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "cert-expiration-950000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p cert-expiration-950000

--- FAIL: TestCertExpiration (195.30s)

=== RUN   TestDockerFlags

=== PAUSE TestDockerFlags

=== CONT  TestDockerFlags

docker_test.go:45: (dbg) Run:  out/minikube-darwin-arm64 start -p docker-flags-981000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=qemu2 

docker_test.go:45: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p docker-flags-981000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=qemu2 : exit status 80 (9.816293417s)

-- stdout --

	* [docker-flags-981000] minikube v1.30.1 on Darwin 13.3.1 (arm64)

	  - MINIKUBE_LOCATION=16543

	  - KUBECONFIG=/Users/jenkins/minikube-integration/16543-1012/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/16543-1012/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting control plane node docker-flags-981000 in cluster docker-flags-981000

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "docker-flags-981000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0520 08:18:51.508708    3403 out.go:296] Setting OutFile to fd 1 ...

	I0520 08:18:51.508835    3403 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0520 08:18:51.508838    3403 out.go:309] Setting ErrFile to fd 2...

	I0520 08:18:51.508840    3403 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0520 08:18:51.508906    3403 root.go:336] Updating PATH: /Users/jenkins/minikube-integration/16543-1012/.minikube/bin

	I0520 08:18:51.509985    3403 out.go:303] Setting JSON to false

	I0520 08:18:51.524965    3403 start.go:125] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":1102,"bootTime":1684594829,"procs":451,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"13.3.1","kernelVersion":"22.4.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}

	W0520 08:18:51.525029    3403 start.go:133] gopshost.Virtualization returned error: not implemented yet

	I0520 08:18:51.529204    3403 out.go:177] * [docker-flags-981000] minikube v1.30.1 on Darwin 13.3.1 (arm64)

	I0520 08:18:51.537104    3403 out.go:177]   - MINIKUBE_LOCATION=16543

	I0520 08:18:51.537142    3403 notify.go:220] Checking for updates...

	I0520 08:18:51.545033    3403 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/16543-1012/kubeconfig

	I0520 08:18:51.548111    3403 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0520 08:18:51.551090    3403 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0520 08:18:51.558064    3403 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/16543-1012/.minikube

	I0520 08:18:51.561163    3403 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0520 08:18:51.564812    3403 config.go:182] Loaded profile config "force-systemd-flag-954000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.27.2

	I0520 08:18:51.564924    3403 config.go:182] Loaded profile config "multinode-046000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.27.2

	I0520 08:18:51.564946    3403 driver.go:375] Setting default libvirt URI to qemu:///system

	I0520 08:18:51.573111    3403 out.go:177] * Using the qemu2 driver based on user configuration

	I0520 08:18:51.576030    3403 start.go:295] selected driver: qemu2

	I0520 08:18:51.576035    3403 start.go:870] validating driver "qemu2" against <nil>

	I0520 08:18:51.576042    3403 start.go:881] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0520 08:18:51.578062    3403 start_flags.go:305] no existing cluster config was found, will generate one from the flags 

	I0520 08:18:51.582046    3403 out.go:177] * Automatically selected the socket_vmnet network

	I0520 08:18:51.585189    3403 start_flags.go:910] Waiting for no components: map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false]

	I0520 08:18:51.585209    3403 cni.go:84] Creating CNI manager for ""

	I0520 08:18:51.585218    3403 cni.go:157] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0520 08:18:51.585222    3403 start_flags.go:314] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0520 08:18:51.585236    3403 start_flags.go:319] config:

	{Name:docker-flags-981000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684523789-16533@sha256:ed200ff6d686f303885e8aaf964442d08018856d63a8e23f7acdc068766ea82b Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.2 ClusterName:docker-flags-981000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain

:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/ru

n/socket_vmnet StaticIP:}

	I0520 08:18:51.585324    3403 iso.go:125] acquiring lock: {Name:mkf05a14b47e9b67445252fbb4917f3bcb37f054 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0520 08:18:51.594119    3403 out.go:177] * Starting control plane node docker-flags-981000 in cluster docker-flags-981000

	I0520 08:18:51.598024    3403 preload.go:132] Checking if preload exists for k8s version v1.27.2 and runtime docker

	I0520 08:18:51.598046    3403 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.2-docker-overlay2-arm64.tar.lz4

	I0520 08:18:51.598060    3403 cache.go:57] Caching tarball of preloaded images

	I0520 08:18:51.598140    3403 preload.go:174] Found /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0520 08:18:51.598145    3403 cache.go:60] Finished verifying existence of preloaded tar for  v1.27.2 on docker

	I0520 08:18:51.598217    3403 profile.go:148] Saving config to /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/docker-flags-981000/config.json ...

	I0520 08:18:51.598229    3403 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/docker-flags-981000/config.json: {Name:mkf0465b25e43d8cdc86cd173c97de295b8b797d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0520 08:18:51.598455    3403 cache.go:195] Successfully downloaded all kic artifacts

	I0520 08:18:51.598466    3403 start.go:364] acquiring machines lock for docker-flags-981000: {Name:mk270c257f49033ffda3b70fea9b877c78314aa8 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0520 08:18:51.598494    3403 start.go:368] acquired machines lock for "docker-flags-981000" in 23.875µs

	I0520 08:18:51.598509    3403 start.go:93] Provisioning new machine with config: &{Name:docker-flags-981000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/16506/minikube-v1.30.1-1684174510-16506-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684523789-16533@sha256:ed200ff6d686f303885e8aaf964442d08018856d63a8e23f7acdc068766ea82b Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root

SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.2 ClusterName:docker-flags-981000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion

:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:} &{Name: IP: Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0520 08:18:51.598536    3403 start.go:125] createHost starting for "" (driver="qemu2")

	I0520 08:18:51.607053    3403 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0520 08:18:51.624237    3403 start.go:159] libmachine.API.Create for "docker-flags-981000" (driver="qemu2")

	I0520 08:18:51.624275    3403 client.go:168] LocalClient.Create starting

	I0520 08:18:51.624344    3403 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/ca.pem

	I0520 08:18:51.624369    3403 main.go:141] libmachine: Decoding PEM data...

	I0520 08:18:51.624381    3403 main.go:141] libmachine: Parsing certificate...

	I0520 08:18:51.624433    3403 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/cert.pem

	I0520 08:18:51.624449    3403 main.go:141] libmachine: Decoding PEM data...

	I0520 08:18:51.624455    3403 main.go:141] libmachine: Parsing certificate...

	I0520 08:18:51.624819    3403 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/16543-1012/.minikube/cache/iso/arm64/minikube-v1.30.1-1684174510-16506-arm64.iso...

	I0520 08:18:51.747675    3403 main.go:141] libmachine: Creating SSH key...

	I0520 08:18:51.853956    3403 main.go:141] libmachine: Creating Disk image...

	I0520 08:18:51.853962    3403 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0520 08:18:51.854109    3403 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/docker-flags-981000/disk.qcow2.raw /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/docker-flags-981000/disk.qcow2

	I0520 08:18:51.862661    3403 main.go:141] libmachine: STDOUT: 

	I0520 08:18:51.862675    3403 main.go:141] libmachine: STDERR: 

	I0520 08:18:51.862758    3403 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/docker-flags-981000/disk.qcow2 +20000M

	I0520 08:18:51.869950    3403 main.go:141] libmachine: STDOUT: Image resized.

	I0520 08:18:51.869961    3403 main.go:141] libmachine: STDERR: 

	I0520 08:18:51.869980    3403 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/docker-flags-981000/disk.qcow2.raw and /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/docker-flags-981000/disk.qcow2

	I0520 08:18:51.869988    3403 main.go:141] libmachine: Starting QEMU VM...

	I0520 08:18:51.870022    3403 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/Cellar/qemu/7.2.0/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/docker-flags-981000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/docker-flags-981000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/docker-flags-981000/qemu.pid -device virtio-net-pci,netdev=net0,mac=72:ff:87:62:c9:b3 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/docker-flags-981000/disk.qcow2

	I0520 08:18:51.871639    3403 main.go:141] libmachine: STDOUT: 

	I0520 08:18:51.871652    3403 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0520 08:18:51.871669    3403 client.go:171] LocalClient.Create took 247.388958ms

	I0520 08:18:53.873916    3403 start.go:128] duration metric: createHost completed in 2.275353792s

	I0520 08:18:53.873975    3403 start.go:83] releasing machines lock for "docker-flags-981000", held for 2.27547475s

	W0520 08:18:53.874034    3403 start.go:687] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0520 08:18:53.893228    3403 out.go:177] * Deleting "docker-flags-981000" in qemu2 ...

	W0520 08:18:53.908933    3403 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0520 08:18:53.908965    3403 start.go:702] Will try again in 5 seconds ...

	I0520 08:18:58.911202    3403 start.go:364] acquiring machines lock for docker-flags-981000: {Name:mk270c257f49033ffda3b70fea9b877c78314aa8 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0520 08:18:58.911621    3403 start.go:368] acquired machines lock for "docker-flags-981000" in 346.416µs

	I0520 08:18:58.911750    3403 start.go:93] Provisioning new machine with config: &{Name:docker-flags-981000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/16506/minikube-v1.30.1-1684174510-16506-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684523789-16533@sha256:ed200ff6d686f303885e8aaf964442d08018856d63a8e23f7acdc068766ea82b Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root

SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.2 ClusterName:docker-flags-981000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion

:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:} &{Name: IP: Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0520 08:18:58.912063    3403 start.go:125] createHost starting for "" (driver="qemu2")

	I0520 08:18:58.921604    3403 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0520 08:18:58.970290    3403 start.go:159] libmachine.API.Create for "docker-flags-981000" (driver="qemu2")

	I0520 08:18:58.970340    3403 client.go:168] LocalClient.Create starting

	I0520 08:18:58.970451    3403 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/ca.pem

	I0520 08:18:58.970492    3403 main.go:141] libmachine: Decoding PEM data...

	I0520 08:18:58.970522    3403 main.go:141] libmachine: Parsing certificate...

	I0520 08:18:58.970598    3403 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/cert.pem

	I0520 08:18:58.970629    3403 main.go:141] libmachine: Decoding PEM data...

	I0520 08:18:58.970652    3403 main.go:141] libmachine: Parsing certificate...

	I0520 08:18:58.971544    3403 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/16543-1012/.minikube/cache/iso/arm64/minikube-v1.30.1-1684174510-16506-arm64.iso...

	I0520 08:18:59.099412    3403 main.go:141] libmachine: Creating SSH key...

	I0520 08:18:59.235830    3403 main.go:141] libmachine: Creating Disk image...

	I0520 08:18:59.235836    3403 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0520 08:18:59.236014    3403 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/docker-flags-981000/disk.qcow2.raw /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/docker-flags-981000/disk.qcow2

	I0520 08:18:59.244717    3403 main.go:141] libmachine: STDOUT: 

	I0520 08:18:59.244730    3403 main.go:141] libmachine: STDERR: 

	I0520 08:18:59.244780    3403 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/docker-flags-981000/disk.qcow2 +20000M

	I0520 08:18:59.251974    3403 main.go:141] libmachine: STDOUT: Image resized.

	I0520 08:18:59.251987    3403 main.go:141] libmachine: STDERR: 

	I0520 08:18:59.252010    3403 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/docker-flags-981000/disk.qcow2.raw and /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/docker-flags-981000/disk.qcow2

	I0520 08:18:59.252018    3403 main.go:141] libmachine: Starting QEMU VM...

	I0520 08:18:59.252054    3403 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/Cellar/qemu/7.2.0/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/docker-flags-981000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/docker-flags-981000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/docker-flags-981000/qemu.pid -device virtio-net-pci,netdev=net0,mac=76:4b:03:b2:61:e2 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/docker-flags-981000/disk.qcow2

	I0520 08:18:59.253667    3403 main.go:141] libmachine: STDOUT: 

	I0520 08:18:59.253684    3403 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0520 08:18:59.253696    3403 client.go:171] LocalClient.Create took 283.347458ms

	I0520 08:19:01.256005    3403 start.go:128] duration metric: createHost completed in 2.343908167s

	I0520 08:19:01.256085    3403 start.go:83] releasing machines lock for "docker-flags-981000", held for 2.344442667s

	W0520 08:19:01.256731    3403 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p docker-flags-981000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p docker-flags-981000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0520 08:19:01.267275    3403 out.go:177] 

	W0520 08:19:01.271451    3403 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0520 08:19:01.271492    3403 out.go:239] * 

	* 

	W0520 08:19:01.274027    3403 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0520 08:19:01.284416    3403 out.go:177] 

** /stderr **

docker_test.go:47: failed to start minikube with args: "out/minikube-darwin-arm64 start -p docker-flags-981000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=qemu2 " : exit status 80

docker_test.go:50: (dbg) Run:  out/minikube-darwin-arm64 -p docker-flags-981000 ssh "sudo systemctl show docker --property=Environment --no-pager"

docker_test.go:50: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p docker-flags-981000 ssh "sudo systemctl show docker --property=Environment --no-pager": exit status 89 (80.19625ms)

-- stdout --

	* The control plane node must be running for this command

	  To start a cluster, run: "minikube start -p docker-flags-981000"

-- /stdout --

docker_test.go:52: failed to 'systemctl show docker' inside minikube. args "out/minikube-darwin-arm64 -p docker-flags-981000 ssh \"sudo systemctl show docker --property=Environment --no-pager\"": exit status 89

docker_test.go:57: expected env key/value "FOO=BAR" to be passed to minikube's docker and be included in: *"* The control plane node must be running for this command\n  To start a cluster, run: \"minikube start -p docker-flags-981000\"\n"*.

docker_test.go:57: expected env key/value "BAZ=BAT" to be passed to minikube's docker and be included in: *"* The control plane node must be running for this command\n  To start a cluster, run: \"minikube start -p docker-flags-981000\"\n"*.

docker_test.go:61: (dbg) Run:  out/minikube-darwin-arm64 -p docker-flags-981000 ssh "sudo systemctl show docker --property=ExecStart --no-pager"

docker_test.go:61: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p docker-flags-981000 ssh "sudo systemctl show docker --property=ExecStart --no-pager": exit status 89 (43.6565ms)

-- stdout --

	* The control plane node must be running for this command

	  To start a cluster, run: "minikube start -p docker-flags-981000"

-- /stdout --

docker_test.go:63: failed on the second 'systemctl show docker' inside minikube. args "out/minikube-darwin-arm64 -p docker-flags-981000 ssh \"sudo systemctl show docker --property=ExecStart --no-pager\"": exit status 89

docker_test.go:67: expected "out/minikube-darwin-arm64 -p docker-flags-981000 ssh \"sudo systemctl show docker --property=ExecStart --no-pager\"" output to have include *--debug* . output: "* The control plane node must be running for this command\n  To start a cluster, run: \"minikube start -p docker-flags-981000\"\n"

panic.go:522: *** TestDockerFlags FAILED at 2023-05-20 08:19:01.425098 -0700 PDT m=+918.413958001

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p docker-flags-981000 -n docker-flags-981000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p docker-flags-981000 -n docker-flags-981000: exit status 7 (28.081416ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "docker-flags-981000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "docker-flags-981000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p docker-flags-981000

--- FAIL: TestDockerFlags (10.07s)

=== RUN   TestForceSystemdFlag

=== PAUSE TestForceSystemdFlag

=== CONT  TestForceSystemdFlag

docker_test.go:85: (dbg) Run:  out/minikube-darwin-arm64 start -p force-systemd-flag-954000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=qemu2 

docker_test.go:85: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p force-systemd-flag-954000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=qemu2 : exit status 80 (11.567625292s)

-- stdout --

	* [force-systemd-flag-954000] minikube v1.30.1 on Darwin 13.3.1 (arm64)

	  - MINIKUBE_LOCATION=16543

	  - KUBECONFIG=/Users/jenkins/minikube-integration/16543-1012/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/16543-1012/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting control plane node force-systemd-flag-954000 in cluster force-systemd-flag-954000

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "force-systemd-flag-954000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0520 08:18:44.687857    3380 out.go:296] Setting OutFile to fd 1 ...

	I0520 08:18:44.687990    3380 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0520 08:18:44.687993    3380 out.go:309] Setting ErrFile to fd 2...

	I0520 08:18:44.687996    3380 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0520 08:18:44.688062    3380 root.go:336] Updating PATH: /Users/jenkins/minikube-integration/16543-1012/.minikube/bin

	I0520 08:18:44.689053    3380 out.go:303] Setting JSON to false

	I0520 08:18:44.704048    3380 start.go:125] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":1095,"bootTime":1684594829,"procs":449,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"13.3.1","kernelVersion":"22.4.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}

	W0520 08:18:44.704121    3380 start.go:133] gopshost.Virtualization returned error: not implemented yet

	I0520 08:18:44.710103    3380 out.go:177] * [force-systemd-flag-954000] minikube v1.30.1 on Darwin 13.3.1 (arm64)

	I0520 08:18:44.713063    3380 out.go:177]   - MINIKUBE_LOCATION=16543

	I0520 08:18:44.713098    3380 notify.go:220] Checking for updates...

	I0520 08:18:44.715965    3380 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/16543-1012/kubeconfig

	I0520 08:18:44.719948    3380 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0520 08:18:44.723943    3380 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0520 08:18:44.727010    3380 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/16543-1012/.minikube

	I0520 08:18:44.729963    3380 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0520 08:18:44.733295    3380 config.go:182] Loaded profile config "force-systemd-env-476000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.27.2

	I0520 08:18:44.733362    3380 config.go:182] Loaded profile config "multinode-046000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.27.2

	I0520 08:18:44.733380    3380 driver.go:375] Setting default libvirt URI to qemu:///system

	I0520 08:18:44.740984    3380 out.go:177] * Using the qemu2 driver based on user configuration

	I0520 08:18:44.743958    3380 start.go:295] selected driver: qemu2

	I0520 08:18:44.743962    3380 start.go:870] validating driver "qemu2" against <nil>

	I0520 08:18:44.743967    3380 start.go:881] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0520 08:18:44.745784    3380 start_flags.go:305] no existing cluster config was found, will generate one from the flags 

	I0520 08:18:44.748972    3380 out.go:177] * Automatically selected the socket_vmnet network

	I0520 08:18:44.750402    3380 start_flags.go:897] Wait components to verify : map[apiserver:true system_pods:true]

	I0520 08:18:44.750415    3380 cni.go:84] Creating CNI manager for ""

	I0520 08:18:44.750421    3380 cni.go:157] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0520 08:18:44.750425    3380 start_flags.go:314] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0520 08:18:44.750432    3380 start_flags.go:319] config:

	{Name:force-systemd-flag-954000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684523789-16533@sha256:ed200ff6d686f303885e8aaf964442d08018856d63a8e23f7acdc068766ea82b Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.2 ClusterName:force-systemd-flag-954000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Co

ntainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}

	I0520 08:18:44.750508    3380 iso.go:125] acquiring lock: {Name:mkf05a14b47e9b67445252fbb4917f3bcb37f054 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0520 08:18:44.758965    3380 out.go:177] * Starting control plane node force-systemd-flag-954000 in cluster force-systemd-flag-954000

	I0520 08:18:44.762981    3380 preload.go:132] Checking if preload exists for k8s version v1.27.2 and runtime docker

	I0520 08:18:44.763005    3380 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.2-docker-overlay2-arm64.tar.lz4

	I0520 08:18:44.763019    3380 cache.go:57] Caching tarball of preloaded images

	I0520 08:18:44.763084    3380 preload.go:174] Found /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0520 08:18:44.763089    3380 cache.go:60] Finished verifying existence of preloaded tar for  v1.27.2 on docker

	I0520 08:18:44.763153    3380 profile.go:148] Saving config to /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/force-systemd-flag-954000/config.json ...

	I0520 08:18:44.763165    3380 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/force-systemd-flag-954000/config.json: {Name:mk30bf16e60d234756352913533ff9cdcdff32bc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0520 08:18:44.763356    3380 cache.go:195] Successfully downloaded all kic artifacts

	I0520 08:18:44.763373    3380 start.go:364] acquiring machines lock for force-systemd-flag-954000: {Name:mk270c257f49033ffda3b70fea9b877c78314aa8 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0520 08:18:44.763403    3380 start.go:368] acquired machines lock for "force-systemd-flag-954000" in 25.292µs

	I0520 08:18:44.763419    3380 start.go:93] Provisioning new machine with config: &{Name:force-systemd-flag-954000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/16506/minikube-v1.30.1-1684174510-16506-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684523789-16533@sha256:ed200ff6d686f303885e8aaf964442d08018856d63a8e23f7acdc068766ea82b Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kub

ernetesConfig:{KubernetesVersion:v1.27.2 ClusterName:force-systemd-flag-954000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p Mount

UID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:} &{Name: IP: Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0520 08:18:44.763446    3380 start.go:125] createHost starting for "" (driver="qemu2")

	I0520 08:18:44.770939    3380 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0520 08:18:44.787081    3380 start.go:159] libmachine.API.Create for "force-systemd-flag-954000" (driver="qemu2")

	I0520 08:18:44.787106    3380 client.go:168] LocalClient.Create starting

	I0520 08:18:44.787166    3380 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/ca.pem

	I0520 08:18:44.787187    3380 main.go:141] libmachine: Decoding PEM data...

	I0520 08:18:44.787201    3380 main.go:141] libmachine: Parsing certificate...

	I0520 08:18:44.787249    3380 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/cert.pem

	I0520 08:18:44.787264    3380 main.go:141] libmachine: Decoding PEM data...

	I0520 08:18:44.787272    3380 main.go:141] libmachine: Parsing certificate...

	I0520 08:18:44.787608    3380 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/16543-1012/.minikube/cache/iso/arm64/minikube-v1.30.1-1684174510-16506-arm64.iso...

	I0520 08:18:44.902060    3380 main.go:141] libmachine: Creating SSH key...

	I0520 08:18:44.976289    3380 main.go:141] libmachine: Creating Disk image...

	I0520 08:18:44.976295    3380 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0520 08:18:44.976441    3380 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/force-systemd-flag-954000/disk.qcow2.raw /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/force-systemd-flag-954000/disk.qcow2

	I0520 08:18:44.984866    3380 main.go:141] libmachine: STDOUT: 

	I0520 08:18:44.984878    3380 main.go:141] libmachine: STDERR: 

	I0520 08:18:44.984918    3380 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/force-systemd-flag-954000/disk.qcow2 +20000M

	I0520 08:18:44.992013    3380 main.go:141] libmachine: STDOUT: Image resized.

	I0520 08:18:44.992027    3380 main.go:141] libmachine: STDERR: 

	I0520 08:18:44.992055    3380 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/force-systemd-flag-954000/disk.qcow2.raw and /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/force-systemd-flag-954000/disk.qcow2

	I0520 08:18:44.992061    3380 main.go:141] libmachine: Starting QEMU VM...

	I0520 08:18:44.992093    3380 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/Cellar/qemu/7.2.0/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/force-systemd-flag-954000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/force-systemd-flag-954000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/force-systemd-flag-954000/qemu.pid -device virtio-net-pci,netdev=net0,mac=da:18:73:bc:43:f0 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/force-systemd-flag-954000/disk.qcow2

	I0520 08:18:44.993545    3380 main.go:141] libmachine: STDOUT: 

	I0520 08:18:44.993557    3380 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0520 08:18:44.993573    3380 client.go:171] LocalClient.Create took 206.461417ms

	I0520 08:18:46.995725    3380 start.go:128] duration metric: createHost completed in 2.232266541s

	I0520 08:18:46.995789    3380 start.go:83] releasing machines lock for "force-systemd-flag-954000", held for 2.2323795s

	W0520 08:18:46.995888    3380 start.go:687] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0520 08:18:47.003320    3380 out.go:177] * Deleting "force-systemd-flag-954000" in qemu2 ...

	W0520 08:18:47.024641    3380 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0520 08:18:47.024673    3380 start.go:702] Will try again in 5 seconds ...

	I0520 08:18:52.026789    3380 start.go:364] acquiring machines lock for force-systemd-flag-954000: {Name:mk270c257f49033ffda3b70fea9b877c78314aa8 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0520 08:18:53.874115    3380 start.go:368] acquired machines lock for "force-systemd-flag-954000" in 1.847246542s

	I0520 08:18:53.874292    3380 start.go:93] Provisioning new machine with config: &{Name:force-systemd-flag-954000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/16506/minikube-v1.30.1-1684174510-16506-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684523789-16533@sha256:ed200ff6d686f303885e8aaf964442d08018856d63a8e23f7acdc068766ea82b Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kub

ernetesConfig:{KubernetesVersion:v1.27.2 ClusterName:force-systemd-flag-954000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p Mount

UID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:} &{Name: IP: Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0520 08:18:53.874546    3380 start.go:125] createHost starting for "" (driver="qemu2")

	I0520 08:18:53.884174    3380 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0520 08:18:53.930775    3380 start.go:159] libmachine.API.Create for "force-systemd-flag-954000" (driver="qemu2")

	I0520 08:18:53.930820    3380 client.go:168] LocalClient.Create starting

	I0520 08:18:53.930945    3380 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/ca.pem

	I0520 08:18:53.930998    3380 main.go:141] libmachine: Decoding PEM data...

	I0520 08:18:53.931014    3380 main.go:141] libmachine: Parsing certificate...

	I0520 08:18:53.931074    3380 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/cert.pem

	I0520 08:18:53.931104    3380 main.go:141] libmachine: Decoding PEM data...

	I0520 08:18:53.931119    3380 main.go:141] libmachine: Parsing certificate...

	I0520 08:18:53.931677    3380 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/16543-1012/.minikube/cache/iso/arm64/minikube-v1.30.1-1684174510-16506-arm64.iso...

	I0520 08:18:54.050366    3380 main.go:141] libmachine: Creating SSH key...

	I0520 08:18:54.166744    3380 main.go:141] libmachine: Creating Disk image...

	I0520 08:18:54.166751    3380 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0520 08:18:54.166897    3380 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/force-systemd-flag-954000/disk.qcow2.raw /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/force-systemd-flag-954000/disk.qcow2

	I0520 08:18:54.175737    3380 main.go:141] libmachine: STDOUT: 

	I0520 08:18:54.175750    3380 main.go:141] libmachine: STDERR: 

	I0520 08:18:54.175809    3380 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/force-systemd-flag-954000/disk.qcow2 +20000M

	I0520 08:18:54.182890    3380 main.go:141] libmachine: STDOUT: Image resized.

	I0520 08:18:54.182904    3380 main.go:141] libmachine: STDERR: 

	I0520 08:18:54.182917    3380 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/force-systemd-flag-954000/disk.qcow2.raw and /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/force-systemd-flag-954000/disk.qcow2

	I0520 08:18:54.182925    3380 main.go:141] libmachine: Starting QEMU VM...

	I0520 08:18:54.182974    3380 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/Cellar/qemu/7.2.0/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/force-systemd-flag-954000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/force-systemd-flag-954000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/force-systemd-flag-954000/qemu.pid -device virtio-net-pci,netdev=net0,mac=ce:ac:aa:fa:3f:c8 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/force-systemd-flag-954000/disk.qcow2

	I0520 08:18:54.184481    3380 main.go:141] libmachine: STDOUT: 

	I0520 08:18:54.184494    3380 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0520 08:18:54.184506    3380 client.go:171] LocalClient.Create took 253.679042ms

	I0520 08:18:56.186717    3380 start.go:128] duration metric: createHost completed in 2.312131292s

	I0520 08:18:56.186767    3380 start.go:83] releasing machines lock for "force-systemd-flag-954000", held for 2.312616125s

	W0520 08:18:56.187380    3380 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p force-systemd-flag-954000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p force-systemd-flag-954000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0520 08:18:56.198192    3380 out.go:177] 

	W0520 08:18:56.203320    3380 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0520 08:18:56.203347    3380 out.go:239] * 

	* 

	W0520 08:18:56.205768    3380 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0520 08:18:56.216105    3380 out.go:177] 

** /stderr **

docker_test.go:87: failed to start minikube with args: "out/minikube-darwin-arm64 start -p force-systemd-flag-954000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=qemu2 " : exit status 80

docker_test.go:104: (dbg) Run:  out/minikube-darwin-arm64 -p force-systemd-flag-954000 ssh "docker info --format {{.CgroupDriver}}"

docker_test.go:104: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p force-systemd-flag-954000 ssh "docker info --format {{.CgroupDriver}}": exit status 89 (77.567292ms)

-- stdout --

	* The control plane node must be running for this command

	  To start a cluster, run: "minikube start -p force-systemd-flag-954000"

-- /stdout --

docker_test.go:106: failed to get docker cgroup driver. args "out/minikube-darwin-arm64 -p force-systemd-flag-954000 ssh \"docker info --format {{.CgroupDriver}}\"": exit status 89

docker_test.go:100: *** TestForceSystemdFlag FAILED at 2023-05-20 08:18:56.309665 -0700 PDT m=+913.298515959

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-flag-954000 -n force-systemd-flag-954000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-flag-954000 -n force-systemd-flag-954000: exit status 7 (32.775875ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "force-systemd-flag-954000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "force-systemd-flag-954000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p force-systemd-flag-954000

--- FAIL: TestForceSystemdFlag (11.78s)

=== RUN   TestForceSystemdEnv

=== PAUSE TestForceSystemdEnv

=== CONT  TestForceSystemdEnv

docker_test.go:149: (dbg) Run:  out/minikube-darwin-arm64 start -p force-systemd-env-476000 --memory=2048 --alsologtostderr -v=5 --driver=qemu2 

docker_test.go:149: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p force-systemd-env-476000 --memory=2048 --alsologtostderr -v=5 --driver=qemu2 : exit status 80 (9.812215167s)

-- stdout --

	* [force-systemd-env-476000] minikube v1.30.1 on Darwin 13.3.1 (arm64)

	  - MINIKUBE_LOCATION=16543

	  - KUBECONFIG=/Users/jenkins/minikube-integration/16543-1012/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/16543-1012/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=true

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting control plane node force-systemd-env-476000 in cluster force-systemd-env-476000

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "force-systemd-env-476000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0520 08:18:41.480539    3362 out.go:296] Setting OutFile to fd 1 ...

	I0520 08:18:41.480680    3362 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0520 08:18:41.480684    3362 out.go:309] Setting ErrFile to fd 2...

	I0520 08:18:41.480687    3362 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0520 08:18:41.480768    3362 root.go:336] Updating PATH: /Users/jenkins/minikube-integration/16543-1012/.minikube/bin

	I0520 08:18:41.481881    3362 out.go:303] Setting JSON to false

	I0520 08:18:41.498964    3362 start.go:125] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":1092,"bootTime":1684594829,"procs":450,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"13.3.1","kernelVersion":"22.4.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}

	W0520 08:18:41.499041    3362 start.go:133] gopshost.Virtualization returned error: not implemented yet

	I0520 08:18:41.502782    3362 out.go:177] * [force-systemd-env-476000] minikube v1.30.1 on Darwin 13.3.1 (arm64)

	I0520 08:18:41.510736    3362 out.go:177]   - MINIKUBE_LOCATION=16543

	I0520 08:18:41.513788    3362 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/16543-1012/kubeconfig

	I0520 08:18:41.510763    3362 notify.go:220] Checking for updates...

	I0520 08:18:41.520776    3362 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0520 08:18:41.524750    3362 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0520 08:18:41.527816    3362 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/16543-1012/.minikube

	I0520 08:18:41.530886    3362 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=true

	I0520 08:18:41.534086    3362 config.go:182] Loaded profile config "multinode-046000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.27.2

	I0520 08:18:41.534114    3362 driver.go:375] Setting default libvirt URI to qemu:///system

	I0520 08:18:41.537832    3362 out.go:177] * Using the qemu2 driver based on user configuration

	I0520 08:18:41.544721    3362 start.go:295] selected driver: qemu2

	I0520 08:18:41.544727    3362 start.go:870] validating driver "qemu2" against <nil>

	I0520 08:18:41.544733    3362 start.go:881] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0520 08:18:41.546652    3362 start_flags.go:305] no existing cluster config was found, will generate one from the flags 

	I0520 08:18:41.550774    3362 out.go:177] * Automatically selected the socket_vmnet network

	I0520 08:18:41.553767    3362 start_flags.go:897] Wait components to verify : map[apiserver:true system_pods:true]

	I0520 08:18:41.553787    3362 cni.go:84] Creating CNI manager for ""

	I0520 08:18:41.553792    3362 cni.go:157] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0520 08:18:41.553799    3362 start_flags.go:314] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0520 08:18:41.553805    3362 start_flags.go:319] config:

	{Name:force-systemd-env-476000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684523789-16533@sha256:ed200ff6d686f303885e8aaf964442d08018856d63a8e23f7acdc068766ea82b Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.2 ClusterName:force-systemd-env-476000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Cont

ainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}

	I0520 08:18:41.553878    3362 iso.go:125] acquiring lock: {Name:mkf05a14b47e9b67445252fbb4917f3bcb37f054 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0520 08:18:41.561771    3362 out.go:177] * Starting control plane node force-systemd-env-476000 in cluster force-systemd-env-476000

	I0520 08:18:41.565740    3362 preload.go:132] Checking if preload exists for k8s version v1.27.2 and runtime docker

	I0520 08:18:41.565763    3362 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.2-docker-overlay2-arm64.tar.lz4

	I0520 08:18:41.565772    3362 cache.go:57] Caching tarball of preloaded images

	I0520 08:18:41.565830    3362 preload.go:174] Found /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0520 08:18:41.565834    3362 cache.go:60] Finished verifying existence of preloaded tar for  v1.27.2 on docker

	I0520 08:18:41.565880    3362 profile.go:148] Saving config to /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/force-systemd-env-476000/config.json ...

	I0520 08:18:41.565894    3362 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/force-systemd-env-476000/config.json: {Name:mkd447c4cd2ce863474944e90c0b78b302504c88 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0520 08:18:41.566082    3362 cache.go:195] Successfully downloaded all kic artifacts

	I0520 08:18:41.566091    3362 start.go:364] acquiring machines lock for force-systemd-env-476000: {Name:mk270c257f49033ffda3b70fea9b877c78314aa8 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0520 08:18:41.566115    3362 start.go:368] acquired machines lock for "force-systemd-env-476000" in 19.792µs

	I0520 08:18:41.566131    3362 start.go:93] Provisioning new machine with config: &{Name:force-systemd-env-476000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/16506/minikube-v1.30.1-1684174510-16506-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684523789-16533@sha256:ed200ff6d686f303885e8aaf964442d08018856d63a8e23f7acdc068766ea82b Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kube

rnetesConfig:{KubernetesVersion:v1.27.2 ClusterName:force-systemd-env-476000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUI

D:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:} &{Name: IP: Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0520 08:18:41.566154    3362 start.go:125] createHost starting for "" (driver="qemu2")

	I0520 08:18:41.573807    3362 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0520 08:18:41.590375    3362 start.go:159] libmachine.API.Create for "force-systemd-env-476000" (driver="qemu2")

	I0520 08:18:41.590404    3362 client.go:168] LocalClient.Create starting

	I0520 08:18:41.590485    3362 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/ca.pem

	I0520 08:18:41.590522    3362 main.go:141] libmachine: Decoding PEM data...

	I0520 08:18:41.590537    3362 main.go:141] libmachine: Parsing certificate...

	I0520 08:18:41.590596    3362 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/cert.pem

	I0520 08:18:41.590614    3362 main.go:141] libmachine: Decoding PEM data...

	I0520 08:18:41.590626    3362 main.go:141] libmachine: Parsing certificate...

	I0520 08:18:41.591044    3362 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/16543-1012/.minikube/cache/iso/arm64/minikube-v1.30.1-1684174510-16506-arm64.iso...

	I0520 08:18:41.732915    3362 main.go:141] libmachine: Creating SSH key...

	I0520 08:18:41.821841    3362 main.go:141] libmachine: Creating Disk image...

	I0520 08:18:41.821852    3362 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0520 08:18:41.822037    3362 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/force-systemd-env-476000/disk.qcow2.raw /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/force-systemd-env-476000/disk.qcow2

	I0520 08:18:41.830747    3362 main.go:141] libmachine: STDOUT: 

	I0520 08:18:41.830761    3362 main.go:141] libmachine: STDERR: 

	I0520 08:18:41.830829    3362 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/force-systemd-env-476000/disk.qcow2 +20000M

	I0520 08:18:41.838396    3362 main.go:141] libmachine: STDOUT: Image resized.

	I0520 08:18:41.838416    3362 main.go:141] libmachine: STDERR: 

	I0520 08:18:41.838434    3362 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/force-systemd-env-476000/disk.qcow2.raw and /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/force-systemd-env-476000/disk.qcow2

	I0520 08:18:41.838440    3362 main.go:141] libmachine: Starting QEMU VM...

	I0520 08:18:41.838476    3362 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/Cellar/qemu/7.2.0/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/force-systemd-env-476000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/force-systemd-env-476000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/force-systemd-env-476000/qemu.pid -device virtio-net-pci,netdev=net0,mac=76:75:ba:14:9d:b0 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/force-systemd-env-476000/disk.qcow2

	I0520 08:18:41.840167    3362 main.go:141] libmachine: STDOUT: 

	I0520 08:18:41.840180    3362 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0520 08:18:41.840198    3362 client.go:171] LocalClient.Create took 249.791333ms

	I0520 08:18:43.842419    3362 start.go:128] duration metric: createHost completed in 2.276239s

	I0520 08:18:43.842495    3362 start.go:83] releasing machines lock for "force-systemd-env-476000", held for 2.27637275s

	W0520 08:18:43.842562    3362 start.go:687] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0520 08:18:43.852892    3362 out.go:177] * Deleting "force-systemd-env-476000" in qemu2 ...

	W0520 08:18:43.871343    3362 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0520 08:18:43.871378    3362 start.go:702] Will try again in 5 seconds ...

	I0520 08:18:48.873581    3362 start.go:364] acquiring machines lock for force-systemd-env-476000: {Name:mk270c257f49033ffda3b70fea9b877c78314aa8 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0520 08:18:48.874063    3362 start.go:368] acquired machines lock for "force-systemd-env-476000" in 382.542µs

	I0520 08:18:48.874237    3362 start.go:93] Provisioning new machine with config: &{Name:force-systemd-env-476000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/16506/minikube-v1.30.1-1684174510-16506-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684523789-16533@sha256:ed200ff6d686f303885e8aaf964442d08018856d63a8e23f7acdc068766ea82b Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kube

rnetesConfig:{KubernetesVersion:v1.27.2 ClusterName:force-systemd-env-476000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUI

D:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:} &{Name: IP: Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0520 08:18:48.874527    3362 start.go:125] createHost starting for "" (driver="qemu2")

	I0520 08:18:48.884228    3362 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0520 08:18:48.931859    3362 start.go:159] libmachine.API.Create for "force-systemd-env-476000" (driver="qemu2")

	I0520 08:18:48.931908    3362 client.go:168] LocalClient.Create starting

	I0520 08:18:48.932022    3362 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/ca.pem

	I0520 08:18:48.932068    3362 main.go:141] libmachine: Decoding PEM data...

	I0520 08:18:48.932084    3362 main.go:141] libmachine: Parsing certificate...

	I0520 08:18:48.932166    3362 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/cert.pem

	I0520 08:18:48.932195    3362 main.go:141] libmachine: Decoding PEM data...

	I0520 08:18:48.932208    3362 main.go:141] libmachine: Parsing certificate...

	I0520 08:18:48.932725    3362 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/16543-1012/.minikube/cache/iso/arm64/minikube-v1.30.1-1684174510-16506-arm64.iso...

	I0520 08:18:49.060500    3362 main.go:141] libmachine: Creating SSH key...

	I0520 08:18:49.200538    3362 main.go:141] libmachine: Creating Disk image...

	I0520 08:18:49.200544    3362 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0520 08:18:49.200705    3362 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/force-systemd-env-476000/disk.qcow2.raw /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/force-systemd-env-476000/disk.qcow2

	I0520 08:18:49.209708    3362 main.go:141] libmachine: STDOUT: 

	I0520 08:18:49.209723    3362 main.go:141] libmachine: STDERR: 

	I0520 08:18:49.209780    3362 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/force-systemd-env-476000/disk.qcow2 +20000M

	I0520 08:18:49.216956    3362 main.go:141] libmachine: STDOUT: Image resized.

	I0520 08:18:49.216970    3362 main.go:141] libmachine: STDERR: 

	I0520 08:18:49.216985    3362 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/force-systemd-env-476000/disk.qcow2.raw and /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/force-systemd-env-476000/disk.qcow2

	I0520 08:18:49.216991    3362 main.go:141] libmachine: Starting QEMU VM...

	I0520 08:18:49.217036    3362 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/Cellar/qemu/7.2.0/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/force-systemd-env-476000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/force-systemd-env-476000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/force-systemd-env-476000/qemu.pid -device virtio-net-pci,netdev=net0,mac=7a:ac:29:05:66:57 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/force-systemd-env-476000/disk.qcow2

	I0520 08:18:49.218577    3362 main.go:141] libmachine: STDOUT: 

	I0520 08:18:49.218592    3362 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0520 08:18:49.218604    3362 client.go:171] LocalClient.Create took 286.689166ms

	I0520 08:18:51.220836    3362 start.go:128] duration metric: createHost completed in 2.346289167s

	I0520 08:18:51.220939    3362 start.go:83] releasing machines lock for "force-systemd-env-476000", held for 2.346841959s

	W0520 08:18:51.221545    3362 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p force-systemd-env-476000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p force-systemd-env-476000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0520 08:18:51.230250    3362 out.go:177] 

	W0520 08:18:51.235410    3362 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0520 08:18:51.235434    3362 out.go:239] * 

	* 

	W0520 08:18:51.239229    3362 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0520 08:18:51.251272    3362 out.go:177] 

** /stderr **

docker_test.go:151: failed to start minikube with args: "out/minikube-darwin-arm64 start -p force-systemd-env-476000 --memory=2048 --alsologtostderr -v=5 --driver=qemu2 " : exit status 80

docker_test.go:104: (dbg) Run:  out/minikube-darwin-arm64 -p force-systemd-env-476000 ssh "docker info --format {{.CgroupDriver}}"

docker_test.go:104: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p force-systemd-env-476000 ssh "docker info --format {{.CgroupDriver}}": exit status 89 (82.198666ms)

-- stdout --

	* The control plane node must be running for this command

	  To start a cluster, run: "minikube start -p force-systemd-env-476000"

-- /stdout --

docker_test.go:106: failed to get docker cgroup driver. args "out/minikube-darwin-arm64 -p force-systemd-env-476000 ssh \"docker info --format {{.CgroupDriver}}\"": exit status 89

docker_test.go:160: *** TestForceSystemdEnv FAILED at 2023-05-20 08:18:51.348359 -0700 PDT m=+908.337201376

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-env-476000 -n force-systemd-env-476000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p force-systemd-env-476000 -n force-systemd-env-476000: exit status 7 (34.8045ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "force-systemd-env-476000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "force-systemd-env-476000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p force-systemd-env-476000

--- FAIL: TestForceSystemdEnv (10.03s)

=== RUN   TestFunctional/parallel/ServiceCmdConnect

=== PAUSE TestFunctional/parallel/ServiceCmdConnect

=== CONT  TestFunctional/parallel/ServiceCmdConnect

functional_test.go:1625: (dbg) Run:  kubectl --context functional-537000 create deployment hello-node-connect --image=registry.k8s.io/echoserver-arm:1.8

functional_test.go:1633: (dbg) Run:  kubectl --context functional-537000 expose deployment hello-node-connect --type=NodePort --port=8080

functional_test.go:1638: (dbg) TestFunctional/parallel/ServiceCmdConnect: waiting 10m0s for pods matching "app=hello-node-connect" in namespace "default" ...

helpers_test.go:344: "hello-node-connect-58d66798bb-rszsd" [d5deaded-35e0-4666-ae93-d2089778768d] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])

helpers_test.go:344: "hello-node-connect-58d66798bb-rszsd" [d5deaded-35e0-4666-ae93-d2089778768d] Running / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])

functional_test.go:1638: (dbg) TestFunctional/parallel/ServiceCmdConnect: app=hello-node-connect healthy within 7.006706833s

functional_test.go:1647: (dbg) Run:  out/minikube-darwin-arm64 -p functional-537000 service hello-node-connect --url

functional_test.go:1653: found endpoint for hello-node-connect: http://192.168.105.4:30213

functional_test.go:1659: error fetching http://192.168.105.4:30213: Get "http://192.168.105.4:30213": dial tcp 192.168.105.4:30213: connect: connection refused

functional_test.go:1659: error fetching http://192.168.105.4:30213: Get "http://192.168.105.4:30213": dial tcp 192.168.105.4:30213: connect: connection refused

functional_test.go:1659: error fetching http://192.168.105.4:30213: Get "http://192.168.105.4:30213": dial tcp 192.168.105.4:30213: connect: connection refused

functional_test.go:1659: error fetching http://192.168.105.4:30213: Get "http://192.168.105.4:30213": dial tcp 192.168.105.4:30213: connect: connection refused

functional_test.go:1659: error fetching http://192.168.105.4:30213: Get "http://192.168.105.4:30213": dial tcp 192.168.105.4:30213: connect: connection refused

functional_test.go:1659: error fetching http://192.168.105.4:30213: Get "http://192.168.105.4:30213": dial tcp 192.168.105.4:30213: connect: connection refused

functional_test.go:1659: error fetching http://192.168.105.4:30213: Get "http://192.168.105.4:30213": dial tcp 192.168.105.4:30213: connect: connection refused

functional_test.go:1659: error fetching http://192.168.105.4:30213: Get "http://192.168.105.4:30213": dial tcp 192.168.105.4:30213: connect: connection refused

functional_test.go:1679: failed to fetch http://192.168.105.4:30213: Get "http://192.168.105.4:30213": dial tcp 192.168.105.4:30213: connect: connection refused

functional_test.go:1596: service test failed - dumping debug information

functional_test.go:1597: -----------------------service failure post-mortem--------------------------------

functional_test.go:1600: (dbg) Run:  kubectl --context functional-537000 describe po hello-node-connect

functional_test.go:1604: hello-node pod describe:

Name:             hello-node-connect-58d66798bb-rszsd

Namespace:        default

Priority:         0

Service Account:  default

Node:             functional-537000/192.168.105.4

Start Time:       Sat, 20 May 2023 08:09:03 -0700

Labels:           app=hello-node-connect

pod-template-hash=58d66798bb

Annotations:      <none>

Status:           Running

IP:               10.244.0.9

IPs:

IP:           10.244.0.9

Controlled By:  ReplicaSet/hello-node-connect-58d66798bb

Containers:

echoserver-arm:

Container ID:   docker://ac4e7966822714724c7ee64fd3ff51261b37fd67c2942ed2835f3c6bdf79503c

Image:          registry.k8s.io/echoserver-arm:1.8

Image ID:       docker-pullable://registry.k8s.io/echoserver-arm@sha256:b33d4cdf6ed097f4e9b77b135d83a596ab73c6268b0342648818eb85f5edfdb5

Port:           <none>

Host Port:      <none>

State:          Waiting

Reason:       CrashLoopBackOff

Last State:     Terminated

Reason:       Error

Exit Code:    1

Started:      Sat, 20 May 2023 08:09:16 -0700

Finished:     Sat, 20 May 2023 08:09:16 -0700

Ready:          False

Restart Count:  2

Environment:    <none>

Mounts:

/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-qlh2q (ro)

Conditions:

Type              Status

Initialized       True 

Ready             False 

ContainersReady   False 

PodScheduled      True 

Volumes:

kube-api-access-qlh2q:

Type:                    Projected (a volume that contains injected data from multiple sources)

TokenExpirationSeconds:  3607

ConfigMapName:           kube-root-ca.crt

ConfigMapOptional:       <nil>

DownwardAPI:             true

QoS Class:                   BestEffort

Node-Selectors:              <none>

Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

Events:

Type     Reason     Age                From               Message

----     ------     ----               ----               -------

Normal   Scheduled  35s                default-scheduler  Successfully assigned default/hello-node-connect-58d66798bb-rszsd to functional-537000

Normal   Pulled     22s (x3 over 35s)  kubelet            Container image "registry.k8s.io/echoserver-arm:1.8" already present on machine

Normal   Created    22s (x3 over 35s)  kubelet            Created container echoserver-arm

Normal   Started    22s (x3 over 35s)  kubelet            Started container echoserver-arm

Warning  BackOff    6s (x3 over 33s)   kubelet            Back-off restarting failed container echoserver-arm in pod hello-node-connect-58d66798bb-rszsd_default(d5deaded-35e0-4666-ae93-d2089778768d)

functional_test.go:1606: (dbg) Run:  kubectl --context functional-537000 logs -l app=hello-node-connect

functional_test.go:1610: hello-node logs:

exec /usr/sbin/nginx: exec format error

functional_test.go:1612: (dbg) Run:  kubectl --context functional-537000 describe svc hello-node-connect

functional_test.go:1616: hello-node svc describe:

Name:                     hello-node-connect

Namespace:                default

Labels:                   app=hello-node-connect

Annotations:              <none>

Selector:                 app=hello-node-connect

Type:                     NodePort

IP Family Policy:         SingleStack

IP Families:              IPv4

IP:                       10.110.197.145

IPs:                      10.110.197.145

Port:                     <unset>  8080/TCP

TargetPort:               8080/TCP

NodePort:                 <unset>  30213/TCP

Endpoints:                

Session Affinity:         None

External Traffic Policy:  Cluster

Events:                   <none>

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p functional-537000 -n functional-537000

helpers_test.go:244: <<< TestFunctional/parallel/ServiceCmdConnect FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestFunctional/parallel/ServiceCmdConnect]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-darwin-arm64 -p functional-537000 logs -n 25

helpers_test.go:252: TestFunctional/parallel/ServiceCmdConnect logs: 

-- stdout --

	* 

	* ==> Audit <==

	* |-----------|--------------------------------------------------------------------------------------------------------------------|-------------------|---------|---------|---------------------|---------------------|

	|  Command  |                                                        Args                                                        |      Profile      |  User   | Version |     Start Time      |      End Time       |

	|-----------|--------------------------------------------------------------------------------------------------------------------|-------------------|---------|---------|---------------------|---------------------|

	| mount     | -p functional-537000                                                                                               | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT |                     |

	|           | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalparallelMountCmdVerifyCleanup1384780782/001:/mount2 |                   |         |         |                     |                     |

	|           | --alsologtostderr -v=1                                                                                             |                   |         |         |                     |                     |

	| mount     | -p functional-537000                                                                                               | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT |                     |

	|           | /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/TestFunctionalparallelMountCmdVerifyCleanup1384780782/001:/mount3 |                   |         |         |                     |                     |

	|           | --alsologtostderr -v=1                                                                                             |                   |         |         |                     |                     |

	| ssh       | functional-537000 ssh findmnt                                                                                      | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT |                     |

	|           | -T /mount1                                                                                                         |                   |         |         |                     |                     |

	| ssh       | functional-537000 ssh findmnt                                                                                      | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT | 20 May 23 08:09 PDT |

	|           | -T /mount1                                                                                                         |                   |         |         |                     |                     |

	| ssh       | functional-537000 ssh findmnt                                                                                      | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT | 20 May 23 08:09 PDT |

	|           | -T /mount2                                                                                                         |                   |         |         |                     |                     |

	| ssh       | functional-537000 ssh findmnt                                                                                      | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT |                     |

	|           | -T /mount3                                                                                                         |                   |         |         |                     |                     |

	| ssh       | functional-537000 ssh findmnt                                                                                      | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT | 20 May 23 08:09 PDT |

	|           | -T /mount1                                                                                                         |                   |         |         |                     |                     |

	| ssh       | functional-537000 ssh findmnt                                                                                      | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT | 20 May 23 08:09 PDT |

	|           | -T /mount2                                                                                                         |                   |         |         |                     |                     |

	| ssh       | functional-537000 ssh findmnt                                                                                      | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT |                     |

	|           | -T /mount3                                                                                                         |                   |         |         |                     |                     |

	| ssh       | functional-537000 ssh findmnt                                                                                      | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT | 20 May 23 08:09 PDT |

	|           | -T /mount1                                                                                                         |                   |         |         |                     |                     |

	| ssh       | functional-537000 ssh findmnt                                                                                      | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT | 20 May 23 08:09 PDT |

	|           | -T /mount2                                                                                                         |                   |         |         |                     |                     |

	| ssh       | functional-537000 ssh findmnt                                                                                      | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT |                     |

	|           | -T /mount3                                                                                                         |                   |         |         |                     |                     |

	| ssh       | functional-537000 ssh findmnt                                                                                      | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT | 20 May 23 08:09 PDT |

	|           | -T /mount1                                                                                                         |                   |         |         |                     |                     |

	| ssh       | functional-537000 ssh findmnt                                                                                      | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT | 20 May 23 08:09 PDT |

	|           | -T /mount2                                                                                                         |                   |         |         |                     |                     |

	| ssh       | functional-537000 ssh findmnt                                                                                      | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT |                     |

	|           | -T /mount3                                                                                                         |                   |         |         |                     |                     |

	| ssh       | functional-537000 ssh findmnt                                                                                      | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT | 20 May 23 08:09 PDT |

	|           | -T /mount1                                                                                                         |                   |         |         |                     |                     |

	| ssh       | functional-537000 ssh findmnt                                                                                      | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT | 20 May 23 08:09 PDT |

	|           | -T /mount2                                                                                                         |                   |         |         |                     |                     |

	| ssh       | functional-537000 ssh findmnt                                                                                      | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT |                     |

	|           | -T /mount3                                                                                                         |                   |         |         |                     |                     |

	| ssh       | functional-537000 ssh findmnt                                                                                      | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT | 20 May 23 08:09 PDT |

	|           | -T /mount1                                                                                                         |                   |         |         |                     |                     |

	| ssh       | functional-537000 ssh findmnt                                                                                      | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT | 20 May 23 08:09 PDT |

	|           | -T /mount2                                                                                                         |                   |         |         |                     |                     |

	| ssh       | functional-537000 ssh findmnt                                                                                      | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT |                     |

	|           | -T /mount3                                                                                                         |                   |         |         |                     |                     |

	| start     | -p functional-537000                                                                                               | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT |                     |

	|           | --dry-run --memory                                                                                                 |                   |         |         |                     |                     |

	|           | 250MB --alsologtostderr                                                                                            |                   |         |         |                     |                     |

	|           | --driver=qemu2                                                                                                     |                   |         |         |                     |                     |

	| start     | -p functional-537000 --dry-run                                                                                     | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT |                     |

	|           | --alsologtostderr -v=1                                                                                             |                   |         |         |                     |                     |

	|           | --driver=qemu2                                                                                                     |                   |         |         |                     |                     |

	| start     | -p functional-537000                                                                                               | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT |                     |

	|           | --dry-run --memory                                                                                                 |                   |         |         |                     |                     |

	|           | 250MB --alsologtostderr                                                                                            |                   |         |         |                     |                     |

	|           | --driver=qemu2                                                                                                     |                   |         |         |                     |                     |

	| dashboard | --url --port 36195                                                                                                 | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT |                     |

	|           | -p functional-537000                                                                                               |                   |         |         |                     |                     |

	|           | --alsologtostderr -v=1                                                                                             |                   |         |         |                     |                     |

	|-----------|--------------------------------------------------------------------------------------------------------------------|-------------------|---------|---------|---------------------|---------------------|

	* 

	* ==> Last Start <==

	* Log file created at: 2023/05/20 08:09:37

	Running on machine: MacOS-M1-Agent-1

	Binary: Built with gc go1.20.4 for darwin/arm64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0520 08:09:37.565187    2296 out.go:296] Setting OutFile to fd 1 ...

	I0520 08:09:37.565285    2296 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0520 08:09:37.565288    2296 out.go:309] Setting ErrFile to fd 2...

	I0520 08:09:37.565290    2296 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0520 08:09:37.565388    2296 root.go:336] Updating PATH: /Users/jenkins/minikube-integration/16543-1012/.minikube/bin

	I0520 08:09:37.566579    2296 out.go:303] Setting JSON to false

	I0520 08:09:37.582881    2296 start.go:125] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":548,"bootTime":1684594829,"procs":444,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"13.3.1","kernelVersion":"22.4.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}

	W0520 08:09:37.582968    2296 start.go:133] gopshost.Virtualization returned error: not implemented yet

	I0520 08:09:37.587991    2296 out.go:177] * [functional-537000] minikube v1.30.1 sur Darwin 13.3.1 (arm64)

	I0520 08:09:37.597986    2296 out.go:177]   - MINIKUBE_LOCATION=16543

	I0520 08:09:37.595135    2296 notify.go:220] Checking for updates...

	I0520 08:09:37.605957    2296 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/16543-1012/kubeconfig

	I0520 08:09:37.610897    2296 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0520 08:09:37.617888    2296 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0520 08:09:37.625941    2296 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/16543-1012/.minikube

	I0520 08:09:37.631905    2296 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0520 08:09:37.633869    2296 config.go:182] Loaded profile config "functional-537000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.27.2

	I0520 08:09:37.634088    2296 driver.go:375] Setting default libvirt URI to qemu:///system

	I0520 08:09:37.637941    2296 out.go:177] * Utilisation du pilote qemu2 basé sur le profil existant

	I0520 08:09:37.643918    2296 start.go:295] selected driver: qemu2

	I0520 08:09:37.643923    2296 start.go:870] validating driver "qemu2" against &{Name:functional-537000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/16506/minikube-v1.30.1-1684174510-16506-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684523789-16533@sha256:ed200ff6d686f303885e8aaf964442d08018856d63a8e23f7acdc068766ea82b Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf

ig:{KubernetesVersion:v1.27.2 ClusterName:functional-537000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.105.4 Port:8441 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false E

xtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}

	I0520 08:09:37.643972    2296 start.go:881] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0520 08:09:37.649962    2296 out.go:177] 

	W0520 08:09:37.653933    2296 out.go:239] X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo

	I0520 08:09:37.657991    2296 out.go:177] 

	* 

	* ==> Docker <==

	* -- Journal begins at Sat 2023-05-20 15:06:17 UTC, ends at Sat 2023-05-20 15:09:39 UTC. --

	May 20 15:09:20 functional-537000 dockerd[8509]: time="2023-05-20T15:09:20.546088135Z" level=warning msg="cleaning up after shim disconnected" id=4942b89873a0b6d0158862a4b9d3b7156499999d77b131688dd5e9665730caad namespace=moby

	May 20 15:09:20 functional-537000 dockerd[8509]: time="2023-05-20T15:09:20.546092468Z" level=info msg="cleaning up dead shim" namespace=moby

	May 20 15:09:22 functional-537000 dockerd[8509]: time="2023-05-20T15:09:22.527227825Z" level=info msg="shim disconnected" id=0d264daa1da04d46822b1ae6710ea60591bcdafc1bff25b23c1efa9eadb9e771 namespace=moby

	May 20 15:09:22 functional-537000 dockerd[8509]: time="2023-05-20T15:09:22.527263283Z" level=warning msg="cleaning up after shim disconnected" id=0d264daa1da04d46822b1ae6710ea60591bcdafc1bff25b23c1efa9eadb9e771 namespace=moby

	May 20 15:09:22 functional-537000 dockerd[8509]: time="2023-05-20T15:09:22.527268658Z" level=info msg="cleaning up dead shim" namespace=moby

	May 20 15:09:22 functional-537000 dockerd[8503]: time="2023-05-20T15:09:22.527536698Z" level=info msg="ignoring event" container=0d264daa1da04d46822b1ae6710ea60591bcdafc1bff25b23c1efa9eadb9e771 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 20 15:09:26 functional-537000 dockerd[8509]: time="2023-05-20T15:09:26.524581413Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	May 20 15:09:26 functional-537000 dockerd[8509]: time="2023-05-20T15:09:26.524645288Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	May 20 15:09:26 functional-537000 dockerd[8509]: time="2023-05-20T15:09:26.524676746Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	May 20 15:09:26 functional-537000 dockerd[8509]: time="2023-05-20T15:09:26.524688163Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	May 20 15:09:26 functional-537000 dockerd[8503]: time="2023-05-20T15:09:26.568887791Z" level=info msg="ignoring event" container=c876f19ce53ae4f3abf705471757d8d807671a0b17f1d5520c3d5ce62ad980e9 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 20 15:09:26 functional-537000 dockerd[8509]: time="2023-05-20T15:09:26.569075665Z" level=info msg="shim disconnected" id=c876f19ce53ae4f3abf705471757d8d807671a0b17f1d5520c3d5ce62ad980e9 namespace=moby

	May 20 15:09:26 functional-537000 dockerd[8509]: time="2023-05-20T15:09:26.569106665Z" level=warning msg="cleaning up after shim disconnected" id=c876f19ce53ae4f3abf705471757d8d807671a0b17f1d5520c3d5ce62ad980e9 namespace=moby

	May 20 15:09:26 functional-537000 dockerd[8509]: time="2023-05-20T15:09:26.569111415Z" level=info msg="cleaning up dead shim" namespace=moby

	May 20 15:09:38 functional-537000 dockerd[8509]: time="2023-05-20T15:09:38.590895263Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	May 20 15:09:38 functional-537000 dockerd[8509]: time="2023-05-20T15:09:38.590925513Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	May 20 15:09:38 functional-537000 dockerd[8509]: time="2023-05-20T15:09:38.590931971Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	May 20 15:09:38 functional-537000 dockerd[8509]: time="2023-05-20T15:09:38.591131929Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	May 20 15:09:38 functional-537000 dockerd[8509]: time="2023-05-20T15:09:38.591874468Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	May 20 15:09:38 functional-537000 dockerd[8509]: time="2023-05-20T15:09:38.592068259Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	May 20 15:09:38 functional-537000 dockerd[8509]: time="2023-05-20T15:09:38.594493084Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	May 20 15:09:38 functional-537000 dockerd[8509]: time="2023-05-20T15:09:38.594525584Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	May 20 15:09:38 functional-537000 cri-dockerd[9363]: time="2023-05-20T15:09:38Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/2721b9788d536f2b83af2873bd5432118160202c87fa21c023d465859c710d24/resolv.conf as [nameserver 10.96.0.10 search kubernetes-dashboard.svc.cluster.local svc.cluster.local cluster.local options ndots:5]"

	May 20 15:09:38 functional-537000 cri-dockerd[9363]: time="2023-05-20T15:09:38Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/88b6f35ee17ffaa7ea20704480032a3a13ce7dfbc884bb33a6ad9965e1cd9552/resolv.conf as [nameserver 10.96.0.10 search kubernetes-dashboard.svc.cluster.local svc.cluster.local cluster.local options ndots:5]"

	May 20 15:09:38 functional-537000 dockerd[8503]: time="2023-05-20T15:09:38.998985985Z" level=warning msg="reference for unknown type: " digest="sha256:76049887f07a0476dc93efc2d3569b9529bf982b22d29f356092ce206e98765c" remote="docker.io/kubernetesui/metrics-scraper@sha256:76049887f07a0476dc93efc2d3569b9529bf982b22d29f356092ce206e98765c"

	* 

	* ==> container status <==

	* CONTAINER           IMAGE                                                                                                 CREATED              STATE               NAME                      ATTEMPT             POD ID

	c876f19ce53ae       72565bf5bbedf                                                                                         13 seconds ago       Exited              echoserver-arm            3                   fbb56259d2bdd

	4942b89873a0b       gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e   19 seconds ago       Exited              mount-munger              0                   0d264daa1da04

	ac4e796682271       72565bf5bbedf                                                                                         23 seconds ago       Exited              echoserver-arm            2                   91f0becdb243b

	c1a754fb8eda6       nginx@sha256:480868e8c8c797794257e2abd88d0f9a8809b2fe956cbfbc05dcc0bca1f7cd43                         29 seconds ago       Running             myfrontend                0                   fb5f93a07893d

	8802b52f40450       nginx@sha256:02ffd439b71d9ea9408e449b568f65c0bbbb94bebd8750f1d80231ab6496008e                         45 seconds ago       Running             nginx                     0                   8fe8a6c7f9f59

	af9bbb635e741       97e04611ad434                                                                                         About a minute ago   Running             coredns                   2                   deb5d52e909b8

	066b7686f5336       ba04bb24b9575                                                                                         About a minute ago   Running             storage-provisioner       3                   c0c044ba4dc7b

	2821a7d42f0a2       29921a0845422                                                                                         About a minute ago   Running             kube-proxy                3                   2c989b393407a

	0fe2b97a26a21       24bc64e911039                                                                                         About a minute ago   Running             etcd                      3                   8b03549f0519f

	d0c182e9138f6       305d7ed1dae28                                                                                         About a minute ago   Running             kube-scheduler            3                   1210296f6dfe4

	0378d9e565a4b       72c9df6be7f1b                                                                                         About a minute ago   Running             kube-apiserver            0                   3675d56a7ab45

	417f084c3c946       2ee705380c3c5                                                                                         About a minute ago   Running             kube-controller-manager   3                   ac985b3a98731

	f81fed79a1c27       305d7ed1dae28                                                                                         2 minutes ago        Exited              kube-scheduler            2                   1ee2e59ad2f29

	d179f9a255b91       97e04611ad434                                                                                         2 minutes ago        Exited              coredns                   1                   f6c2d92cfca41

	16ac5269fc99f       ba04bb24b9575                                                                                         2 minutes ago        Exited              storage-provisioner       2                   480cf7505e591

	6f35b89ec6bfd       24bc64e911039                                                                                         2 minutes ago        Exited              etcd                      2                   d5d899b75f140

	b6f8932e57731       29921a0845422                                                                                         2 minutes ago        Exited              kube-proxy                2                   aef8dfed84ad6

	59532f881219e       2ee705380c3c5                                                                                         2 minutes ago        Exited              kube-controller-manager   2                   4c3ee01bcb8a7

	* 

	* ==> coredns [af9bbb635e74] <==

	* .:53

	[INFO] plugin/reload: Running configuration SHA512 = ea7a0d73d9d208f758b1f67640ef03c58089b9d9366cf3478df3bb369b210e39f213811b46224f8a04380814b6e0890ccd358f5b5e8c80bc22ac19c8601ee35b

	CoreDNS-1.10.1

	linux/arm64, go1.20, 055b2c3

	[INFO] 127.0.0.1:58871 - 35098 "HINFO IN 9095312138016394971.3490947401665456859. udp 57 false 512" NXDOMAIN qr,rd,ra 132 0.009358553s

	[INFO] 10.244.0.1:3791 - 28610 "A IN nginx-svc.default.svc.cluster.local. udp 64 false 4096" NOERROR qr,aa,rd 104 0.000085624s

	[INFO] 10.244.0.1:44113 - 16870 "AAAA IN nginx-svc.default.svc.cluster.local. udp 53 false 512" NOERROR qr,aa,rd 146 0.000090291s

	[INFO] 10.244.0.1:40107 - 24696 "SVCB IN _dns.resolver.arpa. udp 36 false 512" NXDOMAIN qr,rd,ra 116 0.000933829s

	[INFO] 10.244.0.1:64249 - 37211 "A IN nginx-svc.default.svc.cluster.local. udp 53 false 512" NOERROR qr,aa,rd 104 0.000048084s

	[INFO] 10.244.0.1:57912 - 16422 "AAAA IN nginx-svc.default.svc.cluster.local. udp 64 false 1232" NOERROR qr,aa,rd 146 0.000085666s

	[INFO] 10.244.0.1:13504 - 49771 "A IN nginx-svc.default.svc.cluster.local. udp 64 false 1232" NOERROR qr,aa,rd 104 0.000098416s

	* 

	* ==> coredns [d179f9a255b9] <==

	* [INFO] plugin/kubernetes: waiting for Kubernetes API before starting server

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server

	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	.:53

	[INFO] plugin/reload: Running configuration SHA512 = ea7a0d73d9d208f758b1f67640ef03c58089b9d9366cf3478df3bb369b210e39f213811b46224f8a04380814b6e0890ccd358f5b5e8c80bc22ac19c8601ee35b

	CoreDNS-1.10.1

	linux/arm64, go1.20, 055b2c3

	[INFO] 127.0.0.1:58513 - 41252 "HINFO IN 5509182939907841389.8822191893046119781. udp 57 false 512" NXDOMAIN qr,rd,ra 132 0.009031795s

	[INFO] SIGTERM: Shutting down servers then terminating

	[INFO] plugin/health: Going into lameduck mode for 5s

	* 

	* ==> describe nodes <==

	* Name:               functional-537000

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=arm64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=arm64

	                    kubernetes.io/hostname=functional-537000

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=24686ce6bbd657e092eb3c3fd6be64c1b7241033

	                    minikube.k8s.io/name=functional-537000

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2023_05_20T08_06_35_0700

	                    minikube.k8s.io/version=v1.30.1

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Sat, 20 May 2023 15:06:32 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  functional-537000

	  AcquireTime:     <unset>

	  RenewTime:       Sat, 20 May 2023 15:09:38 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Sat, 20 May 2023 15:09:18 +0000   Sat, 20 May 2023 15:06:31 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Sat, 20 May 2023 15:09:18 +0000   Sat, 20 May 2023 15:06:31 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Sat, 20 May 2023 15:09:18 +0000   Sat, 20 May 2023 15:06:31 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Sat, 20 May 2023 15:09:18 +0000   Sat, 20 May 2023 15:06:37 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.105.4

	  Hostname:    functional-537000

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17784760Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3905972Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17784760Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3905972Ki

	  pods:               110

	System Info:

	  Machine ID:                 3528df496e654a3e90b7a05b927c97c9

	  System UUID:                3528df496e654a3e90b7a05b927c97c9

	  Boot ID:                    c3243999-0e28-4f47-b715-7331b91b7f13

	  Kernel Version:             5.10.57

	  OS Image:                   Buildroot 2021.02.12

	  Operating System:           linux

	  Architecture:               arm64

	  Container Runtime Version:  docker://20.10.23

	  Kubelet Version:            v1.27.2

	  Kube-Proxy Version:         v1.27.2

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (13 in total)

	  Namespace                   Name                                          CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                          ------------  ----------  ---------------  -------------  ---

	  default                     hello-node-7b684b55f9-szz9k                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         60s

	  default                     hello-node-connect-58d66798bb-rszsd           0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         36s

	  default                     nginx-svc                                     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         48s

	  default                     sp-pod                                        0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         30s

	  kube-system                 coredns-5d78c9869d-mnhb2                      100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (1%!)(MISSING)        170Mi (4%!)(MISSING)     2m51s

	  kube-system                 etcd-functional-537000                        100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (2%!)(MISSING)       0 (0%!)(MISSING)         3m4s

	  kube-system                 kube-apiserver-functional-537000              250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         82s

	  kube-system                 kube-controller-manager-functional-537000     200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m4s

	  kube-system                 kube-proxy-pwf8l                              0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m52s

	  kube-system                 kube-scheduler-functional-537000              100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m4s

	  kube-system                 storage-provisioner                           0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m51s

	  kubernetes-dashboard        dashboard-metrics-scraper-5dd9cbfd69-nzh6s    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         1s

	  kubernetes-dashboard        kubernetes-dashboard-5c5cfc8747-77j67         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         1s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%!)(MISSING)  0 (0%!)(MISSING)

	  memory             170Mi (4%!)(MISSING)  170Mi (4%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-32Mi     0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-64Ki     0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                From             Message

	  ----    ------                   ----               ----             -------

	  Normal  Starting                 2m50s              kube-proxy       

	  Normal  Starting                 81s                kube-proxy       

	  Normal  Starting                 2m25s              kube-proxy       

	  Normal  Starting                 3m4s               kubelet          Starting kubelet.

	  Normal  NodeAllocatableEnforced  3m4s               kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  3m4s               kubelet          Node functional-537000 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    3m4s               kubelet          Node functional-537000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     3m4s               kubelet          Node functional-537000 status is now: NodeHasSufficientPID

	  Normal  NodeReady                3m2s               kubelet          Node functional-537000 status is now: NodeReady

	  Normal  RegisteredNode           2m52s              node-controller  Node functional-537000 event: Registered Node functional-537000 in Controller

	  Normal  RegisteredNode           2m13s              node-controller  Node functional-537000 event: Registered Node functional-537000 in Controller

	  Normal  Starting                 85s                kubelet          Starting kubelet.

	  Normal  NodeHasSufficientMemory  85s (x8 over 85s)  kubelet          Node functional-537000 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    85s (x8 over 85s)  kubelet          Node functional-537000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     85s (x7 over 85s)  kubelet          Node functional-537000 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  85s                kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           69s                node-controller  Node functional-537000 event: Registered Node functional-537000 in Controller

	* 

	* ==> dmesg <==

	* [  +0.107505] systemd-fstab-generator[3783]: Ignoring "noauto" for root device

	[  +0.583534] kauditd_printk_skb: 28 callbacks suppressed

	[May20 15:07] systemd-fstab-generator[5349]: Ignoring "noauto" for root device

	[  +0.104265] systemd-fstab-generator[5457]: Ignoring "noauto" for root device

	[  +0.131187] systemd-fstab-generator[5617]: Ignoring "noauto" for root device

	[  +0.153618] systemd-fstab-generator[5740]: Ignoring "noauto" for root device

	[  +0.151299] systemd-fstab-generator[5780]: Ignoring "noauto" for root device

	[ +15.062686] kauditd_printk_skb: 52 callbacks suppressed

	[ +29.589105] systemd-fstab-generator[7746]: Ignoring "noauto" for root device

	[  +0.148925] systemd-fstab-generator[7777]: Ignoring "noauto" for root device

	[  +0.101738] systemd-fstab-generator[7788]: Ignoring "noauto" for root device

	[  +0.088262] systemd-fstab-generator[7801]: Ignoring "noauto" for root device

	[May20 15:08] systemd-fstab-generator[8978]: Ignoring "noauto" for root device

	[  +0.101351] systemd-fstab-generator[9046]: Ignoring "noauto" for root device

	[  +0.113935] systemd-fstab-generator[9187]: Ignoring "noauto" for root device

	[  +0.134594] systemd-fstab-generator[9268]: Ignoring "noauto" for root device

	[  +0.124309] systemd-fstab-generator[9355]: Ignoring "noauto" for root device

	[  +1.087765] systemd-fstab-generator[9737]: Ignoring "noauto" for root device

	[  +3.415301] kauditd_printk_skb: 61 callbacks suppressed

	[ +12.720073] kauditd_printk_skb: 5 callbacks suppressed

	[ +11.099486] TCP: eth0: Driver has suspect GRO implementation, TCP performance may be compromised.

	[ +15.325519] kauditd_printk_skb: 1 callbacks suppressed

	[May20 15:09] kauditd_printk_skb: 1 callbacks suppressed

	[  +9.607575] kauditd_printk_skb: 3 callbacks suppressed

	[ +19.841757] kauditd_printk_skb: 3 callbacks suppressed

	* 

	* ==> etcd [0fe2b97a26a2] <==

	* {"level":"info","ts":"2023-05-20T15:08:15.402Z","caller":"embed/etcd.go:762","msg":"serving metrics","address":"http://127.0.0.1:2381"}

	{"level":"info","ts":"2023-05-20T15:08:15.402Z","caller":"etcdserver/server.go:754","msg":"starting initial election tick advance","election-ticks":10}

	{"level":"info","ts":"2023-05-20T15:08:15.402Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/snap","suffix":"snap.db","max":5,"interval":"30s"}

	{"level":"info","ts":"2023-05-20T15:08:15.402Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/snap","suffix":"snap","max":5,"interval":"30s"}

	{"level":"info","ts":"2023-05-20T15:08:15.402Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/wal","suffix":"wal","max":5,"interval":"30s"}

	{"level":"info","ts":"2023-05-20T15:08:15.402Z","caller":"embed/etcd.go:586","msg":"serving peer traffic","address":"192.168.105.4:2380"}

	{"level":"info","ts":"2023-05-20T15:08:15.402Z","caller":"embed/etcd.go:558","msg":"cmux::serve","address":"192.168.105.4:2380"}

	{"level":"info","ts":"2023-05-20T15:08:15.402Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 switched to configuration voters=(527499358918876438)"}

	{"level":"info","ts":"2023-05-20T15:08:15.402Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"80e92d98c466b02f","local-member-id":"7520ddf439b1d16","added-peer-id":"7520ddf439b1d16","added-peer-peer-urls":["https://192.168.105.4:2380"]}

	{"level":"info","ts":"2023-05-20T15:08:15.402Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"80e92d98c466b02f","local-member-id":"7520ddf439b1d16","cluster-version":"3.5"}

	{"level":"info","ts":"2023-05-20T15:08:15.402Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}

	{"level":"info","ts":"2023-05-20T15:08:16.579Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 is starting a new election at term 3"}

	{"level":"info","ts":"2023-05-20T15:08:16.579Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became pre-candidate at term 3"}

	{"level":"info","ts":"2023-05-20T15:08:16.579Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 received MsgPreVoteResp from 7520ddf439b1d16 at term 3"}

	{"level":"info","ts":"2023-05-20T15:08:16.579Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became candidate at term 4"}

	{"level":"info","ts":"2023-05-20T15:08:16.579Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 received MsgVoteResp from 7520ddf439b1d16 at term 4"}

	{"level":"info","ts":"2023-05-20T15:08:16.580Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became leader at term 4"}

	{"level":"info","ts":"2023-05-20T15:08:16.580Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 7520ddf439b1d16 elected leader 7520ddf439b1d16 at term 4"}

	{"level":"info","ts":"2023-05-20T15:08:16.583Z","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"7520ddf439b1d16","local-member-attributes":"{Name:functional-537000 ClientURLs:[https://192.168.105.4:2379]}","request-path":"/0/members/7520ddf439b1d16/attributes","cluster-id":"80e92d98c466b02f","publish-timeout":"7s"}

	{"level":"info","ts":"2023-05-20T15:08:16.583Z","caller":"embed/serve.go:100","msg":"ready to serve client requests"}

	{"level":"info","ts":"2023-05-20T15:08:16.587Z","caller":"embed/serve.go:198","msg":"serving client traffic securely","address":"192.168.105.4:2379"}

	{"level":"info","ts":"2023-05-20T15:08:16.587Z","caller":"embed/serve.go:100","msg":"ready to serve client requests"}

	{"level":"info","ts":"2023-05-20T15:08:16.589Z","caller":"embed/serve.go:198","msg":"serving client traffic securely","address":"127.0.0.1:2379"}

	{"level":"info","ts":"2023-05-20T15:08:16.593Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}

	{"level":"info","ts":"2023-05-20T15:08:16.593Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}

	* 

	* ==> etcd [6f35b89ec6bf] <==

	* {"level":"info","ts":"2023-05-20T15:07:11.973Z","caller":"embed/etcd.go:687","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}

	{"level":"info","ts":"2023-05-20T15:07:11.974Z","caller":"embed/etcd.go:275","msg":"now serving peer/client/metrics","local-member-id":"7520ddf439b1d16","initial-advertise-peer-urls":["https://192.168.105.4:2380"],"listen-peer-urls":["https://192.168.105.4:2380"],"advertise-client-urls":["https://192.168.105.4:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.105.4:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}

	{"level":"info","ts":"2023-05-20T15:07:11.974Z","caller":"embed/etcd.go:762","msg":"serving metrics","address":"http://127.0.0.1:2381"}

	{"level":"info","ts":"2023-05-20T15:07:11.974Z","caller":"embed/etcd.go:586","msg":"serving peer traffic","address":"192.168.105.4:2380"}

	{"level":"info","ts":"2023-05-20T15:07:11.974Z","caller":"embed/etcd.go:558","msg":"cmux::serve","address":"192.168.105.4:2380"}

	{"level":"info","ts":"2023-05-20T15:07:13.267Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 is starting a new election at term 2"}

	{"level":"info","ts":"2023-05-20T15:07:13.267Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became pre-candidate at term 2"}

	{"level":"info","ts":"2023-05-20T15:07:13.267Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 received MsgPreVoteResp from 7520ddf439b1d16 at term 2"}

	{"level":"info","ts":"2023-05-20T15:07:13.267Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became candidate at term 3"}

	{"level":"info","ts":"2023-05-20T15:07:13.267Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 received MsgVoteResp from 7520ddf439b1d16 at term 3"}

	{"level":"info","ts":"2023-05-20T15:07:13.267Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"7520ddf439b1d16 became leader at term 3"}

	{"level":"info","ts":"2023-05-20T15:07:13.267Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 7520ddf439b1d16 elected leader 7520ddf439b1d16 at term 3"}

	{"level":"info","ts":"2023-05-20T15:07:13.270Z","caller":"embed/serve.go:100","msg":"ready to serve client requests"}

	{"level":"info","ts":"2023-05-20T15:07:13.270Z","caller":"embed/serve.go:100","msg":"ready to serve client requests"}

	{"level":"info","ts":"2023-05-20T15:07:13.273Z","caller":"embed/serve.go:198","msg":"serving client traffic securely","address":"192.168.105.4:2379"}

	{"level":"info","ts":"2023-05-20T15:07:13.273Z","caller":"embed/serve.go:198","msg":"serving client traffic securely","address":"127.0.0.1:2379"}

	{"level":"info","ts":"2023-05-20T15:07:13.273Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}

	{"level":"info","ts":"2023-05-20T15:07:13.273Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}

	{"level":"info","ts":"2023-05-20T15:07:13.270Z","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"7520ddf439b1d16","local-member-attributes":"{Name:functional-537000 ClientURLs:[https://192.168.105.4:2379]}","request-path":"/0/members/7520ddf439b1d16/attributes","cluster-id":"80e92d98c466b02f","publish-timeout":"7s"}

	{"level":"info","ts":"2023-05-20T15:07:56.142Z","caller":"osutil/interrupt_unix.go:64","msg":"received signal; shutting down","signal":"terminated"}

	{"level":"info","ts":"2023-05-20T15:07:56.142Z","caller":"embed/etcd.go:373","msg":"closing etcd server","name":"functional-537000","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.105.4:2380"],"advertise-client-urls":["https://192.168.105.4:2379"]}

	{"level":"info","ts":"2023-05-20T15:07:56.154Z","caller":"etcdserver/server.go:1465","msg":"skipped leadership transfer for single voting member cluster","local-member-id":"7520ddf439b1d16","current-leader-member-id":"7520ddf439b1d16"}

	{"level":"info","ts":"2023-05-20T15:07:56.155Z","caller":"embed/etcd.go:568","msg":"stopping serving peer traffic","address":"192.168.105.4:2380"}

	{"level":"info","ts":"2023-05-20T15:07:56.157Z","caller":"embed/etcd.go:573","msg":"stopped serving peer traffic","address":"192.168.105.4:2380"}

	{"level":"info","ts":"2023-05-20T15:07:56.157Z","caller":"embed/etcd.go:375","msg":"closed etcd server","name":"functional-537000","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.105.4:2380"],"advertise-client-urls":["https://192.168.105.4:2379"]}

	* 

	* ==> kernel <==

	*  15:09:39 up 3 min,  0 users,  load average: 0.83, 0.55, 0.23

	Linux functional-537000 5.10.57 #1 SMP PREEMPT Mon May 15 19:29:44 UTC 2023 aarch64 GNU/Linux

	PRETTY_NAME="Buildroot 2021.02.12"

	* 

	* ==> kube-apiserver [0378d9e565a4] <==

	* I0520 15:08:17.280532       1 shared_informer.go:318] Caches are synced for node_authorizer

	I0520 15:08:17.296874       1 cache.go:39] Caches are synced for AvailableConditionController controller

	I0520 15:08:17.297076       1 cache.go:39] Caches are synced for autoregister controller

	I0520 15:08:17.297142       1 shared_informer.go:318] Caches are synced for configmaps

	I0520 15:08:17.297165       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller

	I0520 15:08:17.297439       1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller

	I0520 15:08:17.297484       1 apf_controller.go:366] Running API Priority and Fairness config worker

	I0520 15:08:17.297504       1 apf_controller.go:369] Running API Priority and Fairness periodic rebalancing process

	I0520 15:08:17.307144       1 shared_informer.go:318] Caches are synced for crd-autoregister

	I0520 15:08:18.066160       1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).

	I0520 15:08:18.197639       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.

	I0520 15:08:18.786564       1 controller.go:624] quota admission added evaluator for: serviceaccounts

	I0520 15:08:18.789929       1 controller.go:624] quota admission added evaluator for: deployments.apps

	I0520 15:08:18.801884       1 controller.go:624] quota admission added evaluator for: daemonsets.apps

	I0520 15:08:18.809911       1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io

	I0520 15:08:18.812042       1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io

	I0520 15:08:30.244658       1 controller.go:624] quota admission added evaluator for: endpoints

	I0520 15:08:30.461618       1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io

	I0520 15:08:39.695451       1 controller.go:624] quota admission added evaluator for: replicasets.apps

	I0520 15:08:39.749905       1 alloc.go:330] "allocated clusterIPs" service="default/hello-node" clusterIPs=map[IPv4:10.106.200.145]

	I0520 15:08:51.843606       1 alloc.go:330] "allocated clusterIPs" service="default/nginx-svc" clusterIPs=map[IPv4:10.103.212.197]

	I0520 15:09:03.317196       1 alloc.go:330] "allocated clusterIPs" service="default/hello-node-connect" clusterIPs=map[IPv4:10.110.197.145]

	I0520 15:09:38.125024       1 controller.go:624] quota admission added evaluator for: namespaces

	I0520 15:09:38.187471       1 alloc.go:330] "allocated clusterIPs" service="kubernetes-dashboard/kubernetes-dashboard" clusterIPs=map[IPv4:10.100.88.188]

	I0520 15:09:38.220498       1 alloc.go:330] "allocated clusterIPs" service="kubernetes-dashboard/dashboard-metrics-scraper" clusterIPs=map[IPv4:10.98.147.121]

	* 

	* ==> kube-controller-manager [417f084c3c94] <==

	* I0520 15:08:39.696896       1 event.go:307] "Event occurred" object="default/hello-node" fieldPath="" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set hello-node-7b684b55f9 to 1"

	I0520 15:08:39.707065       1 event.go:307] "Event occurred" object="default/hello-node-7b684b55f9" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: hello-node-7b684b55f9-szz9k"

	I0520 15:08:58.432233       1 event.go:307] "Event occurred" object="default/myclaim" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="waiting for a volume to be created, either by external provisioner \"k8s.io/minikube-hostpath\" or manually created by system administrator"

	I0520 15:09:03.275360       1 event.go:307] "Event occurred" object="default/hello-node-connect" fieldPath="" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set hello-node-connect-58d66798bb to 1"

	I0520 15:09:03.278349       1 event.go:307] "Event occurred" object="default/hello-node-connect-58d66798bb" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: hello-node-connect-58d66798bb-rszsd"

	I0520 15:09:38.145188       1 event.go:307] "Event occurred" object="kubernetes-dashboard/dashboard-metrics-scraper" fieldPath="" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set dashboard-metrics-scraper-5dd9cbfd69 to 1"

	I0520 15:09:38.150497       1 event.go:307] "Event occurred" object="kubernetes-dashboard/dashboard-metrics-scraper-5dd9cbfd69" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"dashboard-metrics-scraper-5dd9cbfd69-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found"

	E0520 15:09:38.153299       1 replica_set.go:544] sync "kubernetes-dashboard/dashboard-metrics-scraper-5dd9cbfd69" failed with pods "dashboard-metrics-scraper-5dd9cbfd69-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I0520 15:09:38.156737       1 event.go:307] "Event occurred" object="kubernetes-dashboard/kubernetes-dashboard" fieldPath="" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set kubernetes-dashboard-5c5cfc8747 to 1"

	E0520 15:09:38.158643       1 replica_set.go:544] sync "kubernetes-dashboard/dashboard-metrics-scraper-5dd9cbfd69" failed with pods "dashboard-metrics-scraper-5dd9cbfd69-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I0520 15:09:38.158725       1 event.go:307] "Event occurred" object="kubernetes-dashboard/dashboard-metrics-scraper-5dd9cbfd69" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"dashboard-metrics-scraper-5dd9cbfd69-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found"

	E0520 15:09:38.161499       1 replica_set.go:544] sync "kubernetes-dashboard/dashboard-metrics-scraper-5dd9cbfd69" failed with pods "dashboard-metrics-scraper-5dd9cbfd69-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I0520 15:09:38.161831       1 event.go:307] "Event occurred" object="kubernetes-dashboard/kubernetes-dashboard-5c5cfc8747" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"kubernetes-dashboard-5c5cfc8747-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found"

	I0520 15:09:38.161864       1 event.go:307] "Event occurred" object="kubernetes-dashboard/dashboard-metrics-scraper-5dd9cbfd69" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"dashboard-metrics-scraper-5dd9cbfd69-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found"

	E0520 15:09:38.164413       1 replica_set.go:544] sync "kubernetes-dashboard/kubernetes-dashboard-5c5cfc8747" failed with pods "kubernetes-dashboard-5c5cfc8747-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	E0520 15:09:38.167313       1 replica_set.go:544] sync "kubernetes-dashboard/kubernetes-dashboard-5c5cfc8747" failed with pods "kubernetes-dashboard-5c5cfc8747-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I0520 15:09:38.167420       1 event.go:307] "Event occurred" object="kubernetes-dashboard/kubernetes-dashboard-5c5cfc8747" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"kubernetes-dashboard-5c5cfc8747-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found"

	E0520 15:09:38.171307       1 replica_set.go:544] sync "kubernetes-dashboard/dashboard-metrics-scraper-5dd9cbfd69" failed with pods "dashboard-metrics-scraper-5dd9cbfd69-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	E0520 15:09:38.171317       1 replica_set.go:544] sync "kubernetes-dashboard/kubernetes-dashboard-5c5cfc8747" failed with pods "kubernetes-dashboard-5c5cfc8747-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I0520 15:09:38.171331       1 event.go:307] "Event occurred" object="kubernetes-dashboard/dashboard-metrics-scraper-5dd9cbfd69" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"dashboard-metrics-scraper-5dd9cbfd69-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found"

	I0520 15:09:38.171451       1 event.go:307] "Event occurred" object="kubernetes-dashboard/kubernetes-dashboard-5c5cfc8747" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"kubernetes-dashboard-5c5cfc8747-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found"

	I0520 15:09:38.203383       1 event.go:307] "Event occurred" object="kubernetes-dashboard/kubernetes-dashboard-5c5cfc8747" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kubernetes-dashboard-5c5cfc8747-77j67"

	I0520 15:09:38.233172       1 event.go:307] "Event occurred" object="kubernetes-dashboard/dashboard-metrics-scraper-5dd9cbfd69" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: dashboard-metrics-scraper-5dd9cbfd69-nzh6s"

	W0520 15:09:38.242663       1 endpointslice_controller.go:297] Error syncing endpoint slices for service "kubernetes-dashboard/dashboard-metrics-scraper", retrying. Error: EndpointSlice informer cache is out of date

	I0520 15:09:38.252396       1 event.go:307] "Event occurred" object="dashboard-metrics-scraper" fieldPath="" kind="Endpoints" apiVersion="v1" type="Warning" reason="FailedToCreateEndpoint" message="Failed to create endpoint for service kubernetes-dashboard/dashboard-metrics-scraper: endpoints \"dashboard-metrics-scraper\" already exists"

	* 

	* ==> kube-controller-manager [59532f881219] <==

	* I0520 15:07:26.127065       1 range_allocator.go:178] "Starting range CIDR allocator"

	I0520 15:07:26.127105       1 shared_informer.go:311] Waiting for caches to sync for cidrallocator

	I0520 15:07:26.127125       1 shared_informer.go:318] Caches are synced for cidrallocator

	I0520 15:07:26.129347       1 shared_informer.go:318] Caches are synced for ClusterRoleAggregator

	I0520 15:07:26.131177       1 shared_informer.go:318] Caches are synced for deployment

	I0520 15:07:26.131470       1 shared_informer.go:318] Caches are synced for TTL

	I0520 15:07:26.137258       1 shared_informer.go:318] Caches are synced for endpoint_slice

	I0520 15:07:26.138356       1 shared_informer.go:318] Caches are synced for daemon sets

	I0520 15:07:26.143926       1 shared_informer.go:318] Caches are synced for PVC protection

	I0520 15:07:26.146958       1 shared_informer.go:318] Caches are synced for ephemeral

	I0520 15:07:26.148008       1 shared_informer.go:318] Caches are synced for ReplicationController

	I0520 15:07:26.160631       1 shared_informer.go:318] Caches are synced for disruption

	I0520 15:07:26.162818       1 shared_informer.go:318] Caches are synced for stateful set

	I0520 15:07:26.167355       1 shared_informer.go:318] Caches are synced for certificate-csrsigning-legacy-unknown

	I0520 15:07:26.234356       1 shared_informer.go:318] Caches are synced for attach detach

	I0520 15:07:26.254697       1 shared_informer.go:318] Caches are synced for namespace

	I0520 15:07:26.289429       1 shared_informer.go:318] Caches are synced for service account

	I0520 15:07:26.670820       1 shared_informer.go:318] Caches are synced for resource quota

	I0520 15:07:26.671926       1 shared_informer.go:318] Caches are synced for garbage collector

	I0520 15:07:26.675050       1 shared_informer.go:318] Caches are synced for garbage collector

	I0520 15:07:26.675066       1 garbagecollector.go:166] "All resource monitors have synced. Proceeding to collect garbage"

	I0520 15:07:26.692406       1 shared_informer.go:318] Caches are synced for cronjob

	I0520 15:07:26.701004       1 shared_informer.go:318] Caches are synced for resource quota

	I0520 15:07:26.742276       1 shared_informer.go:318] Caches are synced for job

	I0520 15:07:26.745354       1 shared_informer.go:318] Caches are synced for TTL after finished

	* 

	* ==> kube-proxy [2821a7d42f0a] <==

	* I0520 15:08:17.991617       1 node.go:141] Successfully retrieved node IP: 192.168.105.4

	I0520 15:08:17.991655       1 server_others.go:110] "Detected node IP" address="192.168.105.4"

	I0520 15:08:17.991665       1 server_others.go:551] "Using iptables proxy"

	I0520 15:08:18.029175       1 server_others.go:176] "kube-proxy running in single-stack mode: secondary ipFamily is not supported" ipFamily=IPv6

	I0520 15:08:18.029224       1 server_others.go:190] "Using iptables Proxier"

	I0520 15:08:18.029637       1 proxier.go:253] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"

	I0520 15:08:18.030813       1 server.go:657] "Version info" version="v1.27.2"

	I0520 15:08:18.031017       1 server.go:659] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0520 15:08:18.031375       1 config.go:188] "Starting service config controller"

	I0520 15:08:18.031388       1 shared_informer.go:311] Waiting for caches to sync for service config

	I0520 15:08:18.031399       1 config.go:97] "Starting endpoint slice config controller"

	I0520 15:08:18.031400       1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config

	I0520 15:08:18.033860       1 config.go:315] "Starting node config controller"

	I0520 15:08:18.033866       1 shared_informer.go:311] Waiting for caches to sync for node config

	I0520 15:08:18.131633       1 shared_informer.go:318] Caches are synced for endpoint slice config

	I0520 15:08:18.131633       1 shared_informer.go:318] Caches are synced for service config

	I0520 15:08:18.133891       1 shared_informer.go:318] Caches are synced for node config

	* 

	* ==> kube-proxy [b6f8932e5773] <==

	* I0520 15:07:13.987986       1 node.go:141] Successfully retrieved node IP: 192.168.105.4

	I0520 15:07:13.988029       1 server_others.go:110] "Detected node IP" address="192.168.105.4"

	I0520 15:07:13.988042       1 server_others.go:551] "Using iptables proxy"

	I0520 15:07:13.995997       1 server_others.go:176] "kube-proxy running in single-stack mode: secondary ipFamily is not supported" ipFamily=IPv6

	I0520 15:07:13.996007       1 server_others.go:190] "Using iptables Proxier"

	I0520 15:07:13.996019       1 proxier.go:253] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"

	I0520 15:07:13.996184       1 server.go:657] "Version info" version="v1.27.2"

	I0520 15:07:13.996189       1 server.go:659] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0520 15:07:13.996470       1 config.go:188] "Starting service config controller"

	I0520 15:07:13.996482       1 shared_informer.go:311] Waiting for caches to sync for service config

	I0520 15:07:13.996522       1 config.go:97] "Starting endpoint slice config controller"

	I0520 15:07:13.996525       1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config

	I0520 15:07:13.996724       1 config.go:315] "Starting node config controller"

	I0520 15:07:13.996727       1 shared_informer.go:311] Waiting for caches to sync for node config

	I0520 15:07:14.102511       1 shared_informer.go:318] Caches are synced for node config

	I0520 15:07:14.106485       1 shared_informer.go:318] Caches are synced for service config

	I0520 15:07:14.106720       1 shared_informer.go:318] Caches are synced for endpoint slice config

	* 

	* ==> kube-scheduler [d0c182e9138f] <==

	* I0520 15:08:16.062588       1 serving.go:348] Generated self-signed cert in-memory

	W0520 15:08:17.215098       1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'

	W0520 15:08:17.215180       1 authentication.go:368] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"

	W0520 15:08:17.215217       1 authentication.go:369] Continuing without authentication configuration. This may treat all requests as anonymous.

	W0520 15:08:17.215236       1 authentication.go:370] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false

	I0520 15:08:17.239060       1 server.go:154] "Starting Kubernetes Scheduler" version="v1.27.2"

	I0520 15:08:17.239154       1 server.go:156] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0520 15:08:17.240195       1 secure_serving.go:210] Serving securely on 127.0.0.1:10259

	I0520 15:08:17.242506       1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"

	I0520 15:08:17.242540       1 shared_informer.go:311] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0520 15:08:17.242561       1 tlsconfig.go:240] "Starting DynamicServingCertificateController"

	I0520 15:08:17.343394       1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	* 

	* ==> kube-scheduler [f81fed79a1c2] <==

	* I0520 15:07:28.744945       1 serving.go:348] Generated self-signed cert in-memory

	I0520 15:07:29.000549       1 server.go:154] "Starting Kubernetes Scheduler" version="v1.27.2"

	I0520 15:07:29.000563       1 server.go:156] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0520 15:07:29.002157       1 requestheader_controller.go:169] Starting RequestHeaderAuthRequestController

	I0520 15:07:29.002195       1 shared_informer.go:311] Waiting for caches to sync for RequestHeaderAuthRequestController

	I0520 15:07:29.002243       1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"

	I0520 15:07:29.002256       1 shared_informer.go:311] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0520 15:07:29.002271       1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"

	I0520 15:07:29.002290       1 shared_informer.go:311] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file

	I0520 15:07:29.002581       1 secure_serving.go:210] Serving securely on 127.0.0.1:10259

	I0520 15:07:29.002633       1 tlsconfig.go:240] "Starting DynamicServingCertificateController"

	I0520 15:07:29.103058       1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file

	I0520 15:07:29.103102       1 shared_informer.go:318] Caches are synced for RequestHeaderAuthRequestController

	I0520 15:07:29.103112       1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0520 15:07:56.149160       1 secure_serving.go:255] Stopped listening on 127.0.0.1:10259

	I0520 15:07:56.149176       1 tlsconfig.go:255] "Shutting down DynamicServingCertificateController"

	E0520 15:07:56.149236       1 scheduling_queue.go:1135] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

	E0520 15:07:56.149257       1 run.go:74] "command failed" err="finished without leader elect"

	* 

	* ==> kubelet <==

	* -- Journal begins at Sat 2023-05-20 15:06:17 UTC, ends at Sat 2023-05-20 15:09:39 UTC. --

	May 20 15:09:22 functional-537000 kubelet[9743]: I0520 15:09:22.738684    9743 reconciler_common.go:172] "operationExecutor.UnmountVolume started for volume \"test-volume\" (UniqueName: \"kubernetes.io/host-path/7013467d-4e9d-4eff-aa16-d4b40efaab49-test-volume\") pod \"7013467d-4e9d-4eff-aa16-d4b40efaab49\" (UID: \"7013467d-4e9d-4eff-aa16-d4b40efaab49\") "

	May 20 15:09:22 functional-537000 kubelet[9743]: I0520 15:09:22.738734    9743 reconciler_common.go:172] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6vbz\" (UniqueName: \"kubernetes.io/projected/7013467d-4e9d-4eff-aa16-d4b40efaab49-kube-api-access-q6vbz\") pod \"7013467d-4e9d-4eff-aa16-d4b40efaab49\" (UID: \"7013467d-4e9d-4eff-aa16-d4b40efaab49\") "

	May 20 15:09:22 functional-537000 kubelet[9743]: I0520 15:09:22.739037    9743 operation_generator.go:878] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/7013467d-4e9d-4eff-aa16-d4b40efaab49-test-volume" (OuterVolumeSpecName: "test-volume") pod "7013467d-4e9d-4eff-aa16-d4b40efaab49" (UID: "7013467d-4e9d-4eff-aa16-d4b40efaab49"). InnerVolumeSpecName "test-volume". PluginName "kubernetes.io/host-path", VolumeGidValue ""

	May 20 15:09:22 functional-537000 kubelet[9743]: I0520 15:09:22.742541    9743 operation_generator.go:878] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7013467d-4e9d-4eff-aa16-d4b40efaab49-kube-api-access-q6vbz" (OuterVolumeSpecName: "kube-api-access-q6vbz") pod "7013467d-4e9d-4eff-aa16-d4b40efaab49" (UID: "7013467d-4e9d-4eff-aa16-d4b40efaab49"). InnerVolumeSpecName "kube-api-access-q6vbz". PluginName "kubernetes.io/projected", VolumeGidValue ""

	May 20 15:09:22 functional-537000 kubelet[9743]: I0520 15:09:22.839782    9743 reconciler_common.go:300] "Volume detached for volume \"kube-api-access-q6vbz\" (UniqueName: \"kubernetes.io/projected/7013467d-4e9d-4eff-aa16-d4b40efaab49-kube-api-access-q6vbz\") on node \"functional-537000\" DevicePath \"\""

	May 20 15:09:22 functional-537000 kubelet[9743]: I0520 15:09:22.839810    9743 reconciler_common.go:300] "Volume detached for volume \"test-volume\" (UniqueName: \"kubernetes.io/host-path/7013467d-4e9d-4eff-aa16-d4b40efaab49-test-volume\") on node \"functional-537000\" DevicePath \"\""

	May 20 15:09:23 functional-537000 kubelet[9743]: I0520 15:09:23.437551    9743 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0d264daa1da04d46822b1ae6710ea60591bcdafc1bff25b23c1efa9eadb9e771"

	May 20 15:09:26 functional-537000 kubelet[9743]: I0520 15:09:26.455929    9743 scope.go:115] "RemoveContainer" containerID="e0ea0f358f93ae0c781a2a7b0baaa2883fe89f18f604e354afdd5ec686b6b8f2"

	May 20 15:09:27 functional-537000 kubelet[9743]: I0520 15:09:27.507906    9743 scope.go:115] "RemoveContainer" containerID="e0ea0f358f93ae0c781a2a7b0baaa2883fe89f18f604e354afdd5ec686b6b8f2"

	May 20 15:09:27 functional-537000 kubelet[9743]: I0520 15:09:27.508175    9743 scope.go:115] "RemoveContainer" containerID="c876f19ce53ae4f3abf705471757d8d807671a0b17f1d5520c3d5ce62ad980e9"

	May 20 15:09:27 functional-537000 kubelet[9743]: E0520 15:09:27.508307    9743 pod_workers.go:1294] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echoserver-arm\" with CrashLoopBackOff: \"back-off 40s restarting failed container=echoserver-arm pod=hello-node-7b684b55f9-szz9k_default(d7081496-1133-42e4-828f-e5f5f932e285)\"" pod="default/hello-node-7b684b55f9-szz9k" podUID=d7081496-1133-42e4-828f-e5f5f932e285

	May 20 15:09:32 functional-537000 kubelet[9743]: I0520 15:09:32.453896    9743 scope.go:115] "RemoveContainer" containerID="ac4e7966822714724c7ee64fd3ff51261b37fd67c2942ed2835f3c6bdf79503c"

	May 20 15:09:32 functional-537000 kubelet[9743]: E0520 15:09:32.454790    9743 pod_workers.go:1294] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echoserver-arm\" with CrashLoopBackOff: \"back-off 20s restarting failed container=echoserver-arm pod=hello-node-connect-58d66798bb-rszsd_default(d5deaded-35e0-4666-ae93-d2089778768d)\"" pod="default/hello-node-connect-58d66798bb-rszsd" podUID=d5deaded-35e0-4666-ae93-d2089778768d

	May 20 15:09:38 functional-537000 kubelet[9743]: I0520 15:09:38.222317    9743 topology_manager.go:212] "Topology Admit Handler"

	May 20 15:09:38 functional-537000 kubelet[9743]: E0520 15:09:38.222364    9743 cpu_manager.go:395] "RemoveStaleState: removing container" podUID="7013467d-4e9d-4eff-aa16-d4b40efaab49" containerName="mount-munger"

	May 20 15:09:38 functional-537000 kubelet[9743]: I0520 15:09:38.222381    9743 memory_manager.go:346] "RemoveStaleState removing state" podUID="7013467d-4e9d-4eff-aa16-d4b40efaab49" containerName="mount-munger"

	May 20 15:09:38 functional-537000 kubelet[9743]: I0520 15:09:38.239329    9743 topology_manager.go:212] "Topology Admit Handler"

	May 20 15:09:38 functional-537000 kubelet[9743]: I0520 15:09:38.407215    9743 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-volume\" (UniqueName: \"kubernetes.io/empty-dir/99cb3091-f060-4a46-85e7-c7d375c2245d-tmp-volume\") pod \"kubernetes-dashboard-5c5cfc8747-77j67\" (UID: \"99cb3091-f060-4a46-85e7-c7d375c2245d\") " pod="kubernetes-dashboard/kubernetes-dashboard-5c5cfc8747-77j67"

	May 20 15:09:38 functional-537000 kubelet[9743]: I0520 15:09:38.407250    9743 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7j2p\" (UniqueName: \"kubernetes.io/projected/5e5057ff-7ee9-407c-989b-bc103b3630f7-kube-api-access-b7j2p\") pod \"dashboard-metrics-scraper-5dd9cbfd69-nzh6s\" (UID: \"5e5057ff-7ee9-407c-989b-bc103b3630f7\") " pod="kubernetes-dashboard/dashboard-metrics-scraper-5dd9cbfd69-nzh6s"

	May 20 15:09:38 functional-537000 kubelet[9743]: I0520 15:09:38.407265    9743 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-265ht\" (UniqueName: \"kubernetes.io/projected/99cb3091-f060-4a46-85e7-c7d375c2245d-kube-api-access-265ht\") pod \"kubernetes-dashboard-5c5cfc8747-77j67\" (UID: \"99cb3091-f060-4a46-85e7-c7d375c2245d\") " pod="kubernetes-dashboard/kubernetes-dashboard-5c5cfc8747-77j67"

	May 20 15:09:38 functional-537000 kubelet[9743]: I0520 15:09:38.407279    9743 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e5057ff-7ee9-407c-989b-bc103b3630f7-tmp-volume\") pod \"dashboard-metrics-scraper-5dd9cbfd69-nzh6s\" (UID: \"5e5057ff-7ee9-407c-989b-bc103b3630f7\") " pod="kubernetes-dashboard/dashboard-metrics-scraper-5dd9cbfd69-nzh6s"

	May 20 15:09:38 functional-537000 kubelet[9743]: I0520 15:09:38.452513    9743 scope.go:115] "RemoveContainer" containerID="c876f19ce53ae4f3abf705471757d8d807671a0b17f1d5520c3d5ce62ad980e9"

	May 20 15:09:38 functional-537000 kubelet[9743]: E0520 15:09:38.452678    9743 pod_workers.go:1294] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echoserver-arm\" with CrashLoopBackOff: \"back-off 40s restarting failed container=echoserver-arm pod=hello-node-7b684b55f9-szz9k_default(d7081496-1133-42e4-828f-e5f5f932e285)\"" pod="default/hello-node-7b684b55f9-szz9k" podUID=d7081496-1133-42e4-828f-e5f5f932e285

	May 20 15:09:38 functional-537000 kubelet[9743]: I0520 15:09:38.787359    9743 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="88b6f35ee17ffaa7ea20704480032a3a13ce7dfbc884bb33a6ad9965e1cd9552"

	May 20 15:09:38 functional-537000 kubelet[9743]: I0520 15:09:38.789319    9743 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2721b9788d536f2b83af2873bd5432118160202c87fa21c023d465859c710d24"

	* 

	* ==> storage-provisioner [066b7686f533] <==

	* I0520 15:08:18.033138       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0520 15:08:18.043833       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0520 15:08:18.043901       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I0520 15:08:35.443470       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0520 15:08:35.443989       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_functional-537000_b012db52-55ee-43ea-b615-507bcc2d26d0!

	I0520 15:08:35.447730       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"dabb9ffd-171d-4e42-aae9-e1379af2f274", APIVersion:"v1", ResourceVersion:"617", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' functional-537000_b012db52-55ee-43ea-b615-507bcc2d26d0 became leader

	I0520 15:08:35.545694       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_functional-537000_b012db52-55ee-43ea-b615-507bcc2d26d0!

	I0520 15:08:58.432232       1 controller.go:1332] provision "default/myclaim" class "standard": started

	I0520 15:08:58.432312       1 storage_provisioner.go:61] Provisioning volume {&StorageClass{ObjectMeta:{standard    b079cf39-f185-4032-b825-02a8fa54ef51 345 0 2023-05-20 15:06:48 +0000 UTC <nil> <nil> map[addonmanager.kubernetes.io/mode:EnsureExists] map[kubectl.kubernetes.io/last-applied-configuration:{"apiVersion":"storage.k8s.io/v1","kind":"StorageClass","metadata":{"annotations":{"storageclass.kubernetes.io/is-default-class":"true"},"labels":{"addonmanager.kubernetes.io/mode":"EnsureExists"},"name":"standard"},"provisioner":"k8s.io/minikube-hostpath"}

	 storageclass.kubernetes.io/is-default-class:true] [] []  [{kubectl-client-side-apply Update storage.k8s.io/v1 2023-05-20 15:06:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubectl.kubernetes.io/last-applied-configuration":{},"f:storageclass.kubernetes.io/is-default-class":{}},"f:labels":{".":{},"f:addonmanager.kubernetes.io/mode":{}}},"f:provisioner":{},"f:reclaimPolicy":{},"f:volumeBindingMode":{}}}]},Provisioner:k8s.io/minikube-hostpath,Parameters:map[string]string{},ReclaimPolicy:*Delete,MountOptions:[],AllowVolumeExpansion:nil,VolumeBindingMode:*Immediate,AllowedTopologies:[]TopologySelectorTerm{},} pvc-62ed2ac1-c3c9-42cd-9c76-ce8ea219dcb1 &PersistentVolumeClaim{ObjectMeta:{myclaim  default  62ed2ac1-c3c9-42cd-9c76-ce8ea219dcb1 690 0 2023-05-20 15:08:58 +0000 UTC <nil> <nil> map[] map[kubectl.kubernetes.io/last-applied-configuration:{"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"name":"myclaim","namespace":"default"},"spec":{"accessModes":["Rea

dWriteOnce"],"resources":{"requests":{"storage":"500Mi"}},"volumeMode":"Filesystem"}}

	 volume.beta.kubernetes.io/storage-provisioner:k8s.io/minikube-hostpath volume.kubernetes.io/storage-provisioner:k8s.io/minikube-hostpath] [] [kubernetes.io/pvc-protection]  [{kube-controller-manager Update v1 2023-05-20 15:08:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:volume.beta.kubernetes.io/storage-provisioner":{},"f:volume.kubernetes.io/storage-provisioner":{}}}}} {kubectl-client-side-apply Update v1 2023-05-20 15:08:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubectl.kubernetes.io/last-applied-configuration":{}}},"f:spec":{"f:accessModes":{},"f:resources":{"f:requests":{".":{},"f:storage":{}}},"f:volumeMode":{}}}}]},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{524288000 0} {<nil>} 500Mi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*standard,VolumeMode:*Filesystem,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:

ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},},} nil} to /tmp/hostpath-provisioner/default/myclaim

	I0520 15:08:58.432859       1 controller.go:1439] provision "default/myclaim" class "standard": volume "pvc-62ed2ac1-c3c9-42cd-9c76-ce8ea219dcb1" provisioned

	I0520 15:08:58.432879       1 controller.go:1456] provision "default/myclaim" class "standard": succeeded

	I0520 15:08:58.432909       1 volume_store.go:212] Trying to save persistentvolume "pvc-62ed2ac1-c3c9-42cd-9c76-ce8ea219dcb1"

	I0520 15:08:58.433622       1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"myclaim", UID:"62ed2ac1-c3c9-42cd-9c76-ce8ea219dcb1", APIVersion:"v1", ResourceVersion:"690", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/myclaim"

	I0520 15:08:58.437334       1 volume_store.go:219] persistentvolume "pvc-62ed2ac1-c3c9-42cd-9c76-ce8ea219dcb1" saved

	I0520 15:08:58.437424       1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"myclaim", UID:"62ed2ac1-c3c9-42cd-9c76-ce8ea219dcb1", APIVersion:"v1", ResourceVersion:"690", FieldPath:""}): type: 'Normal' reason: 'ProvisioningSucceeded' Successfully provisioned volume pvc-62ed2ac1-c3c9-42cd-9c76-ce8ea219dcb1

	* 

	* ==> storage-provisioner [16ac5269fc99] <==

	* I0520 15:07:12.017895       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0520 15:07:13.978877       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0520 15:07:13.978900       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I0520 15:07:31.394517       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0520 15:07:31.395523       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_functional-537000_24c74b04-0438-4f60-92c0-05d99136db63!

	I0520 15:07:31.396644       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"dabb9ffd-171d-4e42-aae9-e1379af2f274", APIVersion:"v1", ResourceVersion:"504", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' functional-537000_24c74b04-0438-4f60-92c0-05d99136db63 became leader

	I0520 15:07:31.496363       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_functional-537000_24c74b04-0438-4f60-92c0-05d99136db63!

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.APIServer}} -p functional-537000 -n functional-537000

helpers_test.go:261: (dbg) Run:  kubectl --context functional-537000 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:272: non-running pods: busybox-mount dashboard-metrics-scraper-5dd9cbfd69-nzh6s kubernetes-dashboard-5c5cfc8747-77j67

helpers_test.go:274: ======> post-mortem[TestFunctional/parallel/ServiceCmdConnect]: describe non-running pods <======

helpers_test.go:277: (dbg) Run:  kubectl --context functional-537000 describe pod busybox-mount dashboard-metrics-scraper-5dd9cbfd69-nzh6s kubernetes-dashboard-5c5cfc8747-77j67

helpers_test.go:277: (dbg) Non-zero exit: kubectl --context functional-537000 describe pod busybox-mount dashboard-metrics-scraper-5dd9cbfd69-nzh6s kubernetes-dashboard-5c5cfc8747-77j67: exit status 1 (40.272ms)

-- stdout --

	Name:             busybox-mount

	Namespace:        default

	Priority:         0

	Service Account:  default

	Node:             functional-537000/192.168.105.4

	Start Time:       Sat, 20 May 2023 08:09:17 -0700

	Labels:           integration-test=busybox-mount

	Annotations:      <none>

	Status:           Succeeded

	IP:               10.244.0.11

	IPs:

	  IP:  10.244.0.11

	Containers:

	  mount-munger:

	    Container ID:  docker://4942b89873a0b6d0158862a4b9d3b7156499999d77b131688dd5e9665730caad

	    Image:         gcr.io/k8s-minikube/busybox:1.28.4-glibc

	    Image ID:      docker-pullable://gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e

	    Port:          <none>

	    Host Port:     <none>

	    Command:

	      /bin/sh

	      -c

	      --

	    Args:

	      cat /mount-9p/created-by-test; echo test > /mount-9p/created-by-pod; rm /mount-9p/created-by-test-removed-by-pod; echo test > /mount-9p/created-by-pod-removed-by-test date >> /mount-9p/pod-dates

	    State:          Terminated

	      Reason:       Completed

	      Exit Code:    0

	      Started:      Sat, 20 May 2023 08:09:20 -0700

	      Finished:     Sat, 20 May 2023 08:09:20 -0700

	    Ready:          False

	    Restart Count:  0

	    Environment:    <none>

	    Mounts:

	      /mount-9p from test-volume (rw)

	      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-q6vbz (ro)

	Conditions:

	  Type              Status

	  Initialized       True 

	  Ready             False 

	  ContainersReady   False 

	  PodScheduled      True 

	Volumes:

	  test-volume:

	    Type:          HostPath (bare host directory volume)

	    Path:          /mount-9p

	    HostPathType:  

	  kube-api-access-q6vbz:

	    Type:                    Projected (a volume that contains injected data from multiple sources)

	    TokenExpirationSeconds:  3607

	    ConfigMapName:           kube-root-ca.crt

	    ConfigMapOptional:       <nil>

	    DownwardAPI:             true

	QoS Class:                   BestEffort

	Node-Selectors:              <none>

	Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

	                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

	Events:

	  Type    Reason     Age   From               Message

	  ----    ------     ----  ----               -------

	  Normal  Scheduled  21s   default-scheduler  Successfully assigned default/busybox-mount to functional-537000

	  Normal  Pulling    21s   kubelet            Pulling image "gcr.io/k8s-minikube/busybox:1.28.4-glibc"

	  Normal  Pulled     19s   kubelet            Successfully pulled image "gcr.io/k8s-minikube/busybox:1.28.4-glibc" in 2.07770742s (2.077711004s including waiting)

	  Normal  Created    19s   kubelet            Created container mount-munger

	  Normal  Started    19s   kubelet            Started container mount-munger

-- /stdout --

** stderr ** 

	Error from server (NotFound): pods "dashboard-metrics-scraper-5dd9cbfd69-nzh6s" not found

	Error from server (NotFound): pods "kubernetes-dashboard-5c5cfc8747-77j67" not found

** /stderr **

helpers_test.go:279: kubectl --context functional-537000 describe pod busybox-mount dashboard-metrics-scraper-5dd9cbfd69-nzh6s kubernetes-dashboard-5c5cfc8747-77j67: exit status 1

--- FAIL: TestFunctional/parallel/ServiceCmdConnect (36.62s)

=== RUN   TestImageBuild/serial/BuildWithBuildArg

image_test.go:99: (dbg) Run:  out/minikube-darwin-arm64 image build -t aaa:latest --build-opt=build-arg=ENV_A=test_env_str --build-opt=no-cache ./testdata/image-build/test-arg -p image-027000

image_test.go:105: failed to pass build-args with args: "out/minikube-darwin-arm64 image build -t aaa:latest --build-opt=build-arg=ENV_A=test_env_str --build-opt=no-cache ./testdata/image-build/test-arg -p image-027000" : 

-- stdout --

	Sending build context to Docker daemon  2.048kB

	Step 1/5 : FROM gcr.io/google-containers/alpine-with-bash:1.0

	 ---> 822c13824dc2

	Step 2/5 : ARG ENV_A

	 ---> [Warning] The requested image's platform (linux/amd64) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested

	 ---> Running in d518566dba52

	Removing intermediate container d518566dba52

	 ---> 000d87db330d

	Step 3/5 : ARG ENV_B

	 ---> [Warning] The requested image's platform (linux/amd64) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested

	 ---> Running in 5557af3c6136

	Removing intermediate container 5557af3c6136

	 ---> 0c1bec15807d

	Step 4/5 : RUN echo "test-build-arg" $ENV_A $ENV_B

	 ---> [Warning] The requested image's platform (linux/amd64) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested

	 ---> Running in 84ffe0fcefdb

	exec /bin/sh: exec format error

	

-- /stdout --

** stderr ** 

	The command '/bin/sh -c echo "test-build-arg" $ENV_A $ENV_B' returned a non-zero code: 1

** /stderr **

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p image-027000 -n image-027000

helpers_test.go:244: <<< TestImageBuild/serial/BuildWithBuildArg FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestImageBuild/serial/BuildWithBuildArg]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-darwin-arm64 -p image-027000 logs -n 25

helpers_test.go:252: TestImageBuild/serial/BuildWithBuildArg logs: 

-- stdout --

	* 

	* ==> Audit <==

	* |----------------|------------------------------------------|-------------------|---------|---------|---------------------|---------------------|

	|    Command     |                   Args                   |      Profile      |  User   | Version |     Start Time      |      End Time       |

	|----------------|------------------------------------------|-------------------|---------|---------|---------------------|---------------------|

	| ssh            | functional-537000 ssh findmnt            | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT |                     |

	|                | -T /mount3                               |                   |         |         |                     |                     |

	| ssh            | functional-537000 ssh findmnt            | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT | 20 May 23 08:09 PDT |

	|                | -T /mount1                               |                   |         |         |                     |                     |

	| ssh            | functional-537000 ssh findmnt            | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT | 20 May 23 08:09 PDT |

	|                | -T /mount2                               |                   |         |         |                     |                     |

	| ssh            | functional-537000 ssh findmnt            | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT |                     |

	|                | -T /mount3                               |                   |         |         |                     |                     |

	| ssh            | functional-537000 ssh findmnt            | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT | 20 May 23 08:09 PDT |

	|                | -T /mount1                               |                   |         |         |                     |                     |

	| ssh            | functional-537000 ssh findmnt            | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT | 20 May 23 08:09 PDT |

	|                | -T /mount2                               |                   |         |         |                     |                     |

	| ssh            | functional-537000 ssh findmnt            | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT |                     |

	|                | -T /mount3                               |                   |         |         |                     |                     |

	| start          | -p functional-537000                     | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT |                     |

	|                | --dry-run --memory                       |                   |         |         |                     |                     |

	|                | 250MB --alsologtostderr                  |                   |         |         |                     |                     |

	|                | --driver=qemu2                           |                   |         |         |                     |                     |

	| start          | -p functional-537000 --dry-run           | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT |                     |

	|                | --alsologtostderr -v=1                   |                   |         |         |                     |                     |

	|                | --driver=qemu2                           |                   |         |         |                     |                     |

	| start          | -p functional-537000                     | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT |                     |

	|                | --dry-run --memory                       |                   |         |         |                     |                     |

	|                | 250MB --alsologtostderr                  |                   |         |         |                     |                     |

	|                | --driver=qemu2                           |                   |         |         |                     |                     |

	| dashboard      | --url --port 36195                       | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT | 20 May 23 08:09 PDT |

	|                | -p functional-537000                     |                   |         |         |                     |                     |

	|                | --alsologtostderr -v=1                   |                   |         |         |                     |                     |

	| update-context | functional-537000                        | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT | 20 May 23 08:09 PDT |

	|                | update-context                           |                   |         |         |                     |                     |

	|                | --alsologtostderr -v=2                   |                   |         |         |                     |                     |

	| update-context | functional-537000                        | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT | 20 May 23 08:09 PDT |

	|                | update-context                           |                   |         |         |                     |                     |

	|                | --alsologtostderr -v=2                   |                   |         |         |                     |                     |

	| update-context | functional-537000                        | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT | 20 May 23 08:09 PDT |

	|                | update-context                           |                   |         |         |                     |                     |

	|                | --alsologtostderr -v=2                   |                   |         |         |                     |                     |

	| image          | functional-537000                        | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT | 20 May 23 08:09 PDT |

	|                | image ls --format short                  |                   |         |         |                     |                     |

	|                | --alsologtostderr                        |                   |         |         |                     |                     |

	| image          | functional-537000                        | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT | 20 May 23 08:09 PDT |

	|                | image ls --format yaml                   |                   |         |         |                     |                     |

	|                | --alsologtostderr                        |                   |         |         |                     |                     |

	| ssh            | functional-537000 ssh pgrep              | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT |                     |

	|                | buildkitd                                |                   |         |         |                     |                     |

	| image          | functional-537000 image build -t         | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT | 20 May 23 08:09 PDT |

	|                | localhost/my-image:functional-537000     |                   |         |         |                     |                     |

	|                | testdata/build --alsologtostderr         |                   |         |         |                     |                     |

	| image          | functional-537000 image ls               | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT | 20 May 23 08:09 PDT |

	| image          | functional-537000                        | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT | 20 May 23 08:09 PDT |

	|                | image ls --format json                   |                   |         |         |                     |                     |

	|                | --alsologtostderr                        |                   |         |         |                     |                     |

	| image          | functional-537000                        | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT | 20 May 23 08:09 PDT |

	|                | image ls --format table                  |                   |         |         |                     |                     |

	|                | --alsologtostderr                        |                   |         |         |                     |                     |

	| delete         | -p functional-537000                     | functional-537000 | jenkins | v1.30.1 | 20 May 23 08:09 PDT | 20 May 23 08:09 PDT |

	| start          | -p image-027000 --driver=qemu2           | image-027000      | jenkins | v1.30.1 | 20 May 23 08:09 PDT | 20 May 23 08:10 PDT |

	|                |                                          |                   |         |         |                     |                     |

	| image          | build -t aaa:latest                      | image-027000      | jenkins | v1.30.1 | 20 May 23 08:10 PDT | 20 May 23 08:10 PDT |

	|                | ./testdata/image-build/test-normal       |                   |         |         |                     |                     |

	|                | -p image-027000                          |                   |         |         |                     |                     |

	| image          | build -t aaa:latest                      | image-027000      | jenkins | v1.30.1 | 20 May 23 08:10 PDT | 20 May 23 08:10 PDT |

	|                | --build-opt=build-arg=ENV_A=test_env_str |                   |         |         |                     |                     |

	|                | --build-opt=no-cache                     |                   |         |         |                     |                     |

	|                | ./testdata/image-build/test-arg -p       |                   |         |         |                     |                     |

	|                | image-027000                             |                   |         |         |                     |                     |

	|----------------|------------------------------------------|-------------------|---------|---------|---------------------|---------------------|

	* 

	* ==> Last Start <==

	* Log file created at: 2023/05/20 08:09:47

	Running on machine: MacOS-M1-Agent-1

	Binary: Built with gc go1.20.4 for darwin/arm64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0520 08:09:47.427879    2351 out.go:296] Setting OutFile to fd 1 ...

	I0520 08:09:47.428031    2351 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0520 08:09:47.428033    2351 out.go:309] Setting ErrFile to fd 2...

	I0520 08:09:47.428035    2351 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0520 08:09:47.428103    2351 root.go:336] Updating PATH: /Users/jenkins/minikube-integration/16543-1012/.minikube/bin

	I0520 08:09:47.429195    2351 out.go:303] Setting JSON to false

	I0520 08:09:47.447280    2351 start.go:125] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":558,"bootTime":1684594829,"procs":442,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"13.3.1","kernelVersion":"22.4.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}

	W0520 08:09:47.447355    2351 start.go:133] gopshost.Virtualization returned error: not implemented yet

	I0520 08:09:47.451115    2351 out.go:177] * [image-027000] minikube v1.30.1 on Darwin 13.3.1 (arm64)

	I0520 08:09:47.455190    2351 out.go:177]   - MINIKUBE_LOCATION=16543

	I0520 08:09:47.455216    2351 notify.go:220] Checking for updates...

	I0520 08:09:47.462144    2351 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/16543-1012/kubeconfig

	I0520 08:09:47.465147    2351 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0520 08:09:47.468947    2351 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0520 08:09:47.471144    2351 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/16543-1012/.minikube

	I0520 08:09:47.474176    2351 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0520 08:09:47.477245    2351 driver.go:375] Setting default libvirt URI to qemu:///system

	I0520 08:09:47.481082    2351 out.go:177] * Using the qemu2 driver based on user configuration

	I0520 08:09:47.488216    2351 start.go:295] selected driver: qemu2

	I0520 08:09:47.488219    2351 start.go:870] validating driver "qemu2" against <nil>

	I0520 08:09:47.488225    2351 start.go:881] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0520 08:09:47.488285    2351 start_flags.go:305] no existing cluster config was found, will generate one from the flags 

	I0520 08:09:47.492112    2351 out.go:177] * Automatically selected the socket_vmnet network

	I0520 08:09:47.498499    2351 start_flags.go:382] Using suggested 4000MB memory alloc based on sys=16384MB, container=0MB

	I0520 08:09:47.498584    2351 start_flags.go:897] Wait components to verify : map[apiserver:true system_pods:true]

	I0520 08:09:47.498595    2351 cni.go:84] Creating CNI manager for ""

	I0520 08:09:47.498602    2351 cni.go:157] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0520 08:09:47.498606    2351 start_flags.go:314] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0520 08:09:47.498612    2351 start_flags.go:319] config:

	{Name:image-027000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684523789-16533@sha256:ed200ff6d686f303885e8aaf964442d08018856d63a8e23f7acdc068766ea82b Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.2 ClusterName:image-027000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRIS

ocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}

	I0520 08:09:47.498697    2351 iso.go:125] acquiring lock: {Name:mkf05a14b47e9b67445252fbb4917f3bcb37f054 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0520 08:09:47.506176    2351 out.go:177] * Starting control plane node image-027000 in cluster image-027000

	I0520 08:09:47.510191    2351 preload.go:132] Checking if preload exists for k8s version v1.27.2 and runtime docker

	I0520 08:09:47.510216    2351 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.2-docker-overlay2-arm64.tar.lz4

	I0520 08:09:47.510228    2351 cache.go:57] Caching tarball of preloaded images

	I0520 08:09:47.510310    2351 preload.go:174] Found /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0520 08:09:47.510318    2351 cache.go:60] Finished verifying existence of preloaded tar for  v1.27.2 on docker

	I0520 08:09:47.510537    2351 profile.go:148] Saving config to /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/image-027000/config.json ...

	I0520 08:09:47.510548    2351 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/image-027000/config.json: {Name:mkbb77569158ecf7ce79fae66462aa5d86033633 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0520 08:09:47.510763    2351 cache.go:195] Successfully downloaded all kic artifacts

	I0520 08:09:47.510772    2351 start.go:364] acquiring machines lock for image-027000: {Name:mk270c257f49033ffda3b70fea9b877c78314aa8 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0520 08:09:47.510802    2351 start.go:368] acquired machines lock for "image-027000" in 25.583µs

	I0520 08:09:47.510814    2351 start.go:93] Provisioning new machine with config: &{Name:image-027000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/16506/minikube-v1.30.1-1684174510-16506-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684523789-16533@sha256:ed200ff6d686f303885e8aaf964442d08018856d63a8e23f7acdc068766ea82b Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig

:{KubernetesVersion:v1.27.2 ClusterName:image-027000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: D

isableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:} &{Name: IP: Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0520 08:09:47.510836    2351 start.go:125] createHost starting for "" (driver="qemu2")

	I0520 08:09:47.518018    2351 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	I0520 08:09:47.541459    2351 start.go:159] libmachine.API.Create for "image-027000" (driver="qemu2")

	I0520 08:09:47.541495    2351 client.go:168] LocalClient.Create starting

	I0520 08:09:47.541550    2351 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/ca.pem

	I0520 08:09:47.541698    2351 main.go:141] libmachine: Decoding PEM data...

	I0520 08:09:47.541706    2351 main.go:141] libmachine: Parsing certificate...

	I0520 08:09:47.541754    2351 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/cert.pem

	I0520 08:09:47.541836    2351 main.go:141] libmachine: Decoding PEM data...

	I0520 08:09:47.541841    2351 main.go:141] libmachine: Parsing certificate...

	I0520 08:09:47.542116    2351 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/16543-1012/.minikube/cache/iso/arm64/minikube-v1.30.1-1684174510-16506-arm64.iso...

	I0520 08:09:48.112982    2351 main.go:141] libmachine: Creating SSH key...

	I0520 08:09:48.248600    2351 main.go:141] libmachine: Creating Disk image...

	I0520 08:09:48.248604    2351 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0520 08:09:48.248787    2351 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/image-027000/disk.qcow2.raw /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/image-027000/disk.qcow2

	I0520 08:09:48.264850    2351 main.go:141] libmachine: STDOUT: 

	I0520 08:09:48.264862    2351 main.go:141] libmachine: STDERR: 

	I0520 08:09:48.264910    2351 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/image-027000/disk.qcow2 +20000M

	I0520 08:09:48.271950    2351 main.go:141] libmachine: STDOUT: Image resized.

	I0520 08:09:48.271958    2351 main.go:141] libmachine: STDERR: 

	I0520 08:09:48.271975    2351 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/image-027000/disk.qcow2.raw and /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/image-027000/disk.qcow2

	I0520 08:09:48.271978    2351 main.go:141] libmachine: Starting QEMU VM...

	I0520 08:09:48.272015    2351 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt -cpu host -drive file=/opt/homebrew/Cellar/qemu/7.2.0/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 4000 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/image-027000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/image-027000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/image-027000/qemu.pid -device virtio-net-pci,netdev=net0,mac=ea:9f:53:ae:c6:fe -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/image-027000/disk.qcow2

	I0520 08:09:48.306594    2351 main.go:141] libmachine: STDOUT: 

	I0520 08:09:48.306611    2351 main.go:141] libmachine: STDERR: 

	I0520 08:09:48.306614    2351 main.go:141] libmachine: Attempt 0

	I0520 08:09:48.306626    2351 main.go:141] libmachine: Searching for ea:9f:53:ae:c6:fe in /var/db/dhcpd_leases ...

	I0520 08:09:48.306821    2351 main.go:141] libmachine: Found 3 entries in /var/db/dhcpd_leases!

	I0520 08:09:48.306839    2351 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.4 HWAddress:6:5b:64:76:26:39 ID:1,6:5b:64:76:26:39 Lease:0x646a3369}

	I0520 08:09:48.306855    2351 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.3 HWAddress:8a:69:5a:cb:74:51 ID:1,8a:69:5a:cb:74:51 Lease:0x6468e1dc}

	I0520 08:09:48.306860    2351 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:36:b1:60:c3:d2:35 ID:1,36:b1:60:c3:d2:35 Lease:0x646a3311}

	I0520 08:09:50.309046    2351 main.go:141] libmachine: Attempt 1

	I0520 08:09:50.309094    2351 main.go:141] libmachine: Searching for ea:9f:53:ae:c6:fe in /var/db/dhcpd_leases ...

	I0520 08:09:50.309491    2351 main.go:141] libmachine: Found 3 entries in /var/db/dhcpd_leases!

	I0520 08:09:50.309536    2351 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.4 HWAddress:6:5b:64:76:26:39 ID:1,6:5b:64:76:26:39 Lease:0x646a3369}

	I0520 08:09:50.309563    2351 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.3 HWAddress:8a:69:5a:cb:74:51 ID:1,8a:69:5a:cb:74:51 Lease:0x6468e1dc}

	I0520 08:09:50.309605    2351 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:36:b1:60:c3:d2:35 ID:1,36:b1:60:c3:d2:35 Lease:0x646a3311}

	I0520 08:09:52.311744    2351 main.go:141] libmachine: Attempt 2

	I0520 08:09:52.311758    2351 main.go:141] libmachine: Searching for ea:9f:53:ae:c6:fe in /var/db/dhcpd_leases ...

	I0520 08:09:52.311856    2351 main.go:141] libmachine: Found 3 entries in /var/db/dhcpd_leases!

	I0520 08:09:52.311866    2351 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.4 HWAddress:6:5b:64:76:26:39 ID:1,6:5b:64:76:26:39 Lease:0x646a3369}

	I0520 08:09:52.311871    2351 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.3 HWAddress:8a:69:5a:cb:74:51 ID:1,8a:69:5a:cb:74:51 Lease:0x6468e1dc}

	I0520 08:09:52.311875    2351 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:36:b1:60:c3:d2:35 ID:1,36:b1:60:c3:d2:35 Lease:0x646a3311}

	I0520 08:09:54.313897    2351 main.go:141] libmachine: Attempt 3

	I0520 08:09:54.313902    2351 main.go:141] libmachine: Searching for ea:9f:53:ae:c6:fe in /var/db/dhcpd_leases ...

	I0520 08:09:54.313948    2351 main.go:141] libmachine: Found 3 entries in /var/db/dhcpd_leases!

	I0520 08:09:54.313961    2351 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.4 HWAddress:6:5b:64:76:26:39 ID:1,6:5b:64:76:26:39 Lease:0x646a3369}

	I0520 08:09:54.313966    2351 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.3 HWAddress:8a:69:5a:cb:74:51 ID:1,8a:69:5a:cb:74:51 Lease:0x6468e1dc}

	I0520 08:09:54.313970    2351 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:36:b1:60:c3:d2:35 ID:1,36:b1:60:c3:d2:35 Lease:0x646a3311}

	I0520 08:09:56.315983    2351 main.go:141] libmachine: Attempt 4

	I0520 08:09:56.315988    2351 main.go:141] libmachine: Searching for ea:9f:53:ae:c6:fe in /var/db/dhcpd_leases ...

	I0520 08:09:56.316023    2351 main.go:141] libmachine: Found 3 entries in /var/db/dhcpd_leases!

	I0520 08:09:56.316029    2351 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.4 HWAddress:6:5b:64:76:26:39 ID:1,6:5b:64:76:26:39 Lease:0x646a3369}

	I0520 08:09:56.316033    2351 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.3 HWAddress:8a:69:5a:cb:74:51 ID:1,8a:69:5a:cb:74:51 Lease:0x6468e1dc}

	I0520 08:09:56.316037    2351 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:36:b1:60:c3:d2:35 ID:1,36:b1:60:c3:d2:35 Lease:0x646a3311}

	I0520 08:09:58.318070    2351 main.go:141] libmachine: Attempt 5

	I0520 08:09:58.318078    2351 main.go:141] libmachine: Searching for ea:9f:53:ae:c6:fe in /var/db/dhcpd_leases ...

	I0520 08:09:58.318150    2351 main.go:141] libmachine: Found 3 entries in /var/db/dhcpd_leases!

	I0520 08:09:58.318158    2351 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.4 HWAddress:6:5b:64:76:26:39 ID:1,6:5b:64:76:26:39 Lease:0x646a3369}

	I0520 08:09:58.318162    2351 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.3 HWAddress:8a:69:5a:cb:74:51 ID:1,8a:69:5a:cb:74:51 Lease:0x6468e1dc}

	I0520 08:09:58.318166    2351 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:36:b1:60:c3:d2:35 ID:1,36:b1:60:c3:d2:35 Lease:0x646a3311}

	I0520 08:10:00.320250    2351 main.go:141] libmachine: Attempt 6

	I0520 08:10:00.320270    2351 main.go:141] libmachine: Searching for ea:9f:53:ae:c6:fe in /var/db/dhcpd_leases ...

	I0520 08:10:00.320393    2351 main.go:141] libmachine: Found 4 entries in /var/db/dhcpd_leases!

	I0520 08:10:00.320429    2351 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.5 HWAddress:ea:9f:53:ae:c6:fe ID:1,ea:9f:53:ae:c6:fe Lease:0x646a3447}

	I0520 08:10:00.320435    2351 main.go:141] libmachine: Found match: ea:9f:53:ae:c6:fe

	I0520 08:10:00.320448    2351 main.go:141] libmachine: IP: 192.168.105.5

	I0520 08:10:00.320456    2351 main.go:141] libmachine: Waiting for VM to start (ssh -p 22 docker@192.168.105.5)...

	I0520 08:10:02.341516    2351 machine.go:88] provisioning docker machine ...

	I0520 08:10:02.341582    2351 buildroot.go:166] provisioning hostname "image-027000"

	I0520 08:10:02.341920    2351 main.go:141] libmachine: Using SSH client type: native

	I0520 08:10:02.342981    2351 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1048306d0] 0x104833130 <nil>  [] 0s} 192.168.105.5 22 <nil> <nil>}

	I0520 08:10:02.342999    2351 main.go:141] libmachine: About to run SSH command:

	sudo hostname image-027000 && echo "image-027000" | sudo tee /etc/hostname

	I0520 08:10:02.428132    2351 main.go:141] libmachine: SSH cmd err, output: <nil>: image-027000

	I0520 08:10:02.432226    2351 main.go:141] libmachine: Using SSH client type: native

	I0520 08:10:02.432645    2351 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1048306d0] 0x104833130 <nil>  [] 0s} 192.168.105.5 22 <nil> <nil>}

	I0520 08:10:02.432656    2351 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\simage-027000' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 image-027000/g' /etc/hosts;

				else 

					echo '127.0.1.1 image-027000' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0520 08:10:02.497441    2351 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0520 08:10:02.497452    2351 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/16543-1012/.minikube CaCertPath:/Users/jenkins/minikube-integration/16543-1012/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/16543-1012/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/16543-1012/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/16543-1012/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/16543-1012/.minikube}

	I0520 08:10:02.497461    2351 buildroot.go:174] setting up certificates

	I0520 08:10:02.497468    2351 provision.go:83] configureAuth start

	I0520 08:10:02.497472    2351 provision.go:138] copyHostCerts

	I0520 08:10:02.497559    2351 exec_runner.go:144] found /Users/jenkins/minikube-integration/16543-1012/.minikube/ca.pem, removing ...

	I0520 08:10:02.497564    2351 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/16543-1012/.minikube/ca.pem

	I0520 08:10:02.497693    2351 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/16543-1012/.minikube/ca.pem (1082 bytes)

	I0520 08:10:02.498213    2351 exec_runner.go:144] found /Users/jenkins/minikube-integration/16543-1012/.minikube/cert.pem, removing ...

	I0520 08:10:02.498216    2351 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/16543-1012/.minikube/cert.pem

	I0520 08:10:02.499034    2351 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/16543-1012/.minikube/cert.pem (1123 bytes)

	I0520 08:10:02.499166    2351 exec_runner.go:144] found /Users/jenkins/minikube-integration/16543-1012/.minikube/key.pem, removing ...

	I0520 08:10:02.499168    2351 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/16543-1012/.minikube/key.pem

	I0520 08:10:02.500449    2351 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/16543-1012/.minikube/key.pem (1679 bytes)

	I0520 08:10:02.500723    2351 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/16543-1012/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/16543-1012/.minikube/certs/ca-key.pem org=jenkins.image-027000 san=[192.168.105.5 192.168.105.5 localhost 127.0.0.1 minikube image-027000]

	I0520 08:10:02.598426    2351 provision.go:172] copyRemoteCerts

	I0520 08:10:02.598470    2351 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0520 08:10:02.598476    2351 sshutil.go:53] new ssh client: &{IP:192.168.105.5 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/image-027000/id_rsa Username:docker}

	I0520 08:10:02.628865    2351 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0520 08:10:02.635789    2351 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/server.pem --> /etc/docker/server.pem (1216 bytes)

	I0520 08:10:02.642452    2351 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I0520 08:10:02.649746    2351 provision.go:86] duration metric: configureAuth took 152.270417ms

	I0520 08:10:02.649750    2351 buildroot.go:189] setting minikube options for container-runtime

	I0520 08:10:02.649843    2351 config.go:182] Loaded profile config "image-027000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.27.2

	I0520 08:10:02.649872    2351 main.go:141] libmachine: Using SSH client type: native

	I0520 08:10:02.650084    2351 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1048306d0] 0x104833130 <nil>  [] 0s} 192.168.105.5 22 <nil> <nil>}

	I0520 08:10:02.650087    2351 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0520 08:10:02.703713    2351 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I0520 08:10:02.703719    2351 buildroot.go:70] root file system type: tmpfs

	I0520 08:10:02.703771    2351 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I0520 08:10:02.703816    2351 main.go:141] libmachine: Using SSH client type: native

	I0520 08:10:02.704041    2351 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1048306d0] 0x104833130 <nil>  [] 0s} 192.168.105.5 22 <nil> <nil>}

	I0520 08:10:02.704074    2351 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0520 08:10:02.764021    2351 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0520 08:10:02.764064    2351 main.go:141] libmachine: Using SSH client type: native

	I0520 08:10:02.764308    2351 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1048306d0] 0x104833130 <nil>  [] 0s} 192.168.105.5 22 <nil> <nil>}

	I0520 08:10:02.764315    2351 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0520 08:10:03.054115    2351 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory

	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.

	I0520 08:10:03.054123    2351 machine.go:91] provisioned docker machine in 712.591917ms

	I0520 08:10:03.054126    2351 client.go:171] LocalClient.Create took 15.51265575s

	I0520 08:10:03.054140    2351 start.go:167] duration metric: libmachine.API.Create for "image-027000" took 15.512711417s

	I0520 08:10:03.054143    2351 start.go:300] post-start starting for "image-027000" (driver="qemu2")

	I0520 08:10:03.054145    2351 start.go:328] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0520 08:10:03.054209    2351 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0520 08:10:03.054216    2351 sshutil.go:53] new ssh client: &{IP:192.168.105.5 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/image-027000/id_rsa Username:docker}

	I0520 08:10:03.085248    2351 ssh_runner.go:195] Run: cat /etc/os-release

	I0520 08:10:03.086767    2351 info.go:137] Remote host: Buildroot 2021.02.12

	I0520 08:10:03.086773    2351 filesync.go:126] Scanning /Users/jenkins/minikube-integration/16543-1012/.minikube/addons for local assets ...

	I0520 08:10:03.086834    2351 filesync.go:126] Scanning /Users/jenkins/minikube-integration/16543-1012/.minikube/files for local assets ...

	I0520 08:10:03.086942    2351 filesync.go:149] local asset: /Users/jenkins/minikube-integration/16543-1012/.minikube/files/etc/ssl/certs/14372.pem -> 14372.pem in /etc/ssl/certs

	I0520 08:10:03.087049    2351 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0520 08:10:03.089808    2351 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/files/etc/ssl/certs/14372.pem --> /etc/ssl/certs/14372.pem (1708 bytes)

	I0520 08:10:03.096711    2351 start.go:303] post-start completed in 42.563833ms

	I0520 08:10:03.097064    2351 profile.go:148] Saving config to /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/image-027000/config.json ...

	I0520 08:10:03.097217    2351 start.go:128] duration metric: createHost completed in 15.586404792s

	I0520 08:10:03.097248    2351 main.go:141] libmachine: Using SSH client type: native

	I0520 08:10:03.097468    2351 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1048306d0] 0x104833130 <nil>  [] 0s} 192.168.105.5 22 <nil> <nil>}

	I0520 08:10:03.097471    2351 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0520 08:10:03.152676    2351 main.go:141] libmachine: SSH cmd err, output: <nil>: 1684595403.443921585

	I0520 08:10:03.152681    2351 fix.go:207] guest clock: 1684595403.443921585

	I0520 08:10:03.152684    2351 fix.go:220] Guest: 2023-05-20 08:10:03.443921585 -0700 PDT Remote: 2023-05-20 08:10:03.09722 -0700 PDT m=+15.690488584 (delta=346.701585ms)

	I0520 08:10:03.152694    2351 fix.go:191] guest clock delta is within tolerance: 346.701585ms

	I0520 08:10:03.152696    2351 start.go:83] releasing machines lock for "image-027000", held for 15.641918417s

	I0520 08:10:03.153018    2351 ssh_runner.go:195] Run: cat /version.json

	I0520 08:10:03.153024    2351 sshutil.go:53] new ssh client: &{IP:192.168.105.5 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/image-027000/id_rsa Username:docker}

	I0520 08:10:03.153042    2351 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0520 08:10:03.153060    2351 sshutil.go:53] new ssh client: &{IP:192.168.105.5 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/image-027000/id_rsa Username:docker}

	I0520 08:10:03.228832    2351 ssh_runner.go:195] Run: systemctl --version

	I0520 08:10:03.231016    2351 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0520 08:10:03.232969    2351 cni.go:208] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0520 08:10:03.233002    2351 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0520 08:10:03.238285    2351 cni.go:261] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0520 08:10:03.238292    2351 preload.go:132] Checking if preload exists for k8s version v1.27.2 and runtime docker

	I0520 08:10:03.238384    2351 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0520 08:10:03.249607    2351 docker.go:633] Got preloaded images: 

	I0520 08:10:03.249612    2351 docker.go:639] registry.k8s.io/kube-apiserver:v1.27.2 wasn't preloaded

	I0520 08:10:03.249657    2351 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I0520 08:10:03.258398    2351 ssh_runner.go:195] Run: which lz4

	I0520 08:10:03.260944    2351 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4

	I0520 08:10:03.262906    2351 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I0520 08:10:03.262923    2351 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.2-docker-overlay2-arm64.tar.lz4 --> /preloaded.tar.lz4 (343635669 bytes)

	I0520 08:10:04.539698    2351 docker.go:597] Took 1.278827 seconds to copy over tarball

	I0520 08:10:04.539743    2351 ssh_runner.go:195] Run: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4

	I0520 08:10:05.542020    2351 ssh_runner.go:235] Completed: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4: (1.002267542s)

	I0520 08:10:05.542028    2351 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I0520 08:10:05.558485    2351 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I0520 08:10:05.561763    2351 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2629 bytes)

	I0520 08:10:05.566986    2351 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0520 08:10:05.638386    2351 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0520 08:10:06.931907    2351 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.293511666s)

	I0520 08:10:06.931925    2351 start.go:481] detecting cgroup driver to use...

	I0520 08:10:06.931989    2351 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0520 08:10:06.939225    2351 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"

	I0520 08:10:06.942401    2351 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I0520 08:10:06.945479    2351 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...

	I0520 08:10:06.945505    2351 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I0520 08:10:06.948945    2351 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0520 08:10:06.952183    2351 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I0520 08:10:06.955166    2351 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0520 08:10:06.958243    2351 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0520 08:10:06.961910    2351 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I0520 08:10:06.965686    2351 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0520 08:10:06.968950    2351 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0520 08:10:06.971834    2351 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0520 08:10:07.034010    2351 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I0520 08:10:07.044293    2351 start.go:481] detecting cgroup driver to use...

	I0520 08:10:07.044349    2351 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0520 08:10:07.050021    2351 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0520 08:10:07.054886    2351 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0520 08:10:07.064055    2351 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0520 08:10:07.068592    2351 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0520 08:10:07.073089    2351 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I0520 08:10:07.130723    2351 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0520 08:10:07.136727    2351 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0520 08:10:07.142684    2351 ssh_runner.go:195] Run: which cri-dockerd

	I0520 08:10:07.144046    2351 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I0520 08:10:07.146797    2351 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)

	I0520 08:10:07.152140    2351 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I0520 08:10:07.215408    2351 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I0520 08:10:07.294620    2351 docker.go:532] configuring docker to use "cgroupfs" as cgroup driver...

	I0520 08:10:07.294629    2351 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (144 bytes)

	I0520 08:10:07.300074    2351 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0520 08:10:07.375384    2351 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0520 08:10:08.508897    2351 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.133503583s)

	I0520 08:10:08.508978    2351 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I0520 08:10:08.574771    2351 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I0520 08:10:08.654072    2351 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I0520 08:10:08.735427    2351 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0520 08:10:08.804114    2351 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I0520 08:10:08.811066    2351 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0520 08:10:08.877978    2351 ssh_runner.go:195] Run: sudo systemctl restart cri-docker

	I0520 08:10:08.901327    2351 start.go:528] Will wait 60s for socket path /var/run/cri-dockerd.sock

	I0520 08:10:08.901402    2351 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0520 08:10:08.903450    2351 start.go:549] Will wait 60s for crictl version

	I0520 08:10:08.903497    2351 ssh_runner.go:195] Run: which crictl

	I0520 08:10:08.904920    2351 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0520 08:10:08.920574    2351 start.go:565] Version:  0.1.0

	RuntimeName:  docker

	RuntimeVersion:  20.10.23

	RuntimeApiVersion:  v1alpha2

	I0520 08:10:08.920643    2351 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0520 08:10:08.929710    2351 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0520 08:10:08.950903    2351 out.go:204] * Preparing Kubernetes v1.27.2 on Docker 20.10.23 ...

	I0520 08:10:08.950990    2351 ssh_runner.go:195] Run: grep 192.168.105.1	host.minikube.internal$ /etc/hosts

	I0520 08:10:08.952398    2351 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.105.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0520 08:10:08.956176    2351 preload.go:132] Checking if preload exists for k8s version v1.27.2 and runtime docker

	I0520 08:10:08.956221    2351 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0520 08:10:08.964989    2351 docker.go:633] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.27.2

	registry.k8s.io/kube-scheduler:v1.27.2

	registry.k8s.io/kube-controller-manager:v1.27.2

	registry.k8s.io/kube-proxy:v1.27.2

	registry.k8s.io/coredns/coredns:v1.10.1

	registry.k8s.io/etcd:3.5.7-0

	registry.k8s.io/pause:3.9

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I0520 08:10:08.964994    2351 docker.go:563] Images already preloaded, skipping extraction

	I0520 08:10:08.965049    2351 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0520 08:10:08.978849    2351 docker.go:633] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.27.2

	registry.k8s.io/kube-controller-manager:v1.27.2

	registry.k8s.io/kube-scheduler:v1.27.2

	registry.k8s.io/kube-proxy:v1.27.2

	registry.k8s.io/coredns/coredns:v1.10.1

	registry.k8s.io/etcd:3.5.7-0

	registry.k8s.io/pause:3.9

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I0520 08:10:08.978856    2351 cache_images.go:84] Images are preloaded, skipping loading

	I0520 08:10:08.978905    2351 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I0520 08:10:08.988605    2351 cni.go:84] Creating CNI manager for ""

	I0520 08:10:08.988611    2351 cni.go:157] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0520 08:10:08.988621    2351 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I0520 08:10:08.988633    2351 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.105.5 APIServerPort:8443 KubernetesVersion:v1.27.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:image-027000 NodeName:image-027000 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.105.5"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.105.5 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kube

rnetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I0520 08:10:08.988700    2351 kubeadm.go:181] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.105.5

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/cri-dockerd.sock

	  name: "image-027000"

	  kubeletExtraArgs:

	    node-ip: 192.168.105.5

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.105.5"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.27.2

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0520 08:10:08.988732    2351 kubeadm.go:971] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.27.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/cri-dockerd.sock --hostname-override=image-027000 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.105.5

	[Install]

	 config:

	{KubernetesVersion:v1.27.2 ClusterName:image-027000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I0520 08:10:08.988778    2351 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.27.2

	I0520 08:10:08.991714    2351 binaries.go:44] Found k8s binaries, skipping transfer

	I0520 08:10:08.991739    2351 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0520 08:10:08.994434    2351 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (374 bytes)

	I0520 08:10:08.999640    2351 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0520 08:10:09.004510    2351 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2098 bytes)

	I0520 08:10:09.009809    2351 ssh_runner.go:195] Run: grep 192.168.105.5	control-plane.minikube.internal$ /etc/hosts

	I0520 08:10:09.011357    2351 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.105.5	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0520 08:10:09.014867    2351 certs.go:56] Setting up /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/image-027000 for IP: 192.168.105.5

	I0520 08:10:09.014875    2351 certs.go:190] acquiring lock for shared ca certs: {Name:mk455286e32296d088c043e2094c607a8fa5e5c4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0520 08:10:09.015010    2351 certs.go:199] skipping minikubeCA CA generation: /Users/jenkins/minikube-integration/16543-1012/.minikube/ca.key

	I0520 08:10:09.015195    2351 certs.go:199] skipping proxyClientCA CA generation: /Users/jenkins/minikube-integration/16543-1012/.minikube/proxy-client-ca.key

	I0520 08:10:09.015221    2351 certs.go:319] generating minikube-user signed cert: /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/image-027000/client.key

	I0520 08:10:09.015228    2351 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/image-027000/client.crt with IP's: []

	I0520 08:10:09.202198    2351 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/image-027000/client.crt ...

	I0520 08:10:09.202202    2351 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/image-027000/client.crt: {Name:mk07e8d43aa3b70bdb0ff22a093771d29fe7e80c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0520 08:10:09.202423    2351 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/image-027000/client.key ...

	I0520 08:10:09.202425    2351 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/image-027000/client.key: {Name:mk70470e49ab8bf5525e9aa8454703fd97021188 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0520 08:10:09.202541    2351 certs.go:319] generating minikube signed cert: /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/image-027000/apiserver.key.e69b33ca

	I0520 08:10:09.202547    2351 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/image-027000/apiserver.crt.e69b33ca with IP's: [192.168.105.5 10.96.0.1 127.0.0.1 10.0.0.1]

	I0520 08:10:09.278771    2351 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/image-027000/apiserver.crt.e69b33ca ...

	I0520 08:10:09.278773    2351 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/image-027000/apiserver.crt.e69b33ca: {Name:mk45114c2497961f694eb65b58641d57bdc90ee5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0520 08:10:09.278892    2351 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/image-027000/apiserver.key.e69b33ca ...

	I0520 08:10:09.278894    2351 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/image-027000/apiserver.key.e69b33ca: {Name:mk8f5a3949399dc7f79cadced6e4a5e089eace0f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0520 08:10:09.278993    2351 certs.go:337] copying /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/image-027000/apiserver.crt.e69b33ca -> /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/image-027000/apiserver.crt

	I0520 08:10:09.279085    2351 certs.go:341] copying /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/image-027000/apiserver.key.e69b33ca -> /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/image-027000/apiserver.key

	I0520 08:10:09.279165    2351 certs.go:319] generating aggregator signed cert: /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/image-027000/proxy-client.key

	I0520 08:10:09.279171    2351 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/image-027000/proxy-client.crt with IP's: []

	I0520 08:10:09.364962    2351 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/image-027000/proxy-client.crt ...

	I0520 08:10:09.364968    2351 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/image-027000/proxy-client.crt: {Name:mkbcef93718edff63fed0b1265f683a9957ff5a3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0520 08:10:09.365155    2351 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/image-027000/proxy-client.key ...

	I0520 08:10:09.365158    2351 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/image-027000/proxy-client.key: {Name:mkc93b0817c2c9cdcf072f988a2140166f3e3e76 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0520 08:10:09.365395    2351 certs.go:437] found cert: /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/Users/jenkins/minikube-integration/16543-1012/.minikube/certs/1437.pem (1338 bytes)

	W0520 08:10:09.365577    2351 certs.go:433] ignoring /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/Users/jenkins/minikube-integration/16543-1012/.minikube/certs/1437_empty.pem, impossibly tiny 0 bytes

	I0520 08:10:09.365589    2351 certs.go:437] found cert: /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/Users/jenkins/minikube-integration/16543-1012/.minikube/certs/ca-key.pem (1675 bytes)

	I0520 08:10:09.365618    2351 certs.go:437] found cert: /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/Users/jenkins/minikube-integration/16543-1012/.minikube/certs/ca.pem (1082 bytes)

	I0520 08:10:09.365640    2351 certs.go:437] found cert: /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/Users/jenkins/minikube-integration/16543-1012/.minikube/certs/cert.pem (1123 bytes)

	I0520 08:10:09.365661    2351 certs.go:437] found cert: /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/Users/jenkins/minikube-integration/16543-1012/.minikube/certs/key.pem (1679 bytes)

	I0520 08:10:09.365717    2351 certs.go:437] found cert: /Users/jenkins/minikube-integration/16543-1012/.minikube/files/etc/ssl/certs/Users/jenkins/minikube-integration/16543-1012/.minikube/files/etc/ssl/certs/14372.pem (1708 bytes)

	I0520 08:10:09.365988    2351 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/image-027000/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I0520 08:10:09.373956    2351 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/image-027000/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I0520 08:10:09.381723    2351 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/image-027000/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0520 08:10:09.389397    2351 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/image-027000/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0520 08:10:09.396745    2351 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0520 08:10:09.403838    2351 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I0520 08:10:09.410863    2351 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0520 08:10:09.418218    2351 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I0520 08:10:09.425717    2351 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/files/etc/ssl/certs/14372.pem --> /usr/share/ca-certificates/14372.pem (1708 bytes)

	I0520 08:10:09.433122    2351 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0520 08:10:09.440110    2351 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/1437.pem --> /usr/share/ca-certificates/1437.pem (1338 bytes)

	I0520 08:10:09.446933    2351 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0520 08:10:09.452196    2351 ssh_runner.go:195] Run: openssl version

	I0520 08:10:09.454288    2351 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14372.pem && ln -fs /usr/share/ca-certificates/14372.pem /etc/ssl/certs/14372.pem"

	I0520 08:10:09.457668    2351 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14372.pem

	I0520 08:10:09.459303    2351 certs.go:480] hashing: -rw-r--r-- 1 root root 1708 May 20 15:06 /usr/share/ca-certificates/14372.pem

	I0520 08:10:09.459322    2351 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14372.pem

	I0520 08:10:09.461255    2351 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14372.pem /etc/ssl/certs/3ec20f2e.0"

	I0520 08:10:09.464489    2351 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0520 08:10:09.467433    2351 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0520 08:10:09.468947    2351 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 May 20 15:04 /usr/share/ca-certificates/minikubeCA.pem

	I0520 08:10:09.468966    2351 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0520 08:10:09.470877    2351 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0520 08:10:09.474326    2351 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1437.pem && ln -fs /usr/share/ca-certificates/1437.pem /etc/ssl/certs/1437.pem"

	I0520 08:10:09.477825    2351 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1437.pem

	I0520 08:10:09.479372    2351 certs.go:480] hashing: -rw-r--r-- 1 root root 1338 May 20 15:06 /usr/share/ca-certificates/1437.pem

	I0520 08:10:09.479393    2351 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1437.pem

	I0520 08:10:09.481243    2351 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1437.pem /etc/ssl/certs/51391683.0"

	I0520 08:10:09.484411    2351 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd

	I0520 08:10:09.485893    2351 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory

	I0520 08:10:09.485921    2351 kubeadm.go:404] StartCluster: {Name:image-027000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/16506/minikube-v1.30.1-1684174510-16506-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684523789-16533@sha256:ed200ff6d686f303885e8aaf964442d08018856d63a8e23f7acdc068766ea82b Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1

.27.2 ClusterName:image-027000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.105.5 Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOpt

imizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}

	I0520 08:10:09.485983    2351 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0520 08:10:09.493037    2351 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0520 08:10:09.496264    2351 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0520 08:10:09.499108    2351 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0520 08:10:09.502301    2351 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0520 08:10:09.502311    2351 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.27.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"

	I0520 08:10:09.524741    2351 kubeadm.go:322] [init] Using Kubernetes version: v1.27.2

	I0520 08:10:09.524769    2351 kubeadm.go:322] [preflight] Running pre-flight checks

	I0520 08:10:09.583050    2351 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster

	I0520 08:10:09.583104    2351 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I0520 08:10:09.583154    2351 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	I0520 08:10:09.642571    2351 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I0520 08:10:09.653134    2351 out.go:204]   - Generating certificates and keys ...

	I0520 08:10:09.653227    2351 kubeadm.go:322] [certs] Using existing ca certificate authority

	I0520 08:10:09.653260    2351 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk

	I0520 08:10:09.752316    2351 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key

	I0520 08:10:09.838068    2351 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key

	I0520 08:10:09.873956    2351 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key

	I0520 08:10:10.039818    2351 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key

	I0520 08:10:10.200693    2351 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key

	I0520 08:10:10.200763    2351 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [image-027000 localhost] and IPs [192.168.105.5 127.0.0.1 ::1]

	I0520 08:10:10.306631    2351 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key

	I0520 08:10:10.306695    2351 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [image-027000 localhost] and IPs [192.168.105.5 127.0.0.1 ::1]

	I0520 08:10:10.416870    2351 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key

	I0520 08:10:10.683425    2351 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key

	I0520 08:10:10.757104    2351 kubeadm.go:322] [certs] Generating "sa" key and public key

	I0520 08:10:10.757131    2351 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I0520 08:10:10.842610    2351 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file

	I0520 08:10:10.935375    2351 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I0520 08:10:11.001386    2351 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I0520 08:10:11.076018    2351 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I0520 08:10:11.082545    2351 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I0520 08:10:11.082587    2351 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I0520 08:10:11.082610    2351 kubeadm.go:322] [kubelet-start] Starting the kubelet

	I0520 08:10:11.168556    2351 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I0520 08:10:11.187065    2351 out.go:204]   - Booting up control plane ...

	I0520 08:10:11.187117    2351 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I0520 08:10:11.187157    2351 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I0520 08:10:11.187189    2351 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I0520 08:10:11.187235    2351 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I0520 08:10:11.187351    2351 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	I0520 08:10:15.172171    2351 kubeadm.go:322] [apiclient] All control plane components are healthy after 4.001964 seconds

	I0520 08:10:15.172247    2351 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I0520 08:10:15.177997    2351 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I0520 08:10:15.695362    2351 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs

	I0520 08:10:15.695590    2351 kubeadm.go:322] [mark-control-plane] Marking the node image-027000 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I0520 08:10:16.200666    2351 kubeadm.go:322] [bootstrap-token] Using token: cg61mv.pyw8v639uxe2crc2

	I0520 08:10:16.204298    2351 out.go:204]   - Configuring RBAC rules ...

	I0520 08:10:16.204343    2351 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I0520 08:10:16.205350    2351 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I0520 08:10:16.212726    2351 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I0520 08:10:16.213932    2351 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I0520 08:10:16.215131    2351 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I0520 08:10:16.216499    2351 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I0520 08:10:16.220427    2351 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I0520 08:10:16.384553    2351 kubeadm.go:322] [addons] Applied essential addon: CoreDNS

	I0520 08:10:16.608543    2351 kubeadm.go:322] [addons] Applied essential addon: kube-proxy

	I0520 08:10:16.609755    2351 kubeadm.go:322] 

	I0520 08:10:16.609790    2351 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!

	I0520 08:10:16.609793    2351 kubeadm.go:322] 

	I0520 08:10:16.609824    2351 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:

	I0520 08:10:16.609826    2351 kubeadm.go:322] 

	I0520 08:10:16.609835    2351 kubeadm.go:322]   mkdir -p $HOME/.kube

	I0520 08:10:16.609861    2351 kubeadm.go:322]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I0520 08:10:16.609883    2351 kubeadm.go:322]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I0520 08:10:16.609884    2351 kubeadm.go:322] 

	I0520 08:10:16.609909    2351 kubeadm.go:322] Alternatively, if you are the root user, you can run:

	I0520 08:10:16.609910    2351 kubeadm.go:322] 

	I0520 08:10:16.609945    2351 kubeadm.go:322]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I0520 08:10:16.609948    2351 kubeadm.go:322] 

	I0520 08:10:16.609974    2351 kubeadm.go:322] You should now deploy a pod network to the cluster.

	I0520 08:10:16.610032    2351 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I0520 08:10:16.610070    2351 kubeadm.go:322]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I0520 08:10:16.610071    2351 kubeadm.go:322] 

	I0520 08:10:16.610118    2351 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities

	I0520 08:10:16.610161    2351 kubeadm.go:322] and service account keys on each node and then running the following as root:

	I0520 08:10:16.610162    2351 kubeadm.go:322] 

	I0520 08:10:16.610202    2351 kubeadm.go:322]   kubeadm join control-plane.minikube.internal:8443 --token cg61mv.pyw8v639uxe2crc2 \

	I0520 08:10:16.610254    2351 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:c637a44edb20ebaef1a3cd8bd36bb27010137a6bac525a779e19218d8d4ae1e6 \

	I0520 08:10:16.610263    2351 kubeadm.go:322] 	--control-plane 

	I0520 08:10:16.610283    2351 kubeadm.go:322] 

	I0520 08:10:16.610323    2351 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:

	I0520 08:10:16.610325    2351 kubeadm.go:322] 

	I0520 08:10:16.610361    2351 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token cg61mv.pyw8v639uxe2crc2 \

	I0520 08:10:16.610410    2351 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:c637a44edb20ebaef1a3cd8bd36bb27010137a6bac525a779e19218d8d4ae1e6 

	I0520 08:10:16.610476    2351 kubeadm.go:322] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I0520 08:10:16.610564    2351 kubeadm.go:322] W0520 15:10:09.874436    1307 images.go:80] could not find officially supported version of etcd for Kubernetes v1.27.2, falling back to the nearest etcd version (3.5.7-0)

	I0520 08:10:16.610644    2351 kubeadm.go:322] W0520 15:10:11.459955    1307 images.go:80] could not find officially supported version of etcd for Kubernetes v1.27.2, falling back to the nearest etcd version (3.5.7-0)

	I0520 08:10:16.610652    2351 cni.go:84] Creating CNI manager for ""

	I0520 08:10:16.610660    2351 cni.go:157] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0520 08:10:16.619646    2351 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...

	I0520 08:10:16.622360    2351 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d

	I0520 08:10:16.625711    2351 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)

	I0520 08:10:16.630935    2351 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0520 08:10:16.630992    2351 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl label nodes minikube.k8s.io/version=v1.30.1 minikube.k8s.io/commit=24686ce6bbd657e092eb3c3fd6be64c1b7241033 minikube.k8s.io/name=image-027000 minikube.k8s.io/updated_at=2023_05_20T08_10_16_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:10:16.630993    2351 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:10:16.684773    2351 kubeadm.go:1076] duration metric: took 53.814792ms to wait for elevateKubeSystemPrivileges.

	I0520 08:10:16.694674    2351 ops.go:34] apiserver oom_adj: -16

	I0520 08:10:16.694680    2351 kubeadm.go:406] StartCluster complete in 7.208772625s

	I0520 08:10:16.694694    2351 settings.go:142] acquiring lock: {Name:mk59154b06c6365bdac4601706e783ce490a045a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0520 08:10:16.694771    2351 settings.go:150] Updating kubeconfig:  /Users/jenkins/minikube-integration/16543-1012/kubeconfig

	I0520 08:10:16.695125    2351 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16543-1012/kubeconfig: {Name:mkf6fa7fb711448995f7c2c1a6e60e631893d6a3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0520 08:10:16.695285    2351 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.27.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0520 08:10:16.695343    2351 addons.go:496] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false]

	I0520 08:10:16.695376    2351 addons.go:66] Setting storage-provisioner=true in profile "image-027000"

	I0520 08:10:16.695382    2351 addons.go:228] Setting addon storage-provisioner=true in "image-027000"

	I0520 08:10:16.695398    2351 addons.go:66] Setting default-storageclass=true in profile "image-027000"

	I0520 08:10:16.695405    2351 host.go:66] Checking if "image-027000" exists ...

	I0520 08:10:16.695405    2351 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "image-027000"

	I0520 08:10:16.695494    2351 config.go:182] Loaded profile config "image-027000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.27.2

	I0520 08:10:16.701313    2351 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0520 08:10:16.705223    2351 addons.go:420] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0520 08:10:16.705229    2351 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0520 08:10:16.705237    2351 sshutil.go:53] new ssh client: &{IP:192.168.105.5 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/image-027000/id_rsa Username:docker}

	I0520 08:10:16.710475    2351 addons.go:228] Setting addon default-storageclass=true in "image-027000"

	I0520 08:10:16.710490    2351 host.go:66] Checking if "image-027000" exists ...

	I0520 08:10:16.711225    2351 addons.go:420] installing /etc/kubernetes/addons/storageclass.yaml

	I0520 08:10:16.711229    2351 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0520 08:10:16.711235    2351 sshutil.go:53] new ssh client: &{IP:192.168.105.5 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/image-027000/id_rsa Username:docker}

	I0520 08:10:16.742581    2351 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.27.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.105.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.27.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0520 08:10:16.745235    2351 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0520 08:10:16.749732    2351 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0520 08:10:17.207090    2351 start.go:916] {"host.minikube.internal": 192.168.105.1} host record injected into CoreDNS's ConfigMap

	I0520 08:10:17.216666    2351 kapi.go:248] "coredns" deployment in "kube-system" namespace and "image-027000" context rescaled to 1 replicas

	I0520 08:10:17.216679    2351 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.105.5 Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0520 08:10:17.219640    2351 out.go:177] * Verifying Kubernetes components...

	I0520 08:10:17.228293    2351 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0520 08:10:17.306227    2351 out.go:177] * Enabled addons: storage-provisioner, default-storageclass

	I0520 08:10:17.303157    2351 api_server.go:52] waiting for apiserver process to appear ...

	I0520 08:10:17.313304    2351 addons.go:499] enable addons completed in 617.963167ms: enabled=[storage-provisioner default-storageclass]

	I0520 08:10:17.313329    2351 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0520 08:10:17.317678    2351 api_server.go:72] duration metric: took 100.991083ms to wait for apiserver process to appear ...

	I0520 08:10:17.317681    2351 api_server.go:88] waiting for apiserver healthz status ...

	I0520 08:10:17.317690    2351 api_server.go:253] Checking apiserver healthz at https://192.168.105.5:8443/healthz ...

	I0520 08:10:17.320709    2351 api_server.go:279] https://192.168.105.5:8443/healthz returned 200:

	ok

	I0520 08:10:17.321264    2351 api_server.go:141] control plane version: v1.27.2

	I0520 08:10:17.321268    2351 api_server.go:131] duration metric: took 3.585ms to wait for apiserver health ...

	I0520 08:10:17.321270    2351 system_pods.go:43] waiting for kube-system pods to appear ...

	I0520 08:10:17.324035    2351 system_pods.go:59] 5 kube-system pods found

	I0520 08:10:17.324040    2351 system_pods.go:61] "etcd-image-027000" [3473b665-064f-4538-8d83-64c046a4ebc8] Pending

	I0520 08:10:17.324042    2351 system_pods.go:61] "kube-apiserver-image-027000" [4e6ec967-1baa-42dc-ad55-21c7d5762d5a] Pending

	I0520 08:10:17.324044    2351 system_pods.go:61] "kube-controller-manager-image-027000" [d8776dfe-5918-49f7-8b4d-9ccdb7edf5f0] Pending

	I0520 08:10:17.324046    2351 system_pods.go:61] "kube-scheduler-image-027000" [94ede0e0-0a9f-4a91-800d-3740c597c813] Pending

	I0520 08:10:17.324048    2351 system_pods.go:61] "storage-provisioner" [4dd0d88f-264a-4147-a2ae-3c8c2408dec9] Pending

	I0520 08:10:17.324049    2351 system_pods.go:74] duration metric: took 2.778041ms to wait for pod list to return data ...

	I0520 08:10:17.324052    2351 kubeadm.go:581] duration metric: took 107.365375ms to wait for : map[apiserver:true system_pods:true] ...

	I0520 08:10:17.324057    2351 node_conditions.go:102] verifying NodePressure condition ...

	I0520 08:10:17.325443    2351 node_conditions.go:122] node storage ephemeral capacity is 17784760Ki

	I0520 08:10:17.325449    2351 node_conditions.go:123] node cpu capacity is 2

	I0520 08:10:17.325454    2351 node_conditions.go:105] duration metric: took 1.395666ms to run NodePressure ...

	I0520 08:10:17.325457    2351 start.go:228] waiting for startup goroutines ...

	I0520 08:10:17.325460    2351 start.go:233] waiting for cluster config update ...

	I0520 08:10:17.325464    2351 start.go:242] writing updated cluster config ...

	I0520 08:10:17.325716    2351 ssh_runner.go:195] Run: rm -f paused

	I0520 08:10:17.355924    2351 start.go:568] kubectl: 1.25.9, cluster: 1.27.2 (minor skew: 2)

	I0520 08:10:17.359338    2351 out.go:177] 

	W0520 08:10:17.363443    2351 out.go:239] ! /usr/local/bin/kubectl is version 1.25.9, which may have incompatibilities with Kubernetes 1.27.2.

	I0520 08:10:17.367298    2351 out.go:177]   - Want kubectl v1.27.2? Try 'minikube kubectl -- get pods -A'

	I0520 08:10:17.381443    2351 out.go:177] * Done! kubectl is now configured to use "image-027000" cluster and "default" namespace by default

	* 

	* ==> Docker <==

	* -- Journal begins at Sat 2023-05-20 15:09:59 UTC, ends at Sat 2023-05-20 15:10:20 UTC. --

	May 20 15:10:12 image-027000 cri-dockerd[1137]: time="2023-05-20T15:10:12Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/2f5698edf8fc7cec5faf1596668ccd43d6ad1826af16a824545c8864f923a614/resolv.conf as [nameserver 192.168.105.1]"

	May 20 15:10:12 image-027000 cri-dockerd[1137]: time="2023-05-20T15:10:12Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/baab361d7f23c14f0f3c38e0cb998ebf3e8f11f3062ef74b1e137b1484c372fe/resolv.conf as [nameserver 192.168.105.1]"

	May 20 15:10:12 image-027000 dockerd[923]: time="2023-05-20T15:10:12.371575048Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	May 20 15:10:12 image-027000 dockerd[923]: time="2023-05-20T15:10:12.371629673Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	May 20 15:10:12 image-027000 dockerd[923]: time="2023-05-20T15:10:12.371642173Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	May 20 15:10:12 image-027000 dockerd[923]: time="2023-05-20T15:10:12.371651589Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	May 20 15:10:12 image-027000 dockerd[923]: time="2023-05-20T15:10:12.422775548Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	May 20 15:10:12 image-027000 dockerd[923]: time="2023-05-20T15:10:12.423183173Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	May 20 15:10:12 image-027000 dockerd[923]: time="2023-05-20T15:10:12.423195339Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	May 20 15:10:12 image-027000 dockerd[923]: time="2023-05-20T15:10:12.423203923Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	May 20 15:10:12 image-027000 dockerd[923]: time="2023-05-20T15:10:12.428945923Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	May 20 15:10:12 image-027000 dockerd[923]: time="2023-05-20T15:10:12.428993423Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	May 20 15:10:12 image-027000 dockerd[923]: time="2023-05-20T15:10:12.429003839Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	May 20 15:10:12 image-027000 dockerd[923]: time="2023-05-20T15:10:12.429011881Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	May 20 15:10:19 image-027000 dockerd[917]: time="2023-05-20T15:10:19.865138343Z" level=info msg="Layer sha256:5e5d01bb2a8d3e34816f24ff1a055b5d084e5a5a1919cd77684120916d61c3eb cleaned up"

	May 20 15:10:20 image-027000 dockerd[917]: time="2023-05-20T15:10:20.022685968Z" level=info msg="Layer sha256:5e5d01bb2a8d3e34816f24ff1a055b5d084e5a5a1919cd77684120916d61c3eb cleaned up"

	May 20 15:10:20 image-027000 dockerd[917]: time="2023-05-20T15:10:20.055163260Z" level=info msg="Layer sha256:5e5d01bb2a8d3e34816f24ff1a055b5d084e5a5a1919cd77684120916d61c3eb cleaned up"

	May 20 15:10:20 image-027000 dockerd[923]: time="2023-05-20T15:10:20.100330968Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	May 20 15:10:20 image-027000 dockerd[923]: time="2023-05-20T15:10:20.100358385Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	May 20 15:10:20 image-027000 dockerd[923]: time="2023-05-20T15:10:20.100368593Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	May 20 15:10:20 image-027000 dockerd[923]: time="2023-05-20T15:10:20.100374760Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	May 20 15:10:20 image-027000 dockerd[917]: time="2023-05-20T15:10:20.248263510Z" level=info msg="ignoring event" container=84ffe0fcefdb5ae9240704ee24d193f52eb1ccd1f447ce122ae0999436b66f78 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 20 15:10:20 image-027000 dockerd[923]: time="2023-05-20T15:10:20.248617302Z" level=info msg="shim disconnected" id=84ffe0fcefdb5ae9240704ee24d193f52eb1ccd1f447ce122ae0999436b66f78 namespace=moby

	May 20 15:10:20 image-027000 dockerd[923]: time="2023-05-20T15:10:20.248647427Z" level=warning msg="cleaning up after shim disconnected" id=84ffe0fcefdb5ae9240704ee24d193f52eb1ccd1f447ce122ae0999436b66f78 namespace=moby

	May 20 15:10:20 image-027000 dockerd[923]: time="2023-05-20T15:10:20.248651468Z" level=info msg="cleaning up dead shim" namespace=moby

	* 

	* ==> container status <==

	* CONTAINER           IMAGE               CREATED             STATE               NAME                      ATTEMPT             POD ID

	04cc9796d6f8d       72c9df6be7f1b       8 seconds ago       Running             kube-apiserver            0                   baab361d7f23c

	e97f8f7348e9a       305d7ed1dae28       8 seconds ago       Running             kube-scheduler            0                   2f5698edf8fc7

	c4b124cdb4021       24bc64e911039       8 seconds ago       Running             etcd                      0                   37c05b14dc691

	66eaab5ec87fd       2ee705380c3c5       8 seconds ago       Running             kube-controller-manager   0                   043bd0c4b8689

	* 

	* ==> describe nodes <==

	* Name:               image-027000

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=arm64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=arm64

	                    kubernetes.io/hostname=image-027000

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=24686ce6bbd657e092eb3c3fd6be64c1b7241033

	                    minikube.k8s.io/name=image-027000

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2023_05_20T08_10_16_0700

	                    minikube.k8s.io/version=v1.30.1

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Sat, 20 May 2023 15:10:14 +0000

	Taints:             node.kubernetes.io/not-ready:NoSchedule

	Unschedulable:      false

	Lease:

	  HolderIdentity:  image-027000

	  AcquireTime:     <unset>

	  RenewTime:       Sat, 20 May 2023 15:10:16 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Sat, 20 May 2023 15:10:19 +0000   Sat, 20 May 2023 15:10:13 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Sat, 20 May 2023 15:10:19 +0000   Sat, 20 May 2023 15:10:13 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Sat, 20 May 2023 15:10:19 +0000   Sat, 20 May 2023 15:10:13 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Sat, 20 May 2023 15:10:19 +0000   Sat, 20 May 2023 15:10:19 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.105.5

	  Hostname:    image-027000

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17784760Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3905972Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17784760Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3905972Ki

	  pods:               110

	System Info:

	  Machine ID:                 c9db1041d74048fa8a9acb4516d0459a

	  System UUID:                c9db1041d74048fa8a9acb4516d0459a

	  Boot ID:                    d3f3f0ec-9a9d-42a6-ac9d-30ef69c9fe51

	  Kernel Version:             5.10.57

	  OS Image:                   Buildroot 2021.02.12

	  Operating System:           linux

	  Architecture:               arm64

	  Container Runtime Version:  docker://20.10.23

	  Kubelet Version:            v1.27.2

	  Kube-Proxy Version:         v1.27.2

	Non-terminated Pods:          (4 in total)

	  Namespace                   Name                                    CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                    ------------  ----------  ---------------  -------------  ---

	  kube-system                 etcd-image-027000                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (2%!)(MISSING)       0 (0%!)(MISSING)         4s

	  kube-system                 kube-apiserver-image-027000             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4s

	  kube-system                 kube-controller-manager-image-027000    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4s

	  kube-system                 kube-scheduler-image-027000             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                650m (32%!)(MISSING)  0 (0%!)(MISSING)

	  memory             100Mi (2%!)(MISSING)  0 (0%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-32Mi     0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-64Ki     0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age              From     Message

	  ----    ------                   ----             ----     -------

	  Normal  Starting                 9s               kubelet  Starting kubelet.

	  Normal  NodeHasSufficientMemory  9s (x8 over 9s)  kubelet  Node image-027000 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    9s (x8 over 9s)  kubelet  Node image-027000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     9s (x7 over 9s)  kubelet  Node image-027000 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  9s               kubelet  Updated Node Allocatable limit across pods

	  Normal  Starting                 4s               kubelet  Starting kubelet.

	  Normal  NodeAllocatableEnforced  4s               kubelet  Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  4s               kubelet  Node image-027000 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    4s               kubelet  Node image-027000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     4s               kubelet  Node image-027000 status is now: NodeHasSufficientPID

	  Normal  NodeReady                1s               kubelet  Node image-027000 status is now: NodeReady

	* 

	* ==> dmesg <==

	* [May20 15:09] ACPI: SRAT not present

	[  +0.000000] KASLR disabled due to lack of seed

	[  +0.650534] EINJ: EINJ table not found.

	[  +0.535231] systemd-fstab-generator[114]: Ignoring "noauto" for root device

	[  +0.043831] systemd[1]: systemd-journald.service: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.

	[  +0.000922] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)

	[May20 15:10] systemd-fstab-generator[474]: Ignoring "noauto" for root device

	[  +0.062884] systemd-fstab-generator[485]: Ignoring "noauto" for root device

	[  +2.689095] systemd-fstab-generator[688]: Ignoring "noauto" for root device

	[  +1.402971] systemd-fstab-generator[849]: Ignoring "noauto" for root device

	[  +0.179876] systemd-fstab-generator[886]: Ignoring "noauto" for root device

	[  +0.080900] systemd-fstab-generator[897]: Ignoring "noauto" for root device

	[  +0.079997] systemd-fstab-generator[910]: Ignoring "noauto" for root device

	[  +1.127259] kauditd_printk_skb: 53 callbacks suppressed

	[  +0.069946] systemd-fstab-generator[1057]: Ignoring "noauto" for root device

	[  +0.081907] systemd-fstab-generator[1068]: Ignoring "noauto" for root device

	[  +0.081507] systemd-fstab-generator[1079]: Ignoring "noauto" for root device

	[  +0.068050] systemd-fstab-generator[1090]: Ignoring "noauto" for root device

	[  +0.072931] systemd-fstab-generator[1130]: Ignoring "noauto" for root device

	[  +2.283970] systemd-fstab-generator[1400]: Ignoring "noauto" for root device

	[  +5.113601] systemd-fstab-generator[2264]: Ignoring "noauto" for root device

	[  +3.544131] kauditd_printk_skb: 41 callbacks suppressed

	* 

	* ==> etcd [c4b124cdb402] <==

	* {"level":"info","ts":"2023-05-20T15:10:12.614Z","caller":"embed/etcd.go:687","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}

	{"level":"info","ts":"2023-05-20T15:10:12.614Z","caller":"embed/etcd.go:275","msg":"now serving peer/client/metrics","local-member-id":"58de0efec1d86300","initial-advertise-peer-urls":["https://192.168.105.5:2380"],"listen-peer-urls":["https://192.168.105.5:2380"],"advertise-client-urls":["https://192.168.105.5:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.105.5:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}

	{"level":"info","ts":"2023-05-20T15:10:12.614Z","caller":"embed/etcd.go:762","msg":"serving metrics","address":"http://127.0.0.1:2381"}

	{"level":"info","ts":"2023-05-20T15:10:12.619Z","caller":"embed/etcd.go:586","msg":"serving peer traffic","address":"192.168.105.5:2380"}

	{"level":"info","ts":"2023-05-20T15:10:12.619Z","caller":"embed/etcd.go:558","msg":"cmux::serve","address":"192.168.105.5:2380"}

	{"level":"info","ts":"2023-05-20T15:10:12.619Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"58de0efec1d86300 switched to configuration voters=(6403572207504089856)"}

	{"level":"info","ts":"2023-05-20T15:10:12.619Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"cd5c0afff2184bea","local-member-id":"58de0efec1d86300","added-peer-id":"58de0efec1d86300","added-peer-peer-urls":["https://192.168.105.5:2380"]}

	{"level":"info","ts":"2023-05-20T15:10:13.594Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"58de0efec1d86300 is starting a new election at term 1"}

	{"level":"info","ts":"2023-05-20T15:10:13.594Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"58de0efec1d86300 became pre-candidate at term 1"}

	{"level":"info","ts":"2023-05-20T15:10:13.594Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"58de0efec1d86300 received MsgPreVoteResp from 58de0efec1d86300 at term 1"}

	{"level":"info","ts":"2023-05-20T15:10:13.595Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"58de0efec1d86300 became candidate at term 2"}

	{"level":"info","ts":"2023-05-20T15:10:13.595Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"58de0efec1d86300 received MsgVoteResp from 58de0efec1d86300 at term 2"}

	{"level":"info","ts":"2023-05-20T15:10:13.595Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"58de0efec1d86300 became leader at term 2"}

	{"level":"info","ts":"2023-05-20T15:10:13.595Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 58de0efec1d86300 elected leader 58de0efec1d86300 at term 2"}

	{"level":"info","ts":"2023-05-20T15:10:13.596Z","caller":"etcdserver/server.go:2571","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}

	{"level":"info","ts":"2023-05-20T15:10:13.597Z","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"58de0efec1d86300","local-member-attributes":"{Name:image-027000 ClientURLs:[https://192.168.105.5:2379]}","request-path":"/0/members/58de0efec1d86300/attributes","cluster-id":"cd5c0afff2184bea","publish-timeout":"7s"}

	{"level":"info","ts":"2023-05-20T15:10:13.598Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"cd5c0afff2184bea","local-member-id":"58de0efec1d86300","cluster-version":"3.5"}

	{"level":"info","ts":"2023-05-20T15:10:13.598Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}

	{"level":"info","ts":"2023-05-20T15:10:13.598Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}

	{"level":"info","ts":"2023-05-20T15:10:13.598Z","caller":"embed/serve.go:100","msg":"ready to serve client requests"}

	{"level":"info","ts":"2023-05-20T15:10:13.599Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}

	{"level":"info","ts":"2023-05-20T15:10:13.599Z","caller":"etcdserver/server.go:2595","msg":"cluster version is updated","cluster-version":"3.5"}

	{"level":"info","ts":"2023-05-20T15:10:13.598Z","caller":"embed/serve.go:100","msg":"ready to serve client requests"}

	{"level":"info","ts":"2023-05-20T15:10:13.601Z","caller":"embed/serve.go:198","msg":"serving client traffic securely","address":"127.0.0.1:2379"}

	{"level":"info","ts":"2023-05-20T15:10:13.601Z","caller":"embed/serve.go:198","msg":"serving client traffic securely","address":"192.168.105.5:2379"}

	* 

	* ==> kernel <==

	*  15:10:20 up 0 min,  0 users,  load average: 1.39, 0.30, 0.10

	Linux image-027000 5.10.57 #1 SMP PREEMPT Mon May 15 19:29:44 UTC 2023 aarch64 GNU/Linux

	PRETTY_NAME="Buildroot 2021.02.12"

	* 

	* ==> kube-apiserver [04cc9796d6f8] <==

	* I0520 15:10:14.314180       1 shared_informer.go:318] Caches are synced for node_authorizer

	I0520 15:10:14.332076       1 cache.go:39] Caches are synced for AvailableConditionController controller

	I0520 15:10:14.332131       1 shared_informer.go:318] Caches are synced for configmaps

	I0520 15:10:14.332087       1 apf_controller.go:366] Running API Priority and Fairness config worker

	I0520 15:10:14.332239       1 apf_controller.go:369] Running API Priority and Fairness periodic rebalancing process

	I0520 15:10:14.332495       1 controller.go:624] quota admission added evaluator for: namespaces

	I0520 15:10:14.332674       1 cache.go:39] Caches are synced for autoregister controller

	I0520 15:10:14.332763       1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller

	I0520 15:10:14.332873       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller

	I0520 15:10:14.342127       1 shared_informer.go:318] Caches are synced for crd-autoregister

	I0520 15:10:14.360981       1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io

	I0520 15:10:15.104050       1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).

	I0520 15:10:15.239868       1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000

	I0520 15:10:15.243471       1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000

	I0520 15:10:15.243486       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.

	I0520 15:10:15.422171       1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io

	I0520 15:10:15.437628       1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io

	I0520 15:10:15.507679       1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs=map[IPv4:10.96.0.1]

	W0520 15:10:15.510140       1 lease.go:251] Resetting endpoints for master service "kubernetes" to [192.168.105.5]

	I0520 15:10:15.510536       1 controller.go:624] quota admission added evaluator for: endpoints

	I0520 15:10:15.511925       1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io

	I0520 15:10:16.304025       1 controller.go:624] quota admission added evaluator for: serviceaccounts

	I0520 15:10:16.671173       1 controller.go:624] quota admission added evaluator for: deployments.apps

	I0520 15:10:16.675315       1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs=map[IPv4:10.96.0.10]

	I0520 15:10:16.679601       1 controller.go:624] quota admission added evaluator for: daemonsets.apps

	* 

	* ==> kube-controller-manager [66eaab5ec87f] <==

	* I0520 15:10:16.754196       1 core.go:228] "Warning: configure-cloud-routes is set, but no cloud provider specified. Will not configure cloud provider routes."

	I0520 15:10:16.754200       1 controllermanager.go:616] "Warning: skipping controller" controller="route"

	I0520 15:10:16.754225       1 certificate_controller.go:112] Starting certificate controller "csrsigning-legacy-unknown"

	I0520 15:10:16.754233       1 shared_informer.go:311] Waiting for caches to sync for certificate-csrsigning-legacy-unknown

	I0520 15:10:16.754259       1 certificate_controller.go:112] Starting certificate controller "csrsigning-kubelet-serving"

	I0520 15:10:16.754265       1 shared_informer.go:311] Waiting for caches to sync for certificate-csrsigning-kubelet-serving

	I0520 15:10:16.754274       1 certificate_controller.go:112] Starting certificate controller "csrsigning-kubelet-client"

	I0520 15:10:16.754278       1 shared_informer.go:311] Waiting for caches to sync for certificate-csrsigning-kubelet-client

	I0520 15:10:16.754287       1 certificate_controller.go:112] Starting certificate controller "csrsigning-kube-apiserver-client"

	I0520 15:10:16.754292       1 shared_informer.go:311] Waiting for caches to sync for certificate-csrsigning-kube-apiserver-client

	I0520 15:10:16.754306       1 dynamic_serving_content.go:132] "Starting controller" name="csr-controller::/var/lib/minikube/certs/ca.crt::/var/lib/minikube/certs/ca.key"

	I0520 15:10:16.754753       1 dynamic_serving_content.go:132] "Starting controller" name="csr-controller::/var/lib/minikube/certs/ca.crt::/var/lib/minikube/certs/ca.key"

	I0520 15:10:16.754772       1 dynamic_serving_content.go:132] "Starting controller" name="csr-controller::/var/lib/minikube/certs/ca.crt::/var/lib/minikube/certs/ca.key"

	I0520 15:10:16.754786       1 dynamic_serving_content.go:132] "Starting controller" name="csr-controller::/var/lib/minikube/certs/ca.crt::/var/lib/minikube/certs/ca.key"

	E0520 15:10:16.802042       1 core.go:213] "Failed to start cloud node lifecycle controller" err="no cloud provider provided"

	I0520 15:10:16.802055       1 controllermanager.go:616] "Warning: skipping controller" controller="cloud-node-lifecycle"

	I0520 15:10:16.952087       1 controllermanager.go:638] "Started controller" controller="deployment"

	I0520 15:10:16.952137       1 deployment_controller.go:168] "Starting controller" controller="deployment"

	I0520 15:10:16.952141       1 shared_informer.go:311] Waiting for caches to sync for deployment

	I0520 15:10:17.159909       1 controllermanager.go:638] "Started controller" controller="disruption"

	I0520 15:10:17.159936       1 disruption.go:423] Sending events to api server.

	I0520 15:10:17.159956       1 disruption.go:434] Starting disruption controller

	I0520 15:10:17.159959       1 shared_informer.go:311] Waiting for caches to sync for disruption

	I0520 15:10:17.302671       1 controllermanager.go:638] "Started controller" controller="bootstrapsigner"

	I0520 15:10:17.302716       1 shared_informer.go:311] Waiting for caches to sync for bootstrap_signer

	* 

	* ==> kube-scheduler [e97f8f7348e9] <==

	* W0520 15:10:14.310661       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	W0520 15:10:14.310690       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	W0520 15:10:14.310727       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0520 15:10:14.310736       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0520 15:10:14.310759       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	W0520 15:10:14.310765       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0520 15:10:14.310833       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0520 15:10:14.310690       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	W0520 15:10:14.310662       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E0520 15:10:14.310932       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	W0520 15:10:14.310790       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E0520 15:10:14.310971       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	W0520 15:10:15.219127       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E0520 15:10:15.219193       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	W0520 15:10:15.228731       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0520 15:10:15.228768       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	W0520 15:10:15.295608       1 reflector.go:533] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0520 15:10:15.295661       1 reflector.go:148] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	W0520 15:10:15.297381       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E0520 15:10:15.297427       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	W0520 15:10:15.300970       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E0520 15:10:15.301021       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	W0520 15:10:15.319332       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0520 15:10:15.319350       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	I0520 15:10:18.003417       1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	* 

	* ==> kubelet <==

	* -- Journal begins at Sat 2023-05-20 15:09:59 UTC, ends at Sat 2023-05-20 15:10:20 UTC. --

	May 20 15:10:16 image-027000 kubelet[2270]: I0520 15:10:16.845556    2270 topology_manager.go:212] "Topology Admit Handler"

	May 20 15:10:16 image-027000 kubelet[2270]: I0520 15:10:16.845569    2270 topology_manager.go:212] "Topology Admit Handler"

	May 20 15:10:16 image-027000 kubelet[2270]: I0520 15:10:16.872723    2270 kubelet_node_status.go:70] "Attempting to register node" node="image-027000"

	May 20 15:10:16 image-027000 kubelet[2270]: I0520 15:10:16.876793    2270 kubelet_node_status.go:108] "Node was previously registered" node="image-027000"

	May 20 15:10:16 image-027000 kubelet[2270]: I0520 15:10:16.876831    2270 kubelet_node_status.go:73] "Successfully registered node" node="image-027000"

	May 20 15:10:17 image-027000 kubelet[2270]: I0520 15:10:17.021869    2270 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/host-path/92e08e6d69d90847af27e586ecafb946-ca-certs\") pod \"kube-controller-manager-image-027000\" (UID: \"92e08e6d69d90847af27e586ecafb946\") " pod="kube-system/kube-controller-manager-image-027000"

	May 20 15:10:17 image-027000 kubelet[2270]: I0520 15:10:17.021893    2270 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"k8s-certs\" (UniqueName: \"kubernetes.io/host-path/92e08e6d69d90847af27e586ecafb946-k8s-certs\") pod \"kube-controller-manager-image-027000\" (UID: \"92e08e6d69d90847af27e586ecafb946\") " pod="kube-system/kube-controller-manager-image-027000"

	May 20 15:10:17 image-027000 kubelet[2270]: I0520 15:10:17.021905    2270 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/92e08e6d69d90847af27e586ecafb946-usr-share-ca-certificates\") pod \"kube-controller-manager-image-027000\" (UID: \"92e08e6d69d90847af27e586ecafb946\") " pod="kube-system/kube-controller-manager-image-027000"

	May 20 15:10:17 image-027000 kubelet[2270]: I0520 15:10:17.021920    2270 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/host-path/98b191e722c2131818ad5075d1522add-ca-certs\") pod \"kube-apiserver-image-027000\" (UID: \"98b191e722c2131818ad5075d1522add\") " pod="kube-system/kube-apiserver-image-027000"

	May 20 15:10:17 image-027000 kubelet[2270]: I0520 15:10:17.021929    2270 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"k8s-certs\" (UniqueName: \"kubernetes.io/host-path/98b191e722c2131818ad5075d1522add-k8s-certs\") pod \"kube-apiserver-image-027000\" (UID: \"98b191e722c2131818ad5075d1522add\") " pod="kube-system/kube-apiserver-image-027000"

	May 20 15:10:17 image-027000 kubelet[2270]: I0520 15:10:17.021938    2270 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/98b191e722c2131818ad5075d1522add-usr-share-ca-certificates\") pod \"kube-apiserver-image-027000\" (UID: \"98b191e722c2131818ad5075d1522add\") " pod="kube-system/kube-apiserver-image-027000"

	May 20 15:10:17 image-027000 kubelet[2270]: I0520 15:10:17.021949    2270 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"flexvolume-dir\" (UniqueName: \"kubernetes.io/host-path/92e08e6d69d90847af27e586ecafb946-flexvolume-dir\") pod \"kube-controller-manager-image-027000\" (UID: \"92e08e6d69d90847af27e586ecafb946\") " pod="kube-system/kube-controller-manager-image-027000"

	May 20 15:10:17 image-027000 kubelet[2270]: I0520 15:10:17.021958    2270 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/92e08e6d69d90847af27e586ecafb946-kubeconfig\") pod \"kube-controller-manager-image-027000\" (UID: \"92e08e6d69d90847af27e586ecafb946\") " pod="kube-system/kube-controller-manager-image-027000"

	May 20 15:10:17 image-027000 kubelet[2270]: I0520 15:10:17.021969    2270 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/eae2b68056b76120db86be9cc15aedd7-kubeconfig\") pod \"kube-scheduler-image-027000\" (UID: \"eae2b68056b76120db86be9cc15aedd7\") " pod="kube-system/kube-scheduler-image-027000"

	May 20 15:10:17 image-027000 kubelet[2270]: I0520 15:10:17.021977    2270 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-certs\" (UniqueName: \"kubernetes.io/host-path/e7d793788e682ff2c52b559bbe31813c-etcd-certs\") pod \"etcd-image-027000\" (UID: \"e7d793788e682ff2c52b559bbe31813c\") " pod="kube-system/etcd-image-027000"

	May 20 15:10:17 image-027000 kubelet[2270]: I0520 15:10:17.021986    2270 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-data\" (UniqueName: \"kubernetes.io/host-path/e7d793788e682ff2c52b559bbe31813c-etcd-data\") pod \"etcd-image-027000\" (UID: \"e7d793788e682ff2c52b559bbe31813c\") " pod="kube-system/etcd-image-027000"

	May 20 15:10:17 image-027000 kubelet[2270]: I0520 15:10:17.710260    2270 apiserver.go:52] "Watching apiserver"

	May 20 15:10:17 image-027000 kubelet[2270]: I0520 15:10:17.720976    2270 desired_state_of_world_populator.go:153] "Finished populating initial desired state of world"

	May 20 15:10:17 image-027000 kubelet[2270]: I0520 15:10:17.728245    2270 reconciler.go:41] "Reconciler: start to sync state"

	May 20 15:10:17 image-027000 kubelet[2270]: E0520 15:10:17.780775    2270 kubelet.go:1856] "Failed creating a mirror pod for" err="pods \"kube-apiserver-image-027000\" already exists" pod="kube-system/kube-apiserver-image-027000"

	May 20 15:10:17 image-027000 kubelet[2270]: I0520 15:10:17.789947    2270 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="kube-system/kube-scheduler-image-027000" podStartSLOduration=1.789922259 podCreationTimestamp="2023-05-20 15:10:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2023-05-20 15:10:17.78976455 +0000 UTC m=+1.131092127" watchObservedRunningTime="2023-05-20 15:10:17.789922259 +0000 UTC m=+1.131249835"

	May 20 15:10:17 image-027000 kubelet[2270]: I0520 15:10:17.793938    2270 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="kube-system/etcd-image-027000" podStartSLOduration=1.793918134 podCreationTimestamp="2023-05-20 15:10:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2023-05-20 15:10:17.793830384 +0000 UTC m=+1.135157960" watchObservedRunningTime="2023-05-20 15:10:17.793918134 +0000 UTC m=+1.135245710"

	May 20 15:10:17 image-027000 kubelet[2270]: I0520 15:10:17.797651    2270 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="kube-system/kube-controller-manager-image-027000" podStartSLOduration=1.797635175 podCreationTimestamp="2023-05-20 15:10:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2023-05-20 15:10:17.797566217 +0000 UTC m=+1.138893794" watchObservedRunningTime="2023-05-20 15:10:17.797635175 +0000 UTC m=+1.138962752"

	May 20 15:10:17 image-027000 kubelet[2270]: I0520 15:10:17.807814    2270 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="kube-system/kube-apiserver-image-027000" podStartSLOduration=1.807789467 podCreationTimestamp="2023-05-20 15:10:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2023-05-20 15:10:17.806433592 +0000 UTC m=+1.147761169" watchObservedRunningTime="2023-05-20 15:10:17.807789467 +0000 UTC m=+1.149117044"

	May 20 15:10:19 image-027000 kubelet[2270]: I0520 15:10:19.249728    2270 kubelet_node_status.go:493] "Fast updating node status as it just became ready"

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.APIServer}} -p image-027000 -n image-027000

helpers_test.go:261: (dbg) Run:  kubectl --context image-027000 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:272: non-running pods: storage-provisioner

helpers_test.go:274: ======> post-mortem[TestImageBuild/serial/BuildWithBuildArg]: describe non-running pods <======

helpers_test.go:277: (dbg) Run:  kubectl --context image-027000 describe pod storage-provisioner

helpers_test.go:277: (dbg) Non-zero exit: kubectl --context image-027000 describe pod storage-provisioner: exit status 1 (39.276917ms)

** stderr ** 

	Error from server (NotFound): pods "storage-provisioner" not found

** /stderr **

helpers_test.go:279: kubectl --context image-027000 describe pod storage-provisioner: exit status 1

--- FAIL: TestImageBuild/serial/BuildWithBuildArg (1.14s)

=== RUN   TestIngressAddonLegacy/serial/ValidateIngressAddons

addons_test.go:183: (dbg) Run:  kubectl --context ingress-addon-legacy-371000 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s

addons_test.go:183: (dbg) Done: kubectl --context ingress-addon-legacy-371000 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s: (16.705611s)

addons_test.go:208: (dbg) Run:  kubectl --context ingress-addon-legacy-371000 replace --force -f testdata/nginx-ingress-v1beta1.yaml

addons_test.go:221: (dbg) Run:  kubectl --context ingress-addon-legacy-371000 replace --force -f testdata/nginx-pod-svc.yaml

addons_test.go:226: (dbg) TestIngressAddonLegacy/serial/ValidateIngressAddons: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...

helpers_test.go:344: "nginx" [efa26872-25f8-49b1-a4bf-55bb27262e63] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])

helpers_test.go:344: "nginx" [efa26872-25f8-49b1-a4bf-55bb27262e63] Running

addons_test.go:226: (dbg) TestIngressAddonLegacy/serial/ValidateIngressAddons: run=nginx healthy within 10.012509125s

addons_test.go:238: (dbg) Run:  out/minikube-darwin-arm64 -p ingress-addon-legacy-371000 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"

addons_test.go:262: (dbg) Run:  kubectl --context ingress-addon-legacy-371000 replace --force -f testdata/ingress-dns-example-v1beta1.yaml

addons_test.go:267: (dbg) Run:  out/minikube-darwin-arm64 -p ingress-addon-legacy-371000 ip

addons_test.go:273: (dbg) Run:  nslookup hello-john.test 192.168.105.6

addons_test.go:273: (dbg) Non-zero exit: nslookup hello-john.test 192.168.105.6: exit status 1 (15.038410708s)

-- stdout --

	;; connection timed out; no servers could be reached

-- /stdout --

addons_test.go:275: failed to nslookup hello-john.test host. args "nslookup hello-john.test 192.168.105.6" : exit status 1

addons_test.go:279: unexpected output from nslookup. stdout: ;; connection timed out; no servers could be reached

stderr: 

addons_test.go:282: (dbg) Run:  out/minikube-darwin-arm64 -p ingress-addon-legacy-371000 addons disable ingress-dns --alsologtostderr -v=1

addons_test.go:282: (dbg) Done: out/minikube-darwin-arm64 -p ingress-addon-legacy-371000 addons disable ingress-dns --alsologtostderr -v=1: (4.127092792s)

addons_test.go:287: (dbg) Run:  out/minikube-darwin-arm64 -p ingress-addon-legacy-371000 addons disable ingress --alsologtostderr -v=1

addons_test.go:287: (dbg) Done: out/minikube-darwin-arm64 -p ingress-addon-legacy-371000 addons disable ingress --alsologtostderr -v=1: (7.064546333s)

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p ingress-addon-legacy-371000 -n ingress-addon-legacy-371000

helpers_test.go:244: <<< TestIngressAddonLegacy/serial/ValidateIngressAddons FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestIngressAddonLegacy/serial/ValidateIngressAddons]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-darwin-arm64 -p ingress-addon-legacy-371000 logs -n 25

helpers_test.go:252: TestIngressAddonLegacy/serial/ValidateIngressAddons logs: 

-- stdout --

	* 

	* ==> Audit <==

	* |----------------|------------------------------------------|-----------------------------|---------|---------|---------------------|---------------------|

	|    Command     |                   Args                   |           Profile           |  User   | Version |     Start Time      |      End Time       |

	|----------------|------------------------------------------|-----------------------------|---------|---------|---------------------|---------------------|

	| dashboard      | --url --port 36195                       | functional-537000           | jenkins | v1.30.1 | 20 May 23 08:09 PDT | 20 May 23 08:09 PDT |

	|                | -p functional-537000                     |                             |         |         |                     |                     |

	|                | --alsologtostderr -v=1                   |                             |         |         |                     |                     |

	| update-context | functional-537000                        | functional-537000           | jenkins | v1.30.1 | 20 May 23 08:09 PDT | 20 May 23 08:09 PDT |

	|                | update-context                           |                             |         |         |                     |                     |

	|                | --alsologtostderr -v=2                   |                             |         |         |                     |                     |

	| update-context | functional-537000                        | functional-537000           | jenkins | v1.30.1 | 20 May 23 08:09 PDT | 20 May 23 08:09 PDT |

	|                | update-context                           |                             |         |         |                     |                     |

	|                | --alsologtostderr -v=2                   |                             |         |         |                     |                     |

	| update-context | functional-537000                        | functional-537000           | jenkins | v1.30.1 | 20 May 23 08:09 PDT | 20 May 23 08:09 PDT |

	|                | update-context                           |                             |         |         |                     |                     |

	|                | --alsologtostderr -v=2                   |                             |         |         |                     |                     |

	| image          | functional-537000                        | functional-537000           | jenkins | v1.30.1 | 20 May 23 08:09 PDT | 20 May 23 08:09 PDT |

	|                | image ls --format short                  |                             |         |         |                     |                     |

	|                | --alsologtostderr                        |                             |         |         |                     |                     |

	| image          | functional-537000                        | functional-537000           | jenkins | v1.30.1 | 20 May 23 08:09 PDT | 20 May 23 08:09 PDT |

	|                | image ls --format yaml                   |                             |         |         |                     |                     |

	|                | --alsologtostderr                        |                             |         |         |                     |                     |

	| ssh            | functional-537000 ssh pgrep              | functional-537000           | jenkins | v1.30.1 | 20 May 23 08:09 PDT |                     |

	|                | buildkitd                                |                             |         |         |                     |                     |

	| image          | functional-537000 image build -t         | functional-537000           | jenkins | v1.30.1 | 20 May 23 08:09 PDT | 20 May 23 08:09 PDT |

	|                | localhost/my-image:functional-537000     |                             |         |         |                     |                     |

	|                | testdata/build --alsologtostderr         |                             |         |         |                     |                     |

	| image          | functional-537000 image ls               | functional-537000           | jenkins | v1.30.1 | 20 May 23 08:09 PDT | 20 May 23 08:09 PDT |

	| image          | functional-537000                        | functional-537000           | jenkins | v1.30.1 | 20 May 23 08:09 PDT | 20 May 23 08:09 PDT |

	|                | image ls --format json                   |                             |         |         |                     |                     |

	|                | --alsologtostderr                        |                             |         |         |                     |                     |

	| image          | functional-537000                        | functional-537000           | jenkins | v1.30.1 | 20 May 23 08:09 PDT | 20 May 23 08:09 PDT |

	|                | image ls --format table                  |                             |         |         |                     |                     |

	|                | --alsologtostderr                        |                             |         |         |                     |                     |

	| delete         | -p functional-537000                     | functional-537000           | jenkins | v1.30.1 | 20 May 23 08:09 PDT | 20 May 23 08:09 PDT |

	| start          | -p image-027000 --driver=qemu2           | image-027000                | jenkins | v1.30.1 | 20 May 23 08:09 PDT | 20 May 23 08:10 PDT |

	|                |                                          |                             |         |         |                     |                     |

	| image          | build -t aaa:latest                      | image-027000                | jenkins | v1.30.1 | 20 May 23 08:10 PDT | 20 May 23 08:10 PDT |

	|                | ./testdata/image-build/test-normal       |                             |         |         |                     |                     |

	|                | -p image-027000                          |                             |         |         |                     |                     |

	| image          | build -t aaa:latest                      | image-027000                | jenkins | v1.30.1 | 20 May 23 08:10 PDT | 20 May 23 08:10 PDT |

	|                | --build-opt=build-arg=ENV_A=test_env_str |                             |         |         |                     |                     |

	|                | --build-opt=no-cache                     |                             |         |         |                     |                     |

	|                | ./testdata/image-build/test-arg -p       |                             |         |         |                     |                     |

	|                | image-027000                             |                             |         |         |                     |                     |

	| image          | build -t aaa:latest                      | image-027000                | jenkins | v1.30.1 | 20 May 23 08:10 PDT | 20 May 23 08:10 PDT |

	|                | ./testdata/image-build/test-normal       |                             |         |         |                     |                     |

	|                | --build-opt=no-cache -p                  |                             |         |         |                     |                     |

	|                | image-027000                             |                             |         |         |                     |                     |

	| image          | build -t aaa:latest                      | image-027000                | jenkins | v1.30.1 | 20 May 23 08:10 PDT | 20 May 23 08:10 PDT |

	|                | -f inner/Dockerfile                      |                             |         |         |                     |                     |

	|                | ./testdata/image-build/test-f            |                             |         |         |                     |                     |

	|                | -p image-027000                          |                             |         |         |                     |                     |

	| delete         | -p image-027000                          | image-027000                | jenkins | v1.30.1 | 20 May 23 08:10 PDT | 20 May 23 08:10 PDT |

	| start          | -p ingress-addon-legacy-371000           | ingress-addon-legacy-371000 | jenkins | v1.30.1 | 20 May 23 08:10 PDT | 20 May 23 08:11 PDT |

	|                | --kubernetes-version=v1.18.20            |                             |         |         |                     |                     |

	|                | --memory=4096 --wait=true                |                             |         |         |                     |                     |

	|                | --alsologtostderr -v=5                   |                             |         |         |                     |                     |

	|                | --driver=qemu2                           |                             |         |         |                     |                     |

	| addons         | ingress-addon-legacy-371000              | ingress-addon-legacy-371000 | jenkins | v1.30.1 | 20 May 23 08:11 PDT | 20 May 23 08:11 PDT |

	|                | addons enable ingress                    |                             |         |         |                     |                     |

	|                | --alsologtostderr -v=5                   |                             |         |         |                     |                     |

	| addons         | ingress-addon-legacy-371000              | ingress-addon-legacy-371000 | jenkins | v1.30.1 | 20 May 23 08:11 PDT | 20 May 23 08:11 PDT |

	|                | addons enable ingress-dns                |                             |         |         |                     |                     |

	|                | --alsologtostderr -v=5                   |                             |         |         |                     |                     |

	| ssh            | ingress-addon-legacy-371000              | ingress-addon-legacy-371000 | jenkins | v1.30.1 | 20 May 23 08:12 PDT | 20 May 23 08:12 PDT |

	|                | ssh curl -s http://127.0.0.1/            |                             |         |         |                     |                     |

	|                | -H 'Host: nginx.example.com'             |                             |         |         |                     |                     |

	| ip             | ingress-addon-legacy-371000 ip           | ingress-addon-legacy-371000 | jenkins | v1.30.1 | 20 May 23 08:12 PDT | 20 May 23 08:12 PDT |

	| addons         | ingress-addon-legacy-371000              | ingress-addon-legacy-371000 | jenkins | v1.30.1 | 20 May 23 08:12 PDT | 20 May 23 08:12 PDT |

	|                | addons disable ingress-dns               |                             |         |         |                     |                     |

	|                | --alsologtostderr -v=1                   |                             |         |         |                     |                     |

	| addons         | ingress-addon-legacy-371000              | ingress-addon-legacy-371000 | jenkins | v1.30.1 | 20 May 23 08:12 PDT | 20 May 23 08:12 PDT |

	|                | addons disable ingress                   |                             |         |         |                     |                     |

	|                | --alsologtostderr -v=1                   |                             |         |         |                     |                     |

	|----------------|------------------------------------------|-----------------------------|---------|---------|---------------------|---------------------|

	* 

	* ==> Last Start <==

	* Log file created at: 2023/05/20 08:10:21

	Running on machine: MacOS-M1-Agent-1

	Binary: Built with gc go1.20.4 for darwin/arm64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0520 08:10:21.157345    2411 out.go:296] Setting OutFile to fd 1 ...

	I0520 08:10:21.157474    2411 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0520 08:10:21.157477    2411 out.go:309] Setting ErrFile to fd 2...

	I0520 08:10:21.157480    2411 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0520 08:10:21.157560    2411 root.go:336] Updating PATH: /Users/jenkins/minikube-integration/16543-1012/.minikube/bin

	I0520 08:10:21.158610    2411 out.go:303] Setting JSON to false

	I0520 08:10:21.174932    2411 start.go:125] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":592,"bootTime":1684594829,"procs":451,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"13.3.1","kernelVersion":"22.4.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}

	W0520 08:10:21.175015    2411 start.go:133] gopshost.Virtualization returned error: not implemented yet

	I0520 08:10:21.179416    2411 out.go:177] * [ingress-addon-legacy-371000] minikube v1.30.1 on Darwin 13.3.1 (arm64)

	I0520 08:10:21.187412    2411 out.go:177]   - MINIKUBE_LOCATION=16543

	I0520 08:10:21.187466    2411 notify.go:220] Checking for updates...

	I0520 08:10:21.194553    2411 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/16543-1012/kubeconfig

	I0520 08:10:21.197504    2411 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0520 08:10:21.201456    2411 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0520 08:10:21.204554    2411 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/16543-1012/.minikube

	I0520 08:10:21.207337    2411 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0520 08:10:21.210638    2411 driver.go:375] Setting default libvirt URI to qemu:///system

	I0520 08:10:21.214441    2411 out.go:177] * Using the qemu2 driver based on user configuration

	I0520 08:10:21.220383    2411 start.go:295] selected driver: qemu2

	I0520 08:10:21.220392    2411 start.go:870] validating driver "qemu2" against <nil>

	I0520 08:10:21.220400    2411 start.go:881] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0520 08:10:21.222625    2411 start_flags.go:305] no existing cluster config was found, will generate one from the flags 

	I0520 08:10:21.226396    2411 out.go:177] * Automatically selected the socket_vmnet network

	I0520 08:10:21.229507    2411 start_flags.go:915] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0520 08:10:21.229531    2411 cni.go:84] Creating CNI manager for ""

	I0520 08:10:21.229541    2411 cni.go:161] CNI unnecessary in this configuration, recommending no CNI

	I0520 08:10:21.229545    2411 start_flags.go:319] config:

	{Name:ingress-addon-legacy-371000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684523789-16533@sha256:ed200ff6d686f303885e8aaf964442d08018856d63a8e23f7acdc068766ea82b Memory:4096 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-371000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.loc

al ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP

:}

	I0520 08:10:21.229635    2411 iso.go:125] acquiring lock: {Name:mkf05a14b47e9b67445252fbb4917f3bcb37f054 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0520 08:10:21.237389    2411 out.go:177] * Starting control plane node ingress-addon-legacy-371000 in cluster ingress-addon-legacy-371000

	I0520 08:10:21.241453    2411 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime docker

	I0520 08:10:21.436055    2411 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.18.20/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4

	I0520 08:10:21.436152    2411 cache.go:57] Caching tarball of preloaded images

	I0520 08:10:21.436860    2411 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime docker

	I0520 08:10:21.441523    2411 out.go:177] * Downloading Kubernetes v1.18.20 preload ...

	I0520 08:10:21.449391    2411 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4 ...

	I0520 08:10:21.665904    2411 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.18.20/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4?checksum=md5:c8c260b886393123ce9d312d8ac2379e -> /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4

	I0520 08:10:33.169424    2411 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4 ...

	I0520 08:10:33.169585    2411 preload.go:256] verifying checksum of /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4 ...

	I0520 08:10:33.919997    2411 cache.go:60] Finished verifying existence of preloaded tar for  v1.18.20 on docker

	I0520 08:10:33.920195    2411 profile.go:148] Saving config to /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/config.json ...

	I0520 08:10:33.920218    2411 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/config.json: {Name:mk3d395a29cdb1c480d5313c94c91459cd335273 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0520 08:10:33.920463    2411 cache.go:195] Successfully downloaded all kic artifacts

	I0520 08:10:33.920473    2411 start.go:364] acquiring machines lock for ingress-addon-legacy-371000: {Name:mk270c257f49033ffda3b70fea9b877c78314aa8 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0520 08:10:33.920500    2411 start.go:368] acquired machines lock for "ingress-addon-legacy-371000" in 23.583µs

	I0520 08:10:33.920519    2411 start.go:93] Provisioning new machine with config: &{Name:ingress-addon-legacy-371000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/16506/minikube-v1.30.1-1684174510-16506-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684523789-16533@sha256:ed200ff6d686f303885e8aaf964442d08018856d63a8e23f7acdc068766ea82b Memory:4096 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 K

ubernetesConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-371000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:doc

ker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:} &{Name: IP: Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0520 08:10:33.920552    2411 start.go:125] createHost starting for "" (driver="qemu2")

	I0520 08:10:33.925548    2411 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=4096MB, Disk=20000MB) ...

	I0520 08:10:33.946111    2411 start.go:159] libmachine.API.Create for "ingress-addon-legacy-371000" (driver="qemu2")

	I0520 08:10:33.946147    2411 client.go:168] LocalClient.Create starting

	I0520 08:10:33.946241    2411 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/ca.pem

	I0520 08:10:33.946263    2411 main.go:141] libmachine: Decoding PEM data...

	I0520 08:10:33.946277    2411 main.go:141] libmachine: Parsing certificate...

	I0520 08:10:33.946321    2411 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/cert.pem

	I0520 08:10:33.946340    2411 main.go:141] libmachine: Decoding PEM data...

	I0520 08:10:33.946348    2411 main.go:141] libmachine: Parsing certificate...

	I0520 08:10:33.946677    2411 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/16543-1012/.minikube/cache/iso/arm64/minikube-v1.30.1-1684174510-16506-arm64.iso...

	I0520 08:10:34.108664    2411 main.go:141] libmachine: Creating SSH key...

	I0520 08:10:34.200678    2411 main.go:141] libmachine: Creating Disk image...

	I0520 08:10:34.200683    2411 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0520 08:10:34.200827    2411 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/ingress-addon-legacy-371000/disk.qcow2.raw /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/ingress-addon-legacy-371000/disk.qcow2

	I0520 08:10:34.216883    2411 main.go:141] libmachine: STDOUT: 

	I0520 08:10:34.216900    2411 main.go:141] libmachine: STDERR: 

	I0520 08:10:34.216952    2411 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/ingress-addon-legacy-371000/disk.qcow2 +20000M

	I0520 08:10:34.224061    2411 main.go:141] libmachine: STDOUT: Image resized.

	I0520 08:10:34.224075    2411 main.go:141] libmachine: STDERR: 

	I0520 08:10:34.224088    2411 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/ingress-addon-legacy-371000/disk.qcow2.raw and /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/ingress-addon-legacy-371000/disk.qcow2

	I0520 08:10:34.224101    2411 main.go:141] libmachine: Starting QEMU VM...

	I0520 08:10:34.224130    2411 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt -cpu host -drive file=/opt/homebrew/Cellar/qemu/7.2.0/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 4096 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/ingress-addon-legacy-371000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/ingress-addon-legacy-371000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/ingress-addon-legacy-371000/qemu.pid -device virtio-net-pci,netdev=net0,mac=32:58:8d:07:2e:d4 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/ingress-addon-legacy-371000/disk.qcow2

	I0520 08:10:34.273178    2411 main.go:141] libmachine: STDOUT: 

	I0520 08:10:34.273201    2411 main.go:141] libmachine: STDERR: 

	I0520 08:10:34.273205    2411 main.go:141] libmachine: Attempt 0

	I0520 08:10:34.273220    2411 main.go:141] libmachine: Searching for 32:58:8d:7:2e:d4 in /var/db/dhcpd_leases ...

	I0520 08:10:34.273285    2411 main.go:141] libmachine: Found 4 entries in /var/db/dhcpd_leases!

	I0520 08:10:34.273308    2411 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.5 HWAddress:ea:9f:53:ae:c6:fe ID:1,ea:9f:53:ae:c6:fe Lease:0x646a3447}

	I0520 08:10:34.273315    2411 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.4 HWAddress:6:5b:64:76:26:39 ID:1,6:5b:64:76:26:39 Lease:0x646a3369}

	I0520 08:10:34.273321    2411 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.3 HWAddress:8a:69:5a:cb:74:51 ID:1,8a:69:5a:cb:74:51 Lease:0x6468e1dc}

	I0520 08:10:34.273326    2411 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:36:b1:60:c3:d2:35 ID:1,36:b1:60:c3:d2:35 Lease:0x646a3311}

	I0520 08:10:36.275444    2411 main.go:141] libmachine: Attempt 1

	I0520 08:10:36.275525    2411 main.go:141] libmachine: Searching for 32:58:8d:7:2e:d4 in /var/db/dhcpd_leases ...

	I0520 08:10:36.275975    2411 main.go:141] libmachine: Found 4 entries in /var/db/dhcpd_leases!

	I0520 08:10:36.276027    2411 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.5 HWAddress:ea:9f:53:ae:c6:fe ID:1,ea:9f:53:ae:c6:fe Lease:0x646a3447}

	I0520 08:10:36.276099    2411 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.4 HWAddress:6:5b:64:76:26:39 ID:1,6:5b:64:76:26:39 Lease:0x646a3369}

	I0520 08:10:36.276159    2411 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.3 HWAddress:8a:69:5a:cb:74:51 ID:1,8a:69:5a:cb:74:51 Lease:0x6468e1dc}

	I0520 08:10:36.276190    2411 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:36:b1:60:c3:d2:35 ID:1,36:b1:60:c3:d2:35 Lease:0x646a3311}

	I0520 08:10:38.278312    2411 main.go:141] libmachine: Attempt 2

	I0520 08:10:38.278342    2411 main.go:141] libmachine: Searching for 32:58:8d:7:2e:d4 in /var/db/dhcpd_leases ...

	I0520 08:10:38.278441    2411 main.go:141] libmachine: Found 4 entries in /var/db/dhcpd_leases!

	I0520 08:10:38.278454    2411 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.5 HWAddress:ea:9f:53:ae:c6:fe ID:1,ea:9f:53:ae:c6:fe Lease:0x646a3447}

	I0520 08:10:38.278460    2411 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.4 HWAddress:6:5b:64:76:26:39 ID:1,6:5b:64:76:26:39 Lease:0x646a3369}

	I0520 08:10:38.278465    2411 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.3 HWAddress:8a:69:5a:cb:74:51 ID:1,8a:69:5a:cb:74:51 Lease:0x6468e1dc}

	I0520 08:10:38.278471    2411 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:36:b1:60:c3:d2:35 ID:1,36:b1:60:c3:d2:35 Lease:0x646a3311}

	I0520 08:10:40.280558    2411 main.go:141] libmachine: Attempt 3

	I0520 08:10:40.280620    2411 main.go:141] libmachine: Searching for 32:58:8d:7:2e:d4 in /var/db/dhcpd_leases ...

	I0520 08:10:40.280739    2411 main.go:141] libmachine: Found 4 entries in /var/db/dhcpd_leases!

	I0520 08:10:40.280769    2411 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.5 HWAddress:ea:9f:53:ae:c6:fe ID:1,ea:9f:53:ae:c6:fe Lease:0x646a3447}

	I0520 08:10:40.280775    2411 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.4 HWAddress:6:5b:64:76:26:39 ID:1,6:5b:64:76:26:39 Lease:0x646a3369}

	I0520 08:10:40.280781    2411 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.3 HWAddress:8a:69:5a:cb:74:51 ID:1,8a:69:5a:cb:74:51 Lease:0x6468e1dc}

	I0520 08:10:40.280787    2411 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:36:b1:60:c3:d2:35 ID:1,36:b1:60:c3:d2:35 Lease:0x646a3311}

	I0520 08:10:42.282895    2411 main.go:141] libmachine: Attempt 4

	I0520 08:10:42.282934    2411 main.go:141] libmachine: Searching for 32:58:8d:7:2e:d4 in /var/db/dhcpd_leases ...

	I0520 08:10:42.283030    2411 main.go:141] libmachine: Found 4 entries in /var/db/dhcpd_leases!

	I0520 08:10:42.283037    2411 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.5 HWAddress:ea:9f:53:ae:c6:fe ID:1,ea:9f:53:ae:c6:fe Lease:0x646a3447}

	I0520 08:10:42.283045    2411 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.4 HWAddress:6:5b:64:76:26:39 ID:1,6:5b:64:76:26:39 Lease:0x646a3369}

	I0520 08:10:42.283051    2411 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.3 HWAddress:8a:69:5a:cb:74:51 ID:1,8a:69:5a:cb:74:51 Lease:0x6468e1dc}

	I0520 08:10:42.283056    2411 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:36:b1:60:c3:d2:35 ID:1,36:b1:60:c3:d2:35 Lease:0x646a3311}

	I0520 08:10:44.285127    2411 main.go:141] libmachine: Attempt 5

	I0520 08:10:44.285147    2411 main.go:141] libmachine: Searching for 32:58:8d:7:2e:d4 in /var/db/dhcpd_leases ...

	I0520 08:10:44.285213    2411 main.go:141] libmachine: Found 4 entries in /var/db/dhcpd_leases!

	I0520 08:10:44.285223    2411 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.5 HWAddress:ea:9f:53:ae:c6:fe ID:1,ea:9f:53:ae:c6:fe Lease:0x646a3447}

	I0520 08:10:44.285229    2411 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.4 HWAddress:6:5b:64:76:26:39 ID:1,6:5b:64:76:26:39 Lease:0x646a3369}

	I0520 08:10:44.285234    2411 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.3 HWAddress:8a:69:5a:cb:74:51 ID:1,8a:69:5a:cb:74:51 Lease:0x6468e1dc}

	I0520 08:10:44.285253    2411 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:36:b1:60:c3:d2:35 ID:1,36:b1:60:c3:d2:35 Lease:0x646a3311}

	I0520 08:10:46.287321    2411 main.go:141] libmachine: Attempt 6

	I0520 08:10:46.287368    2411 main.go:141] libmachine: Searching for 32:58:8d:7:2e:d4 in /var/db/dhcpd_leases ...

	I0520 08:10:46.287488    2411 main.go:141] libmachine: Found 5 entries in /var/db/dhcpd_leases!

	I0520 08:10:46.287501    2411 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.6 HWAddress:32:58:8d:7:2e:d4 ID:1,32:58:8d:7:2e:d4 Lease:0x646a3475}

	I0520 08:10:46.287507    2411 main.go:141] libmachine: Found match: 32:58:8d:7:2e:d4

	I0520 08:10:46.287522    2411 main.go:141] libmachine: IP: 192.168.105.6

	I0520 08:10:46.287529    2411 main.go:141] libmachine: Waiting for VM to start (ssh -p 22 docker@192.168.105.6)...

	I0520 08:10:48.308535    2411 machine.go:88] provisioning docker machine ...

	I0520 08:10:48.308617    2411 buildroot.go:166] provisioning hostname "ingress-addon-legacy-371000"

	I0520 08:10:48.308902    2411 main.go:141] libmachine: Using SSH client type: native

	I0520 08:10:48.309917    2411 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x104f086d0] 0x104f0b130 <nil>  [] 0s} 192.168.105.6 22 <nil> <nil>}

	I0520 08:10:48.309944    2411 main.go:141] libmachine: About to run SSH command:

	sudo hostname ingress-addon-legacy-371000 && echo "ingress-addon-legacy-371000" | sudo tee /etc/hostname

	I0520 08:10:48.405979    2411 main.go:141] libmachine: SSH cmd err, output: <nil>: ingress-addon-legacy-371000

	I0520 08:10:48.406105    2411 main.go:141] libmachine: Using SSH client type: native

	I0520 08:10:48.406599    2411 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x104f086d0] 0x104f0b130 <nil>  [] 0s} 192.168.105.6 22 <nil> <nil>}

	I0520 08:10:48.406619    2411 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\singress-addon-legacy-371000' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ingress-addon-legacy-371000/g' /etc/hosts;

				else 

					echo '127.0.1.1 ingress-addon-legacy-371000' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0520 08:10:48.484288    2411 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0520 08:10:48.484307    2411 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/16543-1012/.minikube CaCertPath:/Users/jenkins/minikube-integration/16543-1012/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/16543-1012/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/16543-1012/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/16543-1012/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/16543-1012/.minikube}

	I0520 08:10:48.484319    2411 buildroot.go:174] setting up certificates

	I0520 08:10:48.484333    2411 provision.go:83] configureAuth start

	I0520 08:10:48.484342    2411 provision.go:138] copyHostCerts

	I0520 08:10:48.484434    2411 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/ca.pem -> /Users/jenkins/minikube-integration/16543-1012/.minikube/ca.pem

	I0520 08:10:48.484519    2411 exec_runner.go:144] found /Users/jenkins/minikube-integration/16543-1012/.minikube/ca.pem, removing ...

	I0520 08:10:48.484527    2411 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/16543-1012/.minikube/ca.pem

	I0520 08:10:48.484698    2411 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/16543-1012/.minikube/ca.pem (1082 bytes)

	I0520 08:10:48.484934    2411 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/cert.pem -> /Users/jenkins/minikube-integration/16543-1012/.minikube/cert.pem

	I0520 08:10:48.484979    2411 exec_runner.go:144] found /Users/jenkins/minikube-integration/16543-1012/.minikube/cert.pem, removing ...

	I0520 08:10:48.484983    2411 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/16543-1012/.minikube/cert.pem

	I0520 08:10:48.485041    2411 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/16543-1012/.minikube/cert.pem (1123 bytes)

	I0520 08:10:48.485161    2411 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/key.pem -> /Users/jenkins/minikube-integration/16543-1012/.minikube/key.pem

	I0520 08:10:48.485203    2411 exec_runner.go:144] found /Users/jenkins/minikube-integration/16543-1012/.minikube/key.pem, removing ...

	I0520 08:10:48.485212    2411 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/16543-1012/.minikube/key.pem

	I0520 08:10:48.485276    2411 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/16543-1012/.minikube/key.pem (1679 bytes)

	I0520 08:10:48.485427    2411 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/16543-1012/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/16543-1012/.minikube/certs/ca-key.pem org=jenkins.ingress-addon-legacy-371000 san=[192.168.105.6 192.168.105.6 localhost 127.0.0.1 minikube ingress-addon-legacy-371000]

	I0520 08:10:48.594093    2411 provision.go:172] copyRemoteCerts

	I0520 08:10:48.594162    2411 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0520 08:10:48.594174    2411 sshutil.go:53] new ssh client: &{IP:192.168.105.6 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/ingress-addon-legacy-371000/id_rsa Username:docker}

	I0520 08:10:48.631273    2411 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0520 08:10:48.631326    2411 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0520 08:10:48.638421    2411 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0520 08:10:48.638462    2411 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/server.pem --> /etc/docker/server.pem (1253 bytes)

	I0520 08:10:48.645382    2411 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0520 08:10:48.645426    2411 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0520 08:10:48.652317    2411 provision.go:86] duration metric: configureAuth took 167.976458ms

	I0520 08:10:48.652324    2411 buildroot.go:189] setting minikube options for container-runtime

	I0520 08:10:48.652435    2411 config.go:182] Loaded profile config "ingress-addon-legacy-371000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.18.20

	I0520 08:10:48.652468    2411 main.go:141] libmachine: Using SSH client type: native

	I0520 08:10:48.652682    2411 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x104f086d0] 0x104f0b130 <nil>  [] 0s} 192.168.105.6 22 <nil> <nil>}

	I0520 08:10:48.652688    2411 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0520 08:10:48.715953    2411 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I0520 08:10:48.715959    2411 buildroot.go:70] root file system type: tmpfs

	I0520 08:10:48.716034    2411 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I0520 08:10:48.716084    2411 main.go:141] libmachine: Using SSH client type: native

	I0520 08:10:48.716345    2411 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x104f086d0] 0x104f0b130 <nil>  [] 0s} 192.168.105.6 22 <nil> <nil>}

	I0520 08:10:48.716384    2411 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0520 08:10:48.783851    2411 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0520 08:10:48.783907    2411 main.go:141] libmachine: Using SSH client type: native

	I0520 08:10:48.784156    2411 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x104f086d0] 0x104f0b130 <nil>  [] 0s} 192.168.105.6 22 <nil> <nil>}

	I0520 08:10:48.784165    2411 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0520 08:10:49.111969    2411 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory

	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.

	I0520 08:10:49.111992    2411 machine.go:91] provisioned docker machine in 803.434208ms

	I0520 08:10:49.111998    2411 client.go:171] LocalClient.Create took 15.165872625s

	I0520 08:10:49.112016    2411 start.go:167] duration metric: libmachine.API.Create for "ingress-addon-legacy-371000" took 15.165933084s

	I0520 08:10:49.112023    2411 start.go:300] post-start starting for "ingress-addon-legacy-371000" (driver="qemu2")

	I0520 08:10:49.112027    2411 start.go:328] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0520 08:10:49.112116    2411 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0520 08:10:49.112130    2411 sshutil.go:53] new ssh client: &{IP:192.168.105.6 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/ingress-addon-legacy-371000/id_rsa Username:docker}

	I0520 08:10:49.145798    2411 ssh_runner.go:195] Run: cat /etc/os-release

	I0520 08:10:49.147535    2411 info.go:137] Remote host: Buildroot 2021.02.12

	I0520 08:10:49.147544    2411 filesync.go:126] Scanning /Users/jenkins/minikube-integration/16543-1012/.minikube/addons for local assets ...

	I0520 08:10:49.147616    2411 filesync.go:126] Scanning /Users/jenkins/minikube-integration/16543-1012/.minikube/files for local assets ...

	I0520 08:10:49.147726    2411 filesync.go:149] local asset: /Users/jenkins/minikube-integration/16543-1012/.minikube/files/etc/ssl/certs/14372.pem -> 14372.pem in /etc/ssl/certs

	I0520 08:10:49.147730    2411 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/16543-1012/.minikube/files/etc/ssl/certs/14372.pem -> /etc/ssl/certs/14372.pem

	I0520 08:10:49.147848    2411 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0520 08:10:49.156490    2411 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/files/etc/ssl/certs/14372.pem --> /etc/ssl/certs/14372.pem (1708 bytes)

	I0520 08:10:49.165306    2411 start.go:303] post-start completed in 53.27375ms

	I0520 08:10:49.165795    2411 profile.go:148] Saving config to /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/config.json ...

	I0520 08:10:49.165976    2411 start.go:128] duration metric: createHost completed in 15.245447209s

	I0520 08:10:49.166036    2411 main.go:141] libmachine: Using SSH client type: native

	I0520 08:10:49.166265    2411 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x104f086d0] 0x104f0b130 <nil>  [] 0s} 192.168.105.6 22 <nil> <nil>}

	I0520 08:10:49.166270    2411 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0520 08:10:49.230624    2411 main.go:141] libmachine: SSH cmd err, output: <nil>: 1684595449.562308502

	I0520 08:10:49.230635    2411 fix.go:207] guest clock: 1684595449.562308502

	I0520 08:10:49.230639    2411 fix.go:220] Guest: 2023-05-20 08:10:49.562308502 -0700 PDT Remote: 2023-05-20 08:10:49.165981 -0700 PDT m=+28.029499876 (delta=396.327502ms)

	I0520 08:10:49.230651    2411 fix.go:191] guest clock delta is within tolerance: 396.327502ms

	I0520 08:10:49.230654    2411 start.go:83] releasing machines lock for "ingress-addon-legacy-371000", held for 15.310175292s

	I0520 08:10:49.230975    2411 ssh_runner.go:195] Run: cat /version.json

	I0520 08:10:49.230984    2411 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0520 08:10:49.230984    2411 sshutil.go:53] new ssh client: &{IP:192.168.105.6 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/ingress-addon-legacy-371000/id_rsa Username:docker}

	I0520 08:10:49.231006    2411 sshutil.go:53] new ssh client: &{IP:192.168.105.6 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/ingress-addon-legacy-371000/id_rsa Username:docker}

	I0520 08:10:49.263751    2411 ssh_runner.go:195] Run: systemctl --version

	I0520 08:10:49.265881    2411 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0520 08:10:49.308397    2411 cni.go:208] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0520 08:10:49.308442    2411 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *bridge* -not -name *podman* -not -name *.mk_disabled -printf "%!p(MISSING), " -exec sh -c "sudo sed -i -r -e '/"dst": ".*:.*"/d' -e 's|^(.*)"dst": (.*)[,*]$|\1"dst": \2|g' -e '/"subnet": ".*:.*"/d' -e 's|^(.*)"subnet": ".*"(.*)[,*]$|\1"subnet": "10.244.0.0/16"\2|g' {}" ;

	I0520 08:10:49.311777    2411 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *podman* -not -name *.mk_disabled -printf "%!p(MISSING), " -exec sh -c "sudo sed -i -r -e 's|^(.*)"subnet": ".*"(.*)$|\1"subnet": "10.244.0.0/16"\2|g' -e 's|^(.*)"gateway": ".*"(.*)$|\1"gateway": "10.244.0.1"\2|g' {}" ;

	I0520 08:10:49.317244    2411 cni.go:307] configured [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0520 08:10:49.317253    2411 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime docker

	I0520 08:10:49.317330    2411 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0520 08:10:49.330197    2411 docker.go:633] Got preloaded images: 

	I0520 08:10:49.330207    2411 docker.go:639] registry.k8s.io/kube-apiserver:v1.18.20 wasn't preloaded

	I0520 08:10:49.330268    2411 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I0520 08:10:49.333686    2411 ssh_runner.go:195] Run: which lz4

	I0520 08:10:49.334909    2411 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4 -> /preloaded.tar.lz4

	I0520 08:10:49.335010    2411 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4

	I0520 08:10:49.336456    2411 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I0520 08:10:49.336471    2411 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4 --> /preloaded.tar.lz4 (459739018 bytes)

	I0520 08:10:51.036758    2411 docker.go:597] Took 1.701793 seconds to copy over tarball

	I0520 08:10:51.036827    2411 ssh_runner.go:195] Run: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4

	I0520 08:10:52.361716    2411 ssh_runner.go:235] Completed: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4: (1.32486375s)

	I0520 08:10:52.361735    2411 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I0520 08:10:52.387668    2411 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I0520 08:10:52.393145    2411 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2502 bytes)

	I0520 08:10:52.402602    2411 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0520 08:10:52.476523    2411 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0520 08:10:53.844289    2411 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.367751208s)

	I0520 08:10:53.844318    2411 start.go:481] detecting cgroup driver to use...

	I0520 08:10:53.844401    2411 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0520 08:10:53.850060    2411 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"

	I0520 08:10:53.853921    2411 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I0520 08:10:53.857165    2411 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...

	I0520 08:10:53.857200    2411 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I0520 08:10:53.860116    2411 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0520 08:10:53.862880    2411 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I0520 08:10:53.866211    2411 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0520 08:10:53.869538    2411 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0520 08:10:53.872924    2411 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I0520 08:10:53.875825    2411 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0520 08:10:53.878654    2411 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0520 08:10:53.881945    2411 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0520 08:10:53.962475    2411 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I0520 08:10:53.972588    2411 start.go:481] detecting cgroup driver to use...

	I0520 08:10:53.972646    2411 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0520 08:10:53.978836    2411 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0520 08:10:53.984167    2411 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0520 08:10:53.990007    2411 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0520 08:10:53.994729    2411 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0520 08:10:53.999678    2411 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I0520 08:10:54.037886    2411 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0520 08:10:54.043252    2411 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/dockershim.sock

	" | sudo tee /etc/crictl.yaml"

	I0520 08:10:54.048707    2411 ssh_runner.go:195] Run: which cri-dockerd

	I0520 08:10:54.049910    2411 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I0520 08:10:54.052742    2411 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)

	I0520 08:10:54.057611    2411 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I0520 08:10:54.137535    2411 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I0520 08:10:54.223451    2411 docker.go:532] configuring docker to use "cgroupfs" as cgroup driver...

	I0520 08:10:54.223466    2411 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (144 bytes)

	I0520 08:10:54.228557    2411 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0520 08:10:54.308135    2411 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0520 08:10:55.458008    2411 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.149858584s)

	I0520 08:10:55.458085    2411 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0520 08:10:55.470559    2411 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0520 08:10:55.490043    2411 out.go:204] * Preparing Kubernetes v1.18.20 on Docker 20.10.23 ...

	I0520 08:10:55.490186    2411 ssh_runner.go:195] Run: grep 192.168.105.1	host.minikube.internal$ /etc/hosts

	I0520 08:10:55.491571    2411 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.105.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0520 08:10:55.495134    2411 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime docker

	I0520 08:10:55.495181    2411 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0520 08:10:55.503827    2411 docker.go:633] Got preloaded images: -- stdout --

	k8s.gcr.io/kube-proxy:v1.18.20

	k8s.gcr.io/kube-controller-manager:v1.18.20

	k8s.gcr.io/kube-apiserver:v1.18.20

	k8s.gcr.io/kube-scheduler:v1.18.20

	gcr.io/k8s-minikube/storage-provisioner:v5

	k8s.gcr.io/pause:3.2

	k8s.gcr.io/coredns:1.6.7

	k8s.gcr.io/etcd:3.4.3-0

	-- /stdout --

	I0520 08:10:55.503837    2411 docker.go:639] registry.k8s.io/kube-apiserver:v1.18.20 wasn't preloaded

	I0520 08:10:55.503883    2411 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I0520 08:10:55.506693    2411 ssh_runner.go:195] Run: which lz4

	I0520 08:10:55.507788    2411 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4 -> /preloaded.tar.lz4

	I0520 08:10:55.507887    2411 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4

	I0520 08:10:55.508963    2411 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I0520 08:10:55.508974    2411 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4 --> /preloaded.tar.lz4 (459739018 bytes)

	I0520 08:10:57.210795    2411 docker.go:597] Took 1.702968 seconds to copy over tarball

	I0520 08:10:57.210859    2411 ssh_runner.go:195] Run: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4

	I0520 08:10:58.515065    2411 ssh_runner.go:235] Completed: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4: (1.304194625s)

	I0520 08:10:58.515077    2411 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I0520 08:10:58.541632    2411 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I0520 08:10:58.548168    2411 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2502 bytes)

	I0520 08:10:58.555894    2411 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0520 08:10:58.629686    2411 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0520 08:11:00.230001    2411 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.600301458s)

	I0520 08:11:00.230114    2411 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0520 08:11:00.239444    2411 docker.go:633] Got preloaded images: -- stdout --

	k8s.gcr.io/kube-proxy:v1.18.20

	k8s.gcr.io/kube-controller-manager:v1.18.20

	k8s.gcr.io/kube-apiserver:v1.18.20

	k8s.gcr.io/kube-scheduler:v1.18.20

	gcr.io/k8s-minikube/storage-provisioner:v5

	k8s.gcr.io/pause:3.2

	k8s.gcr.io/coredns:1.6.7

	k8s.gcr.io/etcd:3.4.3-0

	-- /stdout --

	I0520 08:11:00.239452    2411 docker.go:639] registry.k8s.io/kube-apiserver:v1.18.20 wasn't preloaded

	I0520 08:11:00.239456    2411 cache_images.go:88] LoadImages start: [registry.k8s.io/kube-apiserver:v1.18.20 registry.k8s.io/kube-controller-manager:v1.18.20 registry.k8s.io/kube-scheduler:v1.18.20 registry.k8s.io/kube-proxy:v1.18.20 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.3-0 registry.k8s.io/coredns:1.6.7 gcr.io/k8s-minikube/storage-provisioner:v5]

	I0520 08:11:00.261783    2411 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.18.20

	I0520 08:11:00.261850    2411 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5

	I0520 08:11:00.264665    2411 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.18.20

	I0520 08:11:00.264748    2411 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.18.20

	I0520 08:11:00.264799    2411 image.go:134] retrieving image: registry.k8s.io/coredns:1.6.7

	I0520 08:11:00.265143    2411 image.go:134] retrieving image: registry.k8s.io/pause:3.2

	I0520 08:11:00.265439    2411 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.18.20

	I0520 08:11:00.265451    2411 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.3-0

	I0520 08:11:00.269196    2411 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5

	I0520 08:11:00.270366    2411 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.18.20

	I0520 08:11:00.271279    2411 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.18.20

	I0520 08:11:00.271962    2411 image.go:177] daemon lookup for registry.k8s.io/coredns:1.6.7: Error response from daemon: No such image: registry.k8s.io/coredns:1.6.7

	I0520 08:11:00.274111    2411 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.3-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.3-0

	I0520 08:11:00.274147    2411 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.18.20

	I0520 08:11:00.274161    2411 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2

	I0520 08:11:00.275626    2411 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.18.20

	W0520 08:11:01.422185    2411 image.go:265] image gcr.io/k8s-minikube/storage-provisioner:v5 arch mismatch: want arm64 got amd64. fixing

	I0520 08:11:01.422283    2411 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5

	I0520 08:11:01.430998    2411 cache_images.go:116] "gcr.io/k8s-minikube/storage-provisioner:v5" needs transfer: "gcr.io/k8s-minikube/storage-provisioner:v5" does not exist at hash "66749159455b3f08c8318fe0233122f54d0f5889f9c5fdfb73c3fd9d99895b51" in container runtime

	I0520 08:11:01.431043    2411 docker.go:313] Removing image: gcr.io/k8s-minikube/storage-provisioner:v5

	I0520 08:11:01.431085    2411 ssh_runner.go:195] Run: docker rmi gcr.io/k8s-minikube/storage-provisioner:v5

	I0520 08:11:01.444196    2411 cache_images.go:286] Loading image from: /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5

	W0520 08:11:01.770640    2411 image.go:265] image registry.k8s.io/kube-controller-manager:v1.18.20 arch mismatch: want arm64 got amd64. fixing

	I0520 08:11:01.770752    2411 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.18.20

	I0520 08:11:01.778987    2411 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.18.20" needs transfer: "registry.k8s.io/kube-controller-manager:v1.18.20" does not exist at hash "297c79afbdb81ceb4cf857e0c54a0de7b6ce7ebe01e6cab68fc8baf342be3ea7" in container runtime

	I0520 08:11:01.779012    2411 docker.go:313] Removing image: registry.k8s.io/kube-controller-manager:v1.18.20

	I0520 08:11:01.779058    2411 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-controller-manager:v1.18.20

	W0520 08:11:01.779612    2411 image.go:265] image registry.k8s.io/kube-apiserver:v1.18.20 arch mismatch: want arm64 got amd64. fixing

	I0520 08:11:01.779689    2411 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.18.20

	I0520 08:11:01.791912    2411 cache_images.go:286] Loading image from: /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.18.20

	I0520 08:11:01.791931    2411 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.18.20" needs transfer: "registry.k8s.io/kube-apiserver:v1.18.20" does not exist at hash "d353007847ec85700463981309a5846c8d9c93fbcd1323104266212926d68257" in container runtime

	I0520 08:11:01.791949    2411 docker.go:313] Removing image: registry.k8s.io/kube-apiserver:v1.18.20

	I0520 08:11:01.792002    2411 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-apiserver:v1.18.20

	I0520 08:11:01.799667    2411 cache_images.go:286] Loading image from: /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.18.20

	W0520 08:11:01.892138    2411 image.go:265] image registry.k8s.io/coredns:1.6.7 arch mismatch: want arm64 got amd64. fixing

	I0520 08:11:01.892254    2411 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/coredns:1.6.7

	I0520 08:11:01.899866    2411 cache_images.go:116] "registry.k8s.io/coredns:1.6.7" needs transfer: "registry.k8s.io/coredns:1.6.7" does not exist at hash "ff3af22d8878afc6985d3fec3e066d00ef431aa166c3a01ac58f1990adc92a2c" in container runtime

	I0520 08:11:01.899890    2411 docker.go:313] Removing image: registry.k8s.io/coredns:1.6.7

	I0520 08:11:01.899941    2411 ssh_runner.go:195] Run: docker rmi registry.k8s.io/coredns:1.6.7

	I0520 08:11:01.912619    2411 cache_images.go:286] Loading image from: /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/images/arm64/registry.k8s.io/coredns_1.6.7

	W0520 08:11:01.972306    2411 image.go:265] image registry.k8s.io/etcd:3.4.3-0 arch mismatch: want arm64 got amd64. fixing

	I0520 08:11:01.972434    2411 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.3-0

	I0520 08:11:01.981021    2411 cache_images.go:116] "registry.k8s.io/etcd:3.4.3-0" needs transfer: "registry.k8s.io/etcd:3.4.3-0" does not exist at hash "29dd247b2572efbe28fcaea3fef1c5d72593da59f7350e3f6d2e6618983f9c03" in container runtime

	I0520 08:11:01.981049    2411 docker.go:313] Removing image: registry.k8s.io/etcd:3.4.3-0

	I0520 08:11:01.981105    2411 ssh_runner.go:195] Run: docker rmi registry.k8s.io/etcd:3.4.3-0

	I0520 08:11:01.988577    2411 cache_images.go:286] Loading image from: /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.4.3-0

	W0520 08:11:02.083312    2411 image.go:265] image registry.k8s.io/kube-scheduler:v1.18.20 arch mismatch: want arm64 got amd64. fixing

	I0520 08:11:02.083428    2411 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.18.20

	I0520 08:11:02.091858    2411 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.18.20" needs transfer: "registry.k8s.io/kube-scheduler:v1.18.20" does not exist at hash "177548d745cb87f773d02f41d453af2f2a1479dbe3c32e749cf6d8145c005e79" in container runtime

	I0520 08:11:02.091882    2411 docker.go:313] Removing image: registry.k8s.io/kube-scheduler:v1.18.20

	I0520 08:11:02.091940    2411 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-scheduler:v1.18.20

	I0520 08:11:02.099261    2411 cache_images.go:286] Loading image from: /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.18.20

	I0520 08:11:02.228312    2411 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/pause:3.2

	I0520 08:11:02.244303    2411 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "2a060e2e7101d419352bf82c613158587400be743482d9a537ec4a9d1b4eb93c" in container runtime

	I0520 08:11:02.244338    2411 docker.go:313] Removing image: registry.k8s.io/pause:3.2

	I0520 08:11:02.244423    2411 ssh_runner.go:195] Run: docker rmi registry.k8s.io/pause:3.2

	I0520 08:11:02.256354    2411 cache_images.go:286] Loading image from: /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/images/arm64/registry.k8s.io/pause_3.2

	W0520 08:11:02.428267    2411 image.go:265] image registry.k8s.io/kube-proxy:v1.18.20 arch mismatch: want arm64 got amd64. fixing

	I0520 08:11:02.428941    2411 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.18.20

	I0520 08:11:02.458431    2411 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.18.20" needs transfer: "registry.k8s.io/kube-proxy:v1.18.20" does not exist at hash "b11cdc97ac6ac4ef2b3b0662edbe16597084b17cbc8e3d61fcaf4ef827a7ed18" in container runtime

	I0520 08:11:02.458497    2411 docker.go:313] Removing image: registry.k8s.io/kube-proxy:v1.18.20

	I0520 08:11:02.458663    2411 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-proxy:v1.18.20

	I0520 08:11:02.476778    2411 cache_images.go:286] Loading image from: /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.18.20

	I0520 08:11:02.476840    2411 cache_images.go:92] LoadImages completed in 2.237381708s

	W0520 08:11:02.476977    2411 out.go:239] X Unable to load cached images: loading cached images: stat /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5: no such file or directory

	I0520 08:11:02.477066    2411 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I0520 08:11:02.495007    2411 cni.go:84] Creating CNI manager for ""

	I0520 08:11:02.495022    2411 cni.go:161] CNI unnecessary in this configuration, recommending no CNI

	I0520 08:11:02.495037    2411 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I0520 08:11:02.495051    2411 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.105.6 APIServerPort:8443 KubernetesVersion:v1.18.20 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ingress-addon-legacy-371000 NodeName:ingress-addon-legacy-371000 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.105.6"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.105.6 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/

ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}

	I0520 08:11:02.495192    2411 kubeadm.go:181] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.105.6

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: /var/run/dockershim.sock

	  name: "ingress-addon-legacy-371000"

	  kubeletExtraArgs:

	    node-ip: 192.168.105.6

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.105.6"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	dns:

	  type: CoreDNS

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.18.20

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0520 08:11:02.495253    2411 kubeadm.go:971] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.18.20/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=ingress-addon-legacy-371000 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.105.6

	[Install]

	 config:

	{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-371000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I0520 08:11:02.495352    2411 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.18.20

	I0520 08:11:02.499958    2411 binaries.go:44] Found k8s binaries, skipping transfer

	I0520 08:11:02.500007    2411 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0520 08:11:02.503638    2411 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (355 bytes)

	I0520 08:11:02.510211    2411 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (353 bytes)

	I0520 08:11:02.516056    2411 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2127 bytes)

	I0520 08:11:02.521568    2411 ssh_runner.go:195] Run: grep 192.168.105.6	control-plane.minikube.internal$ /etc/hosts

	I0520 08:11:02.522934    2411 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.105.6	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0520 08:11:02.526704    2411 certs.go:56] Setting up /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000 for IP: 192.168.105.6

	I0520 08:11:02.526714    2411 certs.go:190] acquiring lock for shared ca certs: {Name:mk455286e32296d088c043e2094c607a8fa5e5c4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0520 08:11:02.527063    2411 certs.go:199] skipping minikubeCA CA generation: /Users/jenkins/minikube-integration/16543-1012/.minikube/ca.key

	I0520 08:11:02.527201    2411 certs.go:199] skipping proxyClientCA CA generation: /Users/jenkins/minikube-integration/16543-1012/.minikube/proxy-client-ca.key

	I0520 08:11:02.527231    2411 certs.go:319] generating minikube-user signed cert: /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/client.key

	I0520 08:11:02.527240    2411 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/client.crt with IP's: []

	I0520 08:11:02.604173    2411 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/client.crt ...

	I0520 08:11:02.604178    2411 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/client.crt: {Name:mk8dd7a78e89e2bdba945aba33cc1ed75d0932ab Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0520 08:11:02.604389    2411 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/client.key ...

	I0520 08:11:02.604392    2411 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/client.key: {Name:mkc501f7860c9c1c7f94ab1cb70c699ed8d75bd6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0520 08:11:02.604512    2411 certs.go:319] generating minikube signed cert: /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/apiserver.key.b354f644

	I0520 08:11:02.604521    2411 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/apiserver.crt.b354f644 with IP's: [192.168.105.6 10.96.0.1 127.0.0.1 10.0.0.1]

	I0520 08:11:02.645144    2411 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/apiserver.crt.b354f644 ...

	I0520 08:11:02.645147    2411 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/apiserver.crt.b354f644: {Name:mka701a429665cf58f89e5041d12226f1400a541 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0520 08:11:02.645284    2411 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/apiserver.key.b354f644 ...

	I0520 08:11:02.645287    2411 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/apiserver.key.b354f644: {Name:mkeda105cc6d1e40a7b33fb1e38fecfd406815ee Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0520 08:11:02.645403    2411 certs.go:337] copying /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/apiserver.crt.b354f644 -> /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/apiserver.crt

	I0520 08:11:02.645503    2411 certs.go:341] copying /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/apiserver.key.b354f644 -> /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/apiserver.key

	I0520 08:11:02.645588    2411 certs.go:319] generating aggregator signed cert: /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/proxy-client.key

	I0520 08:11:02.645594    2411 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/proxy-client.crt with IP's: []

	I0520 08:11:02.749129    2411 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/proxy-client.crt ...

	I0520 08:11:02.749134    2411 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/proxy-client.crt: {Name:mk047e841e500c96fdbfff75b1d017c05b59dbc4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0520 08:11:02.749335    2411 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/proxy-client.key ...

	I0520 08:11:02.749339    2411 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/proxy-client.key: {Name:mkfb33f61c9a51adc4b42d80d765ee64effd78a8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0520 08:11:02.749470    2411 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0520 08:11:02.749486    2411 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0520 08:11:02.749500    2411 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0520 08:11:02.749518    2411 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0520 08:11:02.749530    2411 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/16543-1012/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0520 08:11:02.749542    2411 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/16543-1012/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0520 08:11:02.749553    2411 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/16543-1012/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0520 08:11:02.749565    2411 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/16543-1012/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0520 08:11:02.749660    2411 certs.go:437] found cert: /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/Users/jenkins/minikube-integration/16543-1012/.minikube/certs/1437.pem (1338 bytes)

	W0520 08:11:02.750078    2411 certs.go:433] ignoring /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/Users/jenkins/minikube-integration/16543-1012/.minikube/certs/1437_empty.pem, impossibly tiny 0 bytes

	I0520 08:11:02.750090    2411 certs.go:437] found cert: /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/Users/jenkins/minikube-integration/16543-1012/.minikube/certs/ca-key.pem (1675 bytes)

	I0520 08:11:02.750117    2411 certs.go:437] found cert: /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/Users/jenkins/minikube-integration/16543-1012/.minikube/certs/ca.pem (1082 bytes)

	I0520 08:11:02.750143    2411 certs.go:437] found cert: /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/Users/jenkins/minikube-integration/16543-1012/.minikube/certs/cert.pem (1123 bytes)

	I0520 08:11:02.750171    2411 certs.go:437] found cert: /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/Users/jenkins/minikube-integration/16543-1012/.minikube/certs/key.pem (1679 bytes)

	I0520 08:11:02.750235    2411 certs.go:437] found cert: /Users/jenkins/minikube-integration/16543-1012/.minikube/files/etc/ssl/certs/Users/jenkins/minikube-integration/16543-1012/.minikube/files/etc/ssl/certs/14372.pem (1708 bytes)

	I0520 08:11:02.750259    2411 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/16543-1012/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0520 08:11:02.750272    2411 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/1437.pem -> /usr/share/ca-certificates/1437.pem

	I0520 08:11:02.750283    2411 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/16543-1012/.minikube/files/etc/ssl/certs/14372.pem -> /usr/share/ca-certificates/14372.pem

	I0520 08:11:02.750696    2411 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I0520 08:11:02.758429    2411 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0520 08:11:02.765765    2411 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0520 08:11:02.773044    2411 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0520 08:11:02.779780    2411 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0520 08:11:02.786504    2411 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I0520 08:11:02.793986    2411 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0520 08:11:02.801292    2411 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I0520 08:11:02.808115    2411 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0520 08:11:02.814807    2411 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/1437.pem --> /usr/share/ca-certificates/1437.pem (1338 bytes)

	I0520 08:11:02.821964    2411 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16543-1012/.minikube/files/etc/ssl/certs/14372.pem --> /usr/share/ca-certificates/14372.pem (1708 bytes)

	I0520 08:11:02.829118    2411 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0520 08:11:02.834259    2411 ssh_runner.go:195] Run: openssl version

	I0520 08:11:02.836469    2411 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0520 08:11:02.839406    2411 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0520 08:11:02.840940    2411 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 May 20 15:04 /usr/share/ca-certificates/minikubeCA.pem

	I0520 08:11:02.840963    2411 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0520 08:11:02.842827    2411 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0520 08:11:02.846247    2411 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1437.pem && ln -fs /usr/share/ca-certificates/1437.pem /etc/ssl/certs/1437.pem"

	I0520 08:11:02.849704    2411 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1437.pem

	I0520 08:11:02.851191    2411 certs.go:480] hashing: -rw-r--r-- 1 root root 1338 May 20 15:06 /usr/share/ca-certificates/1437.pem

	I0520 08:11:02.851211    2411 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1437.pem

	I0520 08:11:02.852991    2411 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1437.pem /etc/ssl/certs/51391683.0"

	I0520 08:11:02.856025    2411 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14372.pem && ln -fs /usr/share/ca-certificates/14372.pem /etc/ssl/certs/14372.pem"

	I0520 08:11:02.858945    2411 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14372.pem

	I0520 08:11:02.860574    2411 certs.go:480] hashing: -rw-r--r-- 1 root root 1708 May 20 15:06 /usr/share/ca-certificates/14372.pem

	I0520 08:11:02.860592    2411 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14372.pem

	I0520 08:11:02.862414    2411 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14372.pem /etc/ssl/certs/3ec20f2e.0"

	I0520 08:11:02.865697    2411 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd

	I0520 08:11:02.867168    2411 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory

	I0520 08:11:02.867204    2411 kubeadm.go:404] StartCluster: {Name:ingress-addon-legacy-371000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/16506/minikube-v1.30.1-1684174510-16506-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684523789-16533@sha256:ed200ff6d686f303885e8aaf964442d08018856d63a8e23f7acdc068766ea82b Memory:4096 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuber

netesVersion:v1.18.20 ClusterName:ingress-addon-legacy-371000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.105.6 Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker Mount

IP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}

	I0520 08:11:02.867274    2411 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0520 08:11:02.876543    2411 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0520 08:11:02.879359    2411 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0520 08:11:02.882313    2411 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0520 08:11:02.885536    2411 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0520 08:11:02.885548    2411 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.18.20:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU"

	I0520 08:11:02.909698    2411 kubeadm.go:322] [init] Using Kubernetes version: v1.18.20

	I0520 08:11:02.909779    2411 kubeadm.go:322] [preflight] Running pre-flight checks

	I0520 08:11:02.997429    2411 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster

	I0520 08:11:02.997489    2411 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I0520 08:11:02.997561    2411 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	I0520 08:11:03.057593    2411 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I0520 08:11:03.057657    2411 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I0520 08:11:03.057677    2411 kubeadm.go:322] [kubelet-start] Starting the kubelet

	I0520 08:11:03.145444    2411 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I0520 08:11:03.155691    2411 out.go:204]   - Generating certificates and keys ...

	I0520 08:11:03.155739    2411 kubeadm.go:322] [certs] Using existing ca certificate authority

	I0520 08:11:03.155824    2411 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk

	I0520 08:11:03.214610    2411 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key

	I0520 08:11:03.288317    2411 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key

	I0520 08:11:03.398062    2411 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key

	I0520 08:11:03.635292    2411 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key

	I0520 08:11:03.787538    2411 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key

	I0520 08:11:03.787607    2411 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [ingress-addon-legacy-371000 localhost] and IPs [192.168.105.6 127.0.0.1 ::1]

	I0520 08:11:03.880141    2411 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key

	I0520 08:11:03.880220    2411 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [ingress-addon-legacy-371000 localhost] and IPs [192.168.105.6 127.0.0.1 ::1]

	I0520 08:11:04.023190    2411 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key

	I0520 08:11:04.125009    2411 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key

	I0520 08:11:04.251782    2411 kubeadm.go:322] [certs] Generating "sa" key and public key

	I0520 08:11:04.251838    2411 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I0520 08:11:04.384502    2411 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file

	I0520 08:11:04.482130    2411 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I0520 08:11:04.747562    2411 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I0520 08:11:05.036853    2411 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I0520 08:11:05.037097    2411 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I0520 08:11:05.041288    2411 out.go:204]   - Booting up control plane ...

	I0520 08:11:05.041361    2411 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I0520 08:11:05.041401    2411 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I0520 08:11:05.041522    2411 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I0520 08:11:05.042057    2411 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I0520 08:11:05.043454    2411 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	I0520 08:11:16.049727    2411 kubeadm.go:322] [apiclient] All control plane components are healthy after 11.005790 seconds

	I0520 08:11:16.049951    2411 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I0520 08:11:16.066934    2411 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config-1.18" in namespace kube-system with the configuration for the kubelets in the cluster

	I0520 08:11:16.600085    2411 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs

	I0520 08:11:16.600356    2411 kubeadm.go:322] [mark-control-plane] Marking the node ingress-addon-legacy-371000 as control-plane by adding the label "node-role.kubernetes.io/master=''"

	I0520 08:11:17.110192    2411 kubeadm.go:322] [bootstrap-token] Using token: 04qynp.g86fdp8nouvs9odp

	I0520 08:11:17.113176    2411 out.go:204]   - Configuring RBAC rules ...

	I0520 08:11:17.113239    2411 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I0520 08:11:17.114554    2411 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I0520 08:11:17.119942    2411 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I0520 08:11:17.122301    2411 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I0520 08:11:17.124106    2411 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I0520 08:11:17.124941    2411 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I0520 08:11:17.130609    2411 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I0520 08:11:17.317150    2411 kubeadm.go:322] [addons] Applied essential addon: CoreDNS

	I0520 08:11:17.517272    2411 kubeadm.go:322] [addons] Applied essential addon: kube-proxy

	I0520 08:11:17.517905    2411 kubeadm.go:322] 

	I0520 08:11:17.517944    2411 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!

	I0520 08:11:17.517947    2411 kubeadm.go:322] 

	I0520 08:11:17.517993    2411 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:

	I0520 08:11:17.518000    2411 kubeadm.go:322] 

	I0520 08:11:17.518014    2411 kubeadm.go:322]   mkdir -p $HOME/.kube

	I0520 08:11:17.518056    2411 kubeadm.go:322]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I0520 08:11:17.518090    2411 kubeadm.go:322]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I0520 08:11:17.518093    2411 kubeadm.go:322] 

	I0520 08:11:17.518145    2411 kubeadm.go:322] You should now deploy a pod network to the cluster.

	I0520 08:11:17.518202    2411 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I0520 08:11:17.518261    2411 kubeadm.go:322]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I0520 08:11:17.518265    2411 kubeadm.go:322] 

	I0520 08:11:17.518321    2411 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities

	I0520 08:11:17.518375    2411 kubeadm.go:322] and service account keys on each node and then running the following as root:

	I0520 08:11:17.518380    2411 kubeadm.go:322] 

	I0520 08:11:17.518426    2411 kubeadm.go:322]   kubeadm join control-plane.minikube.internal:8443 --token 04qynp.g86fdp8nouvs9odp \

	I0520 08:11:17.518497    2411 kubeadm.go:322]     --discovery-token-ca-cert-hash sha256:c637a44edb20ebaef1a3cd8bd36bb27010137a6bac525a779e19218d8d4ae1e6 \

	I0520 08:11:17.518515    2411 kubeadm.go:322]     --control-plane 

	I0520 08:11:17.518524    2411 kubeadm.go:322] 

	I0520 08:11:17.518588    2411 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:

	I0520 08:11:17.518601    2411 kubeadm.go:322] 

	I0520 08:11:17.518656    2411 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token 04qynp.g86fdp8nouvs9odp \

	I0520 08:11:17.518732    2411 kubeadm.go:322]     --discovery-token-ca-cert-hash sha256:c637a44edb20ebaef1a3cd8bd36bb27010137a6bac525a779e19218d8d4ae1e6 

	I0520 08:11:17.518903    2411 kubeadm.go:322] W0520 15:11:03.241232    1564 configset.go:202] WARNING: kubeadm cannot validate component configs for API groups [kubelet.config.k8s.io kubeproxy.config.k8s.io]

	I0520 08:11:17.519010    2411 kubeadm.go:322] 	[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/

	I0520 08:11:17.519104    2411 kubeadm.go:322] 	[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 20.10.23. Latest validated version: 19.03

	I0520 08:11:17.519186    2411 kubeadm.go:322] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I0520 08:11:17.519269    2411 kubeadm.go:322] W0520 15:11:05.372590    1564 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"

	I0520 08:11:17.519348    2411 kubeadm.go:322] W0520 15:11:05.373275    1564 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"

	I0520 08:11:17.519358    2411 cni.go:84] Creating CNI manager for ""

	I0520 08:11:17.519369    2411 cni.go:161] CNI unnecessary in this configuration, recommending no CNI

	I0520 08:11:17.519381    2411 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0520 08:11:17.519503    2411 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:11:17.519504    2411 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl label nodes minikube.k8s.io/version=v1.30.1 minikube.k8s.io/commit=24686ce6bbd657e092eb3c3fd6be64c1b7241033 minikube.k8s.io/name=ingress-addon-legacy-371000 minikube.k8s.io/updated_at=2023_05_20T08_11_17_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:11:17.589038    2411 ops.go:34] apiserver oom_adj: -16

	I0520 08:11:17.589072    2411 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:11:18.132923    2411 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:11:18.632929    2411 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:11:19.133163    2411 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:11:19.633171    2411 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:11:20.133111    2411 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:11:20.633052    2411 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:11:21.133173    2411 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:11:21.633073    2411 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:11:22.133076    2411 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:11:22.633019    2411 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:11:23.133155    2411 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:11:23.633119    2411 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:11:24.132942    2411 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:11:24.632952    2411 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:11:25.133066    2411 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:11:25.633159    2411 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:11:26.132909    2411 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:11:26.633113    2411 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:11:27.133056    2411 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:11:27.632876    2411 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:11:28.133099    2411 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:11:28.633148    2411 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:11:29.133048    2411 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:11:29.633127    2411 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:11:30.133150    2411 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:11:30.633143    2411 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:11:31.132810    2411 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:11:31.633090    2411 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:11:32.132915    2411 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:11:32.632875    2411 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:11:33.131174    2411 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0520 08:11:33.190258    2411 kubeadm.go:1076] duration metric: took 15.670858167s to wait for elevateKubeSystemPrivileges.

	I0520 08:11:33.190273    2411 kubeadm.go:406] StartCluster complete in 30.323128625s

	I0520 08:11:33.190287    2411 settings.go:142] acquiring lock: {Name:mk59154b06c6365bdac4601706e783ce490a045a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0520 08:11:33.190378    2411 settings.go:150] Updating kubeconfig:  /Users/jenkins/minikube-integration/16543-1012/kubeconfig

	I0520 08:11:33.191476    2411 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16543-1012/kubeconfig: {Name:mkf6fa7fb711448995f7c2c1a6e60e631893d6a3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0520 08:11:33.191666    2411 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.18.20/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0520 08:11:33.191755    2411 addons.go:496] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false]

	I0520 08:11:33.191821    2411 addons.go:66] Setting storage-provisioner=true in profile "ingress-addon-legacy-371000"

	I0520 08:11:33.191829    2411 addons.go:228] Setting addon storage-provisioner=true in "ingress-addon-legacy-371000"

	I0520 08:11:33.191851    2411 addons.go:66] Setting default-storageclass=true in profile "ingress-addon-legacy-371000"

	I0520 08:11:33.191855    2411 host.go:66] Checking if "ingress-addon-legacy-371000" exists ...

	I0520 08:11:33.191863    2411 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "ingress-addon-legacy-371000"

	I0520 08:11:33.191944    2411 config.go:182] Loaded profile config "ingress-addon-legacy-371000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.18.20

	I0520 08:11:33.191946    2411 kapi.go:59] client config for ingress-addon-legacy-371000: &rest.Config{Host:"https://192.168.105.6:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/client.key", CAFile:"/Users/jenkins/minikube-integration/16543-1012/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint

8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x105f568e0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I0520 08:11:33.192340    2411 cert_rotation.go:137] Starting client certificate rotation controller

	I0520 08:11:33.192988    2411 kapi.go:59] client config for ingress-addon-legacy-371000: &rest.Config{Host:"https://192.168.105.6:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/client.key", CAFile:"/Users/jenkins/minikube-integration/16543-1012/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint

8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x105f568e0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I0520 08:11:33.197536    2411 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0520 08:11:33.200539    2411 addons.go:420] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0520 08:11:33.200546    2411 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0520 08:11:33.200554    2411 sshutil.go:53] new ssh client: &{IP:192.168.105.6 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/ingress-addon-legacy-371000/id_rsa Username:docker}

	I0520 08:11:33.204304    2411 addons.go:228] Setting addon default-storageclass=true in "ingress-addon-legacy-371000"

	I0520 08:11:33.204321    2411 host.go:66] Checking if "ingress-addon-legacy-371000" exists ...

	I0520 08:11:33.205019    2411 addons.go:420] installing /etc/kubernetes/addons/storageclass.yaml

	I0520 08:11:33.205026    2411 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0520 08:11:33.205031    2411 sshutil.go:53] new ssh client: &{IP:192.168.105.6 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/ingress-addon-legacy-371000/id_rsa Username:docker}

	I0520 08:11:33.255085    2411 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.18.20/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.105.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.18.20/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0520 08:11:33.290476    2411 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0520 08:11:33.297516    2411 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0520 08:11:33.458840    2411 start.go:916] {"host.minikube.internal": 192.168.105.1} host record injected into CoreDNS's ConfigMap

	I0520 08:11:33.528330    2411 out.go:177] * Enabled addons: default-storageclass, storage-provisioner

	I0520 08:11:33.536415    2411 addons.go:499] enable addons completed in 344.70975ms: enabled=[default-storageclass storage-provisioner]

	I0520 08:11:33.710163    2411 kapi.go:248] "coredns" deployment in "kube-system" namespace and "ingress-addon-legacy-371000" context rescaled to 1 replicas

	I0520 08:11:33.710182    2411 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.105.6 Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0520 08:11:33.714304    2411 out.go:177] * Verifying Kubernetes components...

	I0520 08:11:33.718208    2411 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0520 08:11:33.723624    2411 kapi.go:59] client config for ingress-addon-legacy-371000: &rest.Config{Host:"https://192.168.105.6:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/client.key", CAFile:"/Users/jenkins/minikube-integration/16543-1012/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint

8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x105f568e0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I0520 08:11:33.723762    2411 node_ready.go:35] waiting up to 6m0s for node "ingress-addon-legacy-371000" to be "Ready" ...

	I0520 08:11:33.725522    2411 node_ready.go:49] node "ingress-addon-legacy-371000" has status "Ready":"True"

	I0520 08:11:33.725528    2411 node_ready.go:38] duration metric: took 1.755958ms waiting for node "ingress-addon-legacy-371000" to be "Ready" ...

	I0520 08:11:33.725531    2411 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0520 08:11:33.728878    2411 pod_ready.go:78] waiting up to 6m0s for pod "coredns-66bff467f8-8756c" in "kube-system" namespace to be "Ready" ...

	I0520 08:11:35.744575    2411 pod_ready.go:102] pod "coredns-66bff467f8-8756c" in "kube-system" namespace has status "Ready":"False"

	I0520 08:11:37.745816    2411 pod_ready.go:102] pod "coredns-66bff467f8-8756c" in "kube-system" namespace has status "Ready":"False"

	I0520 08:11:39.747210    2411 pod_ready.go:102] pod "coredns-66bff467f8-8756c" in "kube-system" namespace has status "Ready":"False"

	I0520 08:11:41.245329    2411 pod_ready.go:92] pod "coredns-66bff467f8-8756c" in "kube-system" namespace has status "Ready":"True"

	I0520 08:11:41.245364    2411 pod_ready.go:81] duration metric: took 7.516485667s waiting for pod "coredns-66bff467f8-8756c" in "kube-system" namespace to be "Ready" ...

	I0520 08:11:41.245381    2411 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ingress-addon-legacy-371000" in "kube-system" namespace to be "Ready" ...

	I0520 08:11:41.252402    2411 pod_ready.go:92] pod "etcd-ingress-addon-legacy-371000" in "kube-system" namespace has status "Ready":"True"

	I0520 08:11:41.252420    2411 pod_ready.go:81] duration metric: took 7.028875ms waiting for pod "etcd-ingress-addon-legacy-371000" in "kube-system" namespace to be "Ready" ...

	I0520 08:11:41.252432    2411 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ingress-addon-legacy-371000" in "kube-system" namespace to be "Ready" ...

	I0520 08:11:41.258615    2411 pod_ready.go:92] pod "kube-apiserver-ingress-addon-legacy-371000" in "kube-system" namespace has status "Ready":"True"

	I0520 08:11:41.258630    2411 pod_ready.go:81] duration metric: took 6.189833ms waiting for pod "kube-apiserver-ingress-addon-legacy-371000" in "kube-system" namespace to be "Ready" ...

	I0520 08:11:41.258641    2411 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ingress-addon-legacy-371000" in "kube-system" namespace to be "Ready" ...

	I0520 08:11:41.266365    2411 pod_ready.go:92] pod "kube-controller-manager-ingress-addon-legacy-371000" in "kube-system" namespace has status "Ready":"True"

	I0520 08:11:41.266390    2411 pod_ready.go:81] duration metric: took 7.737792ms waiting for pod "kube-controller-manager-ingress-addon-legacy-371000" in "kube-system" namespace to be "Ready" ...

	I0520 08:11:41.266402    2411 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-k65p6" in "kube-system" namespace to be "Ready" ...

	I0520 08:11:41.270569    2411 pod_ready.go:92] pod "kube-proxy-k65p6" in "kube-system" namespace has status "Ready":"True"

	I0520 08:11:41.270584    2411 pod_ready.go:81] duration metric: took 4.169875ms waiting for pod "kube-proxy-k65p6" in "kube-system" namespace to be "Ready" ...

	I0520 08:11:41.270592    2411 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ingress-addon-legacy-371000" in "kube-system" namespace to be "Ready" ...

	I0520 08:11:41.434915    2411 request.go:628] Waited for 164.226083ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.105.6:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ingress-addon-legacy-371000

	I0520 08:11:41.633613    2411 request.go:628] Waited for 192.744875ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.105.6:8443/api/v1/nodes/ingress-addon-legacy-371000

	I0520 08:11:41.640160    2411 pod_ready.go:92] pod "kube-scheduler-ingress-addon-legacy-371000" in "kube-system" namespace has status "Ready":"True"

	I0520 08:11:41.640188    2411 pod_ready.go:81] duration metric: took 369.586083ms waiting for pod "kube-scheduler-ingress-addon-legacy-371000" in "kube-system" namespace to be "Ready" ...

	I0520 08:11:41.640219    2411 pod_ready.go:38] duration metric: took 7.914687375s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0520 08:11:41.640276    2411 api_server.go:52] waiting for apiserver process to appear ...

	I0520 08:11:41.640589    2411 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0520 08:11:41.658214    2411 api_server.go:72] duration metric: took 7.94802075s to wait for apiserver process to appear ...

	I0520 08:11:41.658237    2411 api_server.go:88] waiting for apiserver healthz status ...

	I0520 08:11:41.658266    2411 api_server.go:253] Checking apiserver healthz at https://192.168.105.6:8443/healthz ...

	I0520 08:11:41.667805    2411 api_server.go:279] https://192.168.105.6:8443/healthz returned 200:

	ok

	I0520 08:11:41.668865    2411 api_server.go:141] control plane version: v1.18.20

	I0520 08:11:41.668889    2411 api_server.go:131] duration metric: took 10.63925ms to wait for apiserver health ...

	I0520 08:11:41.668918    2411 system_pods.go:43] waiting for kube-system pods to appear ...

	I0520 08:11:41.834909    2411 request.go:628] Waited for 165.891833ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.105.6:8443/api/v1/namespaces/kube-system/pods

	I0520 08:11:41.849224    2411 system_pods.go:59] 7 kube-system pods found

	I0520 08:11:41.849256    2411 system_pods.go:61] "coredns-66bff467f8-8756c" [2eec04c4-2fdc-428f-bdab-dfb247718b98] Running

	I0520 08:11:41.849267    2411 system_pods.go:61] "etcd-ingress-addon-legacy-371000" [9b88ca73-b486-4840-ba4c-571e34472372] Running

	I0520 08:11:41.849292    2411 system_pods.go:61] "kube-apiserver-ingress-addon-legacy-371000" [afde7e53-c7bc-4439-a6c3-7492db9e75dc] Running

	I0520 08:11:41.849306    2411 system_pods.go:61] "kube-controller-manager-ingress-addon-legacy-371000" [832a399e-3dab-40e4-8659-03766dfb9bb9] Running

	I0520 08:11:41.849319    2411 system_pods.go:61] "kube-proxy-k65p6" [a4f06e0c-ed08-454b-a71f-e508e9f907f9] Running

	I0520 08:11:41.849332    2411 system_pods.go:61] "kube-scheduler-ingress-addon-legacy-371000" [6457eab4-e622-4b7e-94b7-05acf4fe5a02] Running

	I0520 08:11:41.849344    2411 system_pods.go:61] "storage-provisioner" [b44b6fe0-3a04-41f7-98bd-dcdc7a2ace82] Running

	I0520 08:11:41.849353    2411 system_pods.go:74] duration metric: took 180.426458ms to wait for pod list to return data ...

	I0520 08:11:41.849376    2411 default_sa.go:34] waiting for default service account to be created ...

	I0520 08:11:42.034900    2411 request.go:628] Waited for 185.38825ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.105.6:8443/api/v1/namespaces/default/serviceaccounts

	I0520 08:11:42.040087    2411 default_sa.go:45] found service account: "default"

	I0520 08:11:42.040112    2411 default_sa.go:55] duration metric: took 190.723917ms for default service account to be created ...

	I0520 08:11:42.040125    2411 system_pods.go:116] waiting for k8s-apps to be running ...

	I0520 08:11:42.234835    2411 request.go:628] Waited for 194.58975ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.105.6:8443/api/v1/namespaces/kube-system/pods

	I0520 08:11:42.248572    2411 system_pods.go:86] 7 kube-system pods found

	I0520 08:11:42.248610    2411 system_pods.go:89] "coredns-66bff467f8-8756c" [2eec04c4-2fdc-428f-bdab-dfb247718b98] Running

	I0520 08:11:42.248622    2411 system_pods.go:89] "etcd-ingress-addon-legacy-371000" [9b88ca73-b486-4840-ba4c-571e34472372] Running

	I0520 08:11:42.248632    2411 system_pods.go:89] "kube-apiserver-ingress-addon-legacy-371000" [afde7e53-c7bc-4439-a6c3-7492db9e75dc] Running

	I0520 08:11:42.248646    2411 system_pods.go:89] "kube-controller-manager-ingress-addon-legacy-371000" [832a399e-3dab-40e4-8659-03766dfb9bb9] Running

	I0520 08:11:42.248661    2411 system_pods.go:89] "kube-proxy-k65p6" [a4f06e0c-ed08-454b-a71f-e508e9f907f9] Running

	I0520 08:11:42.248671    2411 system_pods.go:89] "kube-scheduler-ingress-addon-legacy-371000" [6457eab4-e622-4b7e-94b7-05acf4fe5a02] Running

	I0520 08:11:42.248682    2411 system_pods.go:89] "storage-provisioner" [b44b6fe0-3a04-41f7-98bd-dcdc7a2ace82] Running

	I0520 08:11:42.248696    2411 system_pods.go:126] duration metric: took 208.562708ms to wait for k8s-apps to be running ...

	I0520 08:11:42.248718    2411 system_svc.go:44] waiting for kubelet service to be running ....

	I0520 08:11:42.248943    2411 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0520 08:11:42.267945    2411 system_svc.go:56] duration metric: took 19.226041ms WaitForService to wait for kubelet.

	I0520 08:11:42.267968    2411 kubeadm.go:581] duration metric: took 8.557787583s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...

	I0520 08:11:42.267991    2411 node_conditions.go:102] verifying NodePressure condition ...

	I0520 08:11:42.434945    2411 request.go:628] Waited for 166.804541ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.105.6:8443/api/v1/nodes

	I0520 08:11:42.443380    2411 node_conditions.go:122] node storage ephemeral capacity is 17784760Ki

	I0520 08:11:42.443430    2411 node_conditions.go:123] node cpu capacity is 2

	I0520 08:11:42.443464    2411 node_conditions.go:105] duration metric: took 175.455542ms to run NodePressure ...

	I0520 08:11:42.443489    2411 start.go:228] waiting for startup goroutines ...

	I0520 08:11:42.443506    2411 start.go:233] waiting for cluster config update ...

	I0520 08:11:42.443531    2411 start.go:242] writing updated cluster config ...

	I0520 08:11:42.445027    2411 ssh_runner.go:195] Run: rm -f paused

	I0520 08:11:42.566579    2411 start.go:568] kubectl: 1.25.9, cluster: 1.18.20 (minor skew: 7)

	I0520 08:11:42.570946    2411 out.go:177] 

	W0520 08:11:42.574949    2411 out.go:239] ! /usr/local/bin/kubectl is version 1.25.9, which may have incompatibilities with Kubernetes 1.18.20.

	I0520 08:11:42.578852    2411 out.go:177]   - Want kubectl v1.18.20? Try 'minikube kubectl -- get pods -A'

	I0520 08:11:42.589825    2411 out.go:177] * Done! kubectl is now configured to use "ingress-addon-legacy-371000" cluster and "default" namespace by default

	* 

	* ==> Docker <==

	* -- Journal begins at Sat 2023-05-20 15:10:45 UTC, ends at Sat 2023-05-20 15:12:51 UTC. --

	May 20 15:12:27 ingress-addon-legacy-371000 dockerd[1242]: time="2023-05-20T15:12:27.837693850Z" level=info msg="shim disconnected" id=d4465ecac2ad8d7a550a1ac69ad6a5ee312b4c46ea721a22863c58bae413e8ef namespace=moby

	May 20 15:12:27 ingress-addon-legacy-371000 dockerd[1242]: time="2023-05-20T15:12:27.837736518Z" level=warning msg="cleaning up after shim disconnected" id=d4465ecac2ad8d7a550a1ac69ad6a5ee312b4c46ea721a22863c58bae413e8ef namespace=moby

	May 20 15:12:27 ingress-addon-legacy-371000 dockerd[1242]: time="2023-05-20T15:12:27.837741310Z" level=info msg="cleaning up dead shim" namespace=moby

	May 20 15:12:42 ingress-addon-legacy-371000 dockerd[1235]: time="2023-05-20T15:12:42.072259440Z" level=info msg="ignoring event" container=42da86a655e9a2337707ceabcb139f35c6644f49a543783da285e2fbebae7b45 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 20 15:12:42 ingress-addon-legacy-371000 dockerd[1242]: time="2023-05-20T15:12:42.072624409Z" level=info msg="shim disconnected" id=42da86a655e9a2337707ceabcb139f35c6644f49a543783da285e2fbebae7b45 namespace=moby

	May 20 15:12:42 ingress-addon-legacy-371000 dockerd[1242]: time="2023-05-20T15:12:42.072659993Z" level=warning msg="cleaning up after shim disconnected" id=42da86a655e9a2337707ceabcb139f35c6644f49a543783da285e2fbebae7b45 namespace=moby

	May 20 15:12:42 ingress-addon-legacy-371000 dockerd[1242]: time="2023-05-20T15:12:42.072667077Z" level=info msg="cleaning up dead shim" namespace=moby

	May 20 15:12:43 ingress-addon-legacy-371000 dockerd[1242]: time="2023-05-20T15:12:43.070451465Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	May 20 15:12:43 ingress-addon-legacy-371000 dockerd[1242]: time="2023-05-20T15:12:43.070704014Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	May 20 15:12:43 ingress-addon-legacy-371000 dockerd[1242]: time="2023-05-20T15:12:43.070720098Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	May 20 15:12:43 ingress-addon-legacy-371000 dockerd[1242]: time="2023-05-20T15:12:43.070789100Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	May 20 15:12:43 ingress-addon-legacy-371000 dockerd[1235]: time="2023-05-20T15:12:43.106675470Z" level=info msg="ignoring event" container=853f3c51575ddd256f2d93e9cb8634eebdb3a070394884ae831d44e93d7f6b32 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 20 15:12:43 ingress-addon-legacy-371000 dockerd[1242]: time="2023-05-20T15:12:43.106851933Z" level=info msg="shim disconnected" id=853f3c51575ddd256f2d93e9cb8634eebdb3a070394884ae831d44e93d7f6b32 namespace=moby

	May 20 15:12:43 ingress-addon-legacy-371000 dockerd[1242]: time="2023-05-20T15:12:43.106876558Z" level=warning msg="cleaning up after shim disconnected" id=853f3c51575ddd256f2d93e9cb8634eebdb3a070394884ae831d44e93d7f6b32 namespace=moby

	May 20 15:12:43 ingress-addon-legacy-371000 dockerd[1242]: time="2023-05-20T15:12:43.106880725Z" level=info msg="cleaning up dead shim" namespace=moby

	May 20 15:12:46 ingress-addon-legacy-371000 dockerd[1235]: time="2023-05-20T15:12:46.508519925Z" level=info msg="Container failed to exit within 2s of signal 15 - using the force" container=7fc9fbce956df23726b84c6e920ce88c2b7bbc4296d0e78a92aeb2349e6cef38

	May 20 15:12:46 ingress-addon-legacy-371000 dockerd[1235]: time="2023-05-20T15:12:46.535662897Z" level=info msg="Container failed to exit within 2s of signal 15 - using the force" container=7fc9fbce956df23726b84c6e920ce88c2b7bbc4296d0e78a92aeb2349e6cef38

	May 20 15:12:46 ingress-addon-legacy-371000 dockerd[1242]: time="2023-05-20T15:12:46.606028228Z" level=info msg="shim disconnected" id=7fc9fbce956df23726b84c6e920ce88c2b7bbc4296d0e78a92aeb2349e6cef38 namespace=moby

	May 20 15:12:46 ingress-addon-legacy-371000 dockerd[1242]: time="2023-05-20T15:12:46.606113147Z" level=warning msg="cleaning up after shim disconnected" id=7fc9fbce956df23726b84c6e920ce88c2b7bbc4296d0e78a92aeb2349e6cef38 namespace=moby

	May 20 15:12:46 ingress-addon-legacy-371000 dockerd[1242]: time="2023-05-20T15:12:46.606122230Z" level=info msg="cleaning up dead shim" namespace=moby

	May 20 15:12:46 ingress-addon-legacy-371000 dockerd[1235]: time="2023-05-20T15:12:46.606503699Z" level=info msg="ignoring event" container=7fc9fbce956df23726b84c6e920ce88c2b7bbc4296d0e78a92aeb2349e6cef38 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 20 15:12:46 ingress-addon-legacy-371000 dockerd[1242]: time="2023-05-20T15:12:46.645107767Z" level=info msg="shim disconnected" id=28f0cf39cfbb68e1cdb2f2013b106a2940c324cf6d0d8d0a15feacabf121b119 namespace=moby

	May 20 15:12:46 ingress-addon-legacy-371000 dockerd[1242]: time="2023-05-20T15:12:46.645138935Z" level=warning msg="cleaning up after shim disconnected" id=28f0cf39cfbb68e1cdb2f2013b106a2940c324cf6d0d8d0a15feacabf121b119 namespace=moby

	May 20 15:12:46 ingress-addon-legacy-371000 dockerd[1242]: time="2023-05-20T15:12:46.645143560Z" level=info msg="cleaning up dead shim" namespace=moby

	May 20 15:12:46 ingress-addon-legacy-371000 dockerd[1235]: time="2023-05-20T15:12:46.645219437Z" level=info msg="ignoring event" container=28f0cf39cfbb68e1cdb2f2013b106a2940c324cf6d0d8d0a15feacabf121b119 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	* 

	* ==> container status <==

	* CONTAINER           IMAGE                                                                                                              CREATED              STATE               NAME                      ATTEMPT             POD ID

	853f3c51575dd       13753a81eccfd                                                                                                      8 seconds ago        Exited              hello-world-app           2                   b45168fbed5f8

	db9d43c894a4c       nginx@sha256:02ffd439b71d9ea9408e449b568f65c0bbbb94bebd8750f1d80231ab6496008e                                      34 seconds ago       Running             nginx                     0                   8691dc962dc63

	7fc9fbce956df       registry.k8s.io/ingress-nginx/controller@sha256:35fe394c82164efa8f47f3ed0be981b3f23da77175bbb8268a9ae438851c8324   55 seconds ago       Exited              controller                0                   28f0cf39cfbb6

	ea0087f565eb8       jettech/kube-webhook-certgen@sha256:950833e19ade18cd389d647efb88992a7cc077abedef343fa59e012d376d79b7               About a minute ago   Exited              patch                     0                   b39678463e201

	27f1276731a37       jettech/kube-webhook-certgen@sha256:950833e19ade18cd389d647efb88992a7cc077abedef343fa59e012d376d79b7               About a minute ago   Exited              create                    0                   61b5509e77d9b

	e0363764c55e6       gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944    About a minute ago   Running             storage-provisioner       0                   59c153793acf0

	13f01b9373301       6e17ba78cf3eb                                                                                                      About a minute ago   Running             coredns                   0                   8cd20e4ad6c11

	4a543cd77f6f5       565297bc6f7d4                                                                                                      About a minute ago   Running             kube-proxy                0                   970a9a7543efc

	5003745eaafd6       095f37015706d                                                                                                      About a minute ago   Running             kube-scheduler            0                   ae24c6ce42c52

	0b464588143a4       2694cf044d665                                                                                                      About a minute ago   Running             kube-apiserver            0                   1ad5182f0974e

	75b7cd98378ed       ab707b0a0ea33                                                                                                      About a minute ago   Running             etcd                      0                   4a52ce869bad9

	ffd97d080490b       68a4fac29a865                                                                                                      About a minute ago   Running             kube-controller-manager   0                   1caa8726b8d34

	* 

	* ==> coredns [13f01b937330] <==

	* [INFO] 172.17.0.1:44095 - 1773 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000032709s

	[INFO] 172.17.0.1:14254 - 55480 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000033793s

	[INFO] 172.17.0.1:44095 - 19729 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000032126s

	[INFO] 172.17.0.1:14254 - 10839 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000011833s

	[INFO] 172.17.0.1:44095 - 40584 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000029126s

	[INFO] 172.17.0.1:14254 - 11094 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000011293s

	[INFO] 172.17.0.1:44095 - 42895 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.00002846s

	[INFO] 172.17.0.1:14254 - 60311 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000011084s

	[INFO] 172.17.0.1:14254 - 36546 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000012417s

	[INFO] 172.17.0.1:44095 - 54324 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000048918s

	[INFO] 172.17.0.1:14254 - 35665 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000012209s

	[INFO] 172.17.0.1:31807 - 51117 "A IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000044044s

	[INFO] 172.17.0.1:64480 - 26444 "A IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000028209s

	[INFO] 172.17.0.1:31807 - 25437 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000018793s

	[INFO] 172.17.0.1:64480 - 43938 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000019251s

	[INFO] 172.17.0.1:64480 - 52899 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000018459s

	[INFO] 172.17.0.1:31807 - 5367 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.00003621s

	[INFO] 172.17.0.1:31807 - 61738 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000015917s

	[INFO] 172.17.0.1:64480 - 2278 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000016917s

	[INFO] 172.17.0.1:31807 - 7720 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000031792s

	[INFO] 172.17.0.1:64480 - 43249 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000017876s

	[INFO] 172.17.0.1:64480 - 7874 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000015459s

	[INFO] 172.17.0.1:31807 - 12846 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000037168s

	[INFO] 172.17.0.1:64480 - 50735 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.00004596s

	[INFO] 172.17.0.1:31807 - 9379 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000045252s

	* 

	* ==> describe nodes <==

	* Name:               ingress-addon-legacy-371000

	Roles:              master

	Labels:             beta.kubernetes.io/arch=arm64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=arm64

	                    kubernetes.io/hostname=ingress-addon-legacy-371000

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=24686ce6bbd657e092eb3c3fd6be64c1b7241033

	                    minikube.k8s.io/name=ingress-addon-legacy-371000

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2023_05_20T08_11_17_0700

	                    minikube.k8s.io/version=v1.30.1

	                    node-role.kubernetes.io/master=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /var/run/dockershim.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Sat, 20 May 2023 15:11:15 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ingress-addon-legacy-371000

	  AcquireTime:     <unset>

	  RenewTime:       Sat, 20 May 2023 15:12:44 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Sat, 20 May 2023 15:12:24 +0000   Sat, 20 May 2023 15:11:13 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Sat, 20 May 2023 15:12:24 +0000   Sat, 20 May 2023 15:11:13 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Sat, 20 May 2023 15:12:24 +0000   Sat, 20 May 2023 15:11:13 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Sat, 20 May 2023 15:12:24 +0000   Sat, 20 May 2023 15:11:15 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.105.6

	  Hostname:    ingress-addon-legacy-371000

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17784760Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             4004084Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17784760Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             4004084Ki

	  pods:               110

	System Info:

	  Machine ID:                 d77c379fb93f4809a9956253aa22d8c1

	  System UUID:                d77c379fb93f4809a9956253aa22d8c1

	  Boot ID:                    d1bc664f-ed28-4deb-a390-e0440eb1ee50

	  Kernel Version:             5.10.57

	  OS Image:                   Buildroot 2021.02.12

	  Operating System:           linux

	  Architecture:               arm64

	  Container Runtime Version:  docker://20.10.23

	  Kubelet Version:            v1.18.20

	  Kube-Proxy Version:         v1.18.20

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (9 in total)

	  Namespace                   Name                                                   CPU Requests  CPU Limits  Memory Requests  Memory Limits  AGE

	  ---------                   ----                                                   ------------  ----------  ---------------  -------------  ---

	  default                     hello-world-app-5f5d8b66bb-fnflz                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         27s

	  default                     nginx                                                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         37s

	  kube-system                 coredns-66bff467f8-8756c                               100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (1%!)(MISSING)        170Mi (4%!)(MISSING)     79s

	  kube-system                 etcd-ingress-addon-legacy-371000                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         87s

	  kube-system                 kube-apiserver-ingress-addon-legacy-371000             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         87s

	  kube-system                 kube-controller-manager-ingress-addon-legacy-371000    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         87s

	  kube-system                 kube-proxy-k65p6                                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         78s

	  kube-system                 kube-scheduler-ingress-addon-legacy-371000             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         87s

	  kube-system                 storage-provisioner                                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         78s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                650m (32%!)(MISSING)  0 (0%!)(MISSING)

	  memory             70Mi (1%!)(MISSING)   170Mi (4%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-32Mi     0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-64Ki     0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age   From        Message

	  ----    ------                   ----  ----        -------

	  Normal  Starting                 88s   kubelet     Starting kubelet.

	  Normal  NodeAllocatableEnforced  87s   kubelet     Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  87s   kubelet     Node ingress-addon-legacy-371000 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    87s   kubelet     Node ingress-addon-legacy-371000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     87s   kubelet     Node ingress-addon-legacy-371000 status is now: NodeHasSufficientPID

	  Normal  Starting                 78s   kube-proxy  Starting kube-proxy.

	* 

	* ==> dmesg <==

	* [May20 15:10] ACPI: SRAT not present

	[  +0.000000] KASLR disabled due to lack of seed

	[  +0.661755] EINJ: EINJ table not found.

	[  +0.511169] systemd-fstab-generator[114]: Ignoring "noauto" for root device

	[  +0.044301] systemd[1]: systemd-journald.service: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.

	[  +0.000802] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)

	[  +4.202647] systemd-fstab-generator[473]: Ignoring "noauto" for root device

	[  +0.072273] systemd-fstab-generator[484]: Ignoring "noauto" for root device

	[  +3.474063] systemd-fstab-generator[776]: Ignoring "noauto" for root device

	[  +1.487712] systemd-fstab-generator[937]: Ignoring "noauto" for root device

	[  +0.174283] systemd-fstab-generator[972]: Ignoring "noauto" for root device

	[  +0.085678] systemd-fstab-generator[987]: Ignoring "noauto" for root device

	[  +0.086054] systemd-fstab-generator[1013]: Ignoring "noauto" for root device

	[  +1.140233] kauditd_printk_skb: 53 callbacks suppressed

	[  +3.175048] systemd-fstab-generator[1211]: Ignoring "noauto" for root device

	[May20 15:11] systemd-fstab-generator[1694]: Ignoring "noauto" for root device

	[  +8.116176] kauditd_printk_skb: 68 callbacks suppressed

	[  +0.079489] kmem.limit_in_bytes is deprecated and will be removed. Please report your usecase to linux-mm@kvack.org if you depend on this functionality.

	[  +5.879268] systemd-fstab-generator[2786]: Ignoring "noauto" for root device

	[ +16.590637] kauditd_printk_skb: 7 callbacks suppressed

	[  +7.098148] kauditd_printk_skb: 7 callbacks suppressed

	[  +7.338537] TCP: eth0: Driver has suspect GRO implementation, TCP performance may be compromised.

	[May20 15:12] kauditd_printk_skb: 1 callbacks suppressed

	* 

	* ==> etcd [75b7cd98378e] <==

	* raft2023/05/20 15:11:12 INFO: ed054832bd1917e1 became follower at term 0

	raft2023/05/20 15:11:12 INFO: newRaft ed054832bd1917e1 [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]

	raft2023/05/20 15:11:12 INFO: ed054832bd1917e1 became follower at term 1

	raft2023/05/20 15:11:12 INFO: ed054832bd1917e1 switched to configuration voters=(17079136544630577121)

	2023-05-20 15:11:12.488148 W | auth: simple token is not cryptographically signed

	2023-05-20 15:11:12.489332 I | etcdserver: starting server... [version: 3.4.3, cluster version: to_be_decided]

	2023-05-20 15:11:12.490184 I | embed: ClientTLS: cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = 

	2023-05-20 15:11:12.490252 I | embed: listening for metrics on http://127.0.0.1:2381

	2023-05-20 15:11:12.490351 I | etcdserver: ed054832bd1917e1 as single-node; fast-forwarding 9 ticks (election ticks 10)

	2023-05-20 15:11:12.490558 I | embed: listening for peers on 192.168.105.6:2380

	raft2023/05/20 15:11:12 INFO: ed054832bd1917e1 switched to configuration voters=(17079136544630577121)

	2023-05-20 15:11:12.490730 I | etcdserver/membership: added member ed054832bd1917e1 [https://192.168.105.6:2380] to cluster 45a39c2c59b0edf4

	raft2023/05/20 15:11:12 INFO: ed054832bd1917e1 is starting a new election at term 1

	raft2023/05/20 15:11:12 INFO: ed054832bd1917e1 became candidate at term 2

	raft2023/05/20 15:11:12 INFO: ed054832bd1917e1 received MsgVoteResp from ed054832bd1917e1 at term 2

	raft2023/05/20 15:11:12 INFO: ed054832bd1917e1 became leader at term 2

	raft2023/05/20 15:11:12 INFO: raft.node: ed054832bd1917e1 elected leader ed054832bd1917e1 at term 2

	2023-05-20 15:11:12.803451 I | etcdserver: setting up the initial cluster version to 3.4

	2023-05-20 15:11:12.823434 N | etcdserver/membership: set the initial cluster version to 3.4

	2023-05-20 15:11:12.827444 I | etcdserver/api: enabled capabilities for version 3.4

	2023-05-20 15:11:12.830459 I | etcdserver: published {Name:ingress-addon-legacy-371000 ClientURLs:[https://192.168.105.6:2379]} to cluster 45a39c2c59b0edf4

	2023-05-20 15:11:12.830480 I | embed: ready to serve client requests

	2023-05-20 15:11:12.830520 I | embed: ready to serve client requests

	2023-05-20 15:11:12.838803 I | embed: serving client requests on 127.0.0.1:2379

	2023-05-20 15:11:12.939721 I | embed: serving client requests on 192.168.105.6:2379

	* 

	* ==> kernel <==

	*  15:12:51 up 2 min,  0 users,  load average: 0.74, 0.24, 0.08

	Linux ingress-addon-legacy-371000 5.10.57 #1 SMP PREEMPT Mon May 15 19:29:44 UTC 2023 aarch64 GNU/Linux

	PRETTY_NAME="Buildroot 2021.02.12"

	* 

	* ==> kube-apiserver [0b464588143a] <==

	* I0520 15:11:14.997755       1 shared_informer.go:223] Waiting for caches to sync for crd-autoregister

	E0520 15:11:15.010597       1 controller.go:152] Unable to remove old endpoints from kubernetes service: StorageError: key not found, Code: 1, Key: /registry/masterleases/192.168.105.6, ResourceVersion: 0, AdditionalErrorMsg: 

	I0520 15:11:15.081250       1 cache.go:39] Caches are synced for AvailableConditionController controller

	I0520 15:11:15.081262       1 shared_informer.go:230] Caches are synced for cluster_authentication_trust_controller 

	I0520 15:11:15.082932       1 cache.go:39] Caches are synced for autoregister controller

	I0520 15:11:15.083066       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller

	I0520 15:11:15.102708       1 shared_informer.go:230] Caches are synced for crd-autoregister 

	I0520 15:11:15.980081       1 controller.go:130] OpenAPI AggregationController: action for item : Nothing (removed from the queue).

	I0520 15:11:15.980535       1 controller.go:130] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).

	I0520 15:11:15.994000       1 storage_scheduling.go:134] created PriorityClass system-node-critical with value 2000001000

	I0520 15:11:16.003626       1 storage_scheduling.go:134] created PriorityClass system-cluster-critical with value 2000000000

	I0520 15:11:16.003654       1 storage_scheduling.go:143] all system priority classes are created successfully or already exist.

	I0520 15:11:16.142250       1 controller.go:609] quota admission added evaluator for: roles.rbac.authorization.k8s.io

	I0520 15:11:16.152395       1 controller.go:609] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io

	W0520 15:11:16.247885       1 lease.go:224] Resetting endpoints for master service "kubernetes" to [192.168.105.6]

	I0520 15:11:16.248332       1 controller.go:609] quota admission added evaluator for: endpoints

	I0520 15:11:16.249891       1 controller.go:609] quota admission added evaluator for: endpointslices.discovery.k8s.io

	I0520 15:11:17.286951       1 controller.go:609] quota admission added evaluator for: serviceaccounts

	I0520 15:11:17.643949       1 controller.go:609] quota admission added evaluator for: deployments.apps

	I0520 15:11:17.843335       1 controller.go:609] quota admission added evaluator for: daemonsets.apps

	I0520 15:11:23.978758       1 controller.go:609] quota admission added evaluator for: leases.coordination.k8s.io

	I0520 15:11:32.698162       1 controller.go:609] quota admission added evaluator for: replicasets.apps

	I0520 15:11:33.316751       1 controller.go:609] quota admission added evaluator for: controllerrevisions.apps

	I0520 15:11:42.861363       1 controller.go:609] quota admission added evaluator for: jobs.batch

	I0520 15:12:14.499941       1 controller.go:609] quota admission added evaluator for: ingresses.networking.k8s.io

	* 

	* ==> kube-controller-manager [ffd97d080490] <==

	* I0520 15:11:33.017251       1 shared_informer.go:230] Caches are synced for attach detach 

	I0520 15:11:33.044918       1 shared_informer.go:230] Caches are synced for service account 

	I0520 15:11:33.088426       1 shared_informer.go:230] Caches are synced for namespace 

	I0520 15:11:33.156217       1 shared_informer.go:230] Caches are synced for job 

	I0520 15:11:33.242016       1 shared_informer.go:230] Caches are synced for disruption 

	I0520 15:11:33.242028       1 disruption.go:339] Sending events to api server.

	I0520 15:11:33.245273       1 shared_informer.go:230] Caches are synced for garbage collector 

	I0520 15:11:33.245286       1 garbagecollector.go:142] Garbage collector: all resource monitors have synced. Proceeding to collect garbage

	I0520 15:11:33.252698       1 shared_informer.go:230] Caches are synced for garbage collector 

	I0520 15:11:33.264728       1 event.go:278] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"kube-system", Name:"coredns", UID:"00a49698-3b4c-4d10-9035-6137b9ffd208", APIVersion:"apps/v1", ResourceVersion:"334", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled down replica set coredns-66bff467f8 to 1

	I0520 15:11:33.274506       1 event.go:278] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kube-system", Name:"coredns-66bff467f8", UID:"291c0fc9-194e-42c0-8284-338ad47b5787", APIVersion:"apps/v1", ResourceVersion:"335", FieldPath:""}): type: 'Normal' reason: 'SuccessfulDelete' Deleted pod: coredns-66bff467f8-m2lfb

	I0520 15:11:33.284059       1 shared_informer.go:230] Caches are synced for stateful set 

	I0520 15:11:33.293798       1 shared_informer.go:230] Caches are synced for resource quota 

	I0520 15:11:33.314560       1 shared_informer.go:230] Caches are synced for daemon sets 

	I0520 15:11:33.319167       1 event.go:278] Event(v1.ObjectReference{Kind:"DaemonSet", Namespace:"kube-system", Name:"kube-proxy", UID:"13934369-266a-4b56-ab47-d82d1542d56d", APIVersion:"apps/v1", ResourceVersion:"211", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: kube-proxy-k65p6

	I0520 15:11:33.343850       1 shared_informer.go:230] Caches are synced for resource quota 

	I0520 15:11:42.841551       1 event.go:278] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"ingress-nginx", Name:"ingress-nginx-controller", UID:"c6fc4d8e-7c76-45d5-ade4-44bffd79a5a4", APIVersion:"apps/v1", ResourceVersion:"433", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set ingress-nginx-controller-7fcf777cb7 to 1

	I0520 15:11:42.845739       1 event.go:278] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-7fcf777cb7", UID:"f9342773-c9d4-4cc8-a1eb-f2e14a574dbb", APIVersion:"apps/v1", ResourceVersion:"434", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: ingress-nginx-controller-7fcf777cb7-tnqdl

	I0520 15:11:42.875049       1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-patch", UID:"597e5621-a970-488b-ab8f-c3c6d0952768", APIVersion:"batch/v1", ResourceVersion:"445", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: ingress-nginx-admission-patch-b9f5l

	I0520 15:11:42.875154       1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-create", UID:"d78a6c40-90d3-4c52-b02c-c2d0c34ccffe", APIVersion:"batch/v1", ResourceVersion:"444", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: ingress-nginx-admission-create-cx6fw

	I0520 15:11:46.277201       1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-create", UID:"d78a6c40-90d3-4c52-b02c-c2d0c34ccffe", APIVersion:"batch/v1", ResourceVersion:"457", FieldPath:""}): type: 'Normal' reason: 'Completed' Job completed

	I0520 15:11:46.291148       1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-patch", UID:"597e5621-a970-488b-ab8f-c3c6d0952768", APIVersion:"batch/v1", ResourceVersion:"452", FieldPath:""}): type: 'Normal' reason: 'Completed' Job completed

	I0520 15:12:24.803215       1 event.go:278] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"default", Name:"hello-world-app", UID:"0ac766d0-63ad-430e-abb5-58d6c61c24bc", APIVersion:"apps/v1", ResourceVersion:"577", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set hello-world-app-5f5d8b66bb to 1

	I0520 15:12:24.807837       1 event.go:278] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"default", Name:"hello-world-app-5f5d8b66bb", UID:"d74110ce-56d4-4be9-bfed-42f0f3e02cf0", APIVersion:"apps/v1", ResourceVersion:"578", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: hello-world-app-5f5d8b66bb-fnflz

	E0520 15:12:49.273298       1 tokens_controller.go:261] error synchronizing serviceaccount ingress-nginx/default: secrets "default-token-t7dp2" is forbidden: unable to create new content in namespace ingress-nginx because it is being terminated

	* 

	* ==> kube-proxy [4a543cd77f6f] <==

	* W0520 15:11:33.814655       1 server_others.go:559] Unknown proxy mode "", assuming iptables proxy

	I0520 15:11:33.818423       1 node.go:136] Successfully retrieved node IP: 192.168.105.6

	I0520 15:11:33.818438       1 server_others.go:186] Using iptables Proxier.

	I0520 15:11:33.818656       1 server.go:583] Version: v1.18.20

	I0520 15:11:33.820004       1 config.go:315] Starting service config controller

	I0520 15:11:33.820068       1 shared_informer.go:223] Waiting for caches to sync for service config

	I0520 15:11:33.821036       1 config.go:133] Starting endpoints config controller

	I0520 15:11:33.821144       1 shared_informer.go:223] Waiting for caches to sync for endpoints config

	I0520 15:11:33.920280       1 shared_informer.go:230] Caches are synced for service config 

	I0520 15:11:33.921630       1 shared_informer.go:230] Caches are synced for endpoints config 

	* 

	* ==> kube-scheduler [5003745eaafd] <==

	* I0520 15:11:15.025246       1 registry.go:150] Registering EvenPodsSpread predicate and priority function

	I0520 15:11:15.026479       1 secure_serving.go:178] Serving securely on 127.0.0.1:10259

	I0520 15:11:15.026528       1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0520 15:11:15.029282       1 shared_informer.go:223] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0520 15:11:15.026535       1 tlsconfig.go:240] Starting DynamicServingCertificateController

	E0520 15:11:15.030201       1 reflector.go:178] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0520 15:11:15.030375       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E0520 15:11:15.030870       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E0520 15:11:15.030895       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0520 15:11:15.030916       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0520 15:11:15.030937       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0520 15:11:15.030956       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0520 15:11:15.030977       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0520 15:11:15.030996       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0520 15:11:15.031610       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0520 15:11:15.031645       1 reflector.go:178] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:233: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0520 15:11:15.031952       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0520 15:11:16.008022       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0520 15:11:16.053339       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0520 15:11:16.058721       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0520 15:11:16.079320       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E0520 15:11:16.096551       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	I0520 15:11:16.335436       1 shared_informer.go:230] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 

	E0520 15:11:32.727650       1 factory.go:503] pod: kube-system/coredns-66bff467f8-m2lfb is already present in the active queue

	E0520 15:11:32.732967       1 factory.go:503] pod: kube-system/coredns-66bff467f8-8756c is already present in the active queue

	* 

	* ==> kubelet <==

	* -- Journal begins at Sat 2023-05-20 15:10:45 UTC, ends at Sat 2023-05-20 15:12:51 UTC. --

	May 20 15:12:29 ingress-addon-legacy-371000 kubelet[2792]: I0520 15:12:29.804664    2792 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: d4465ecac2ad8d7a550a1ac69ad6a5ee312b4c46ea721a22863c58bae413e8ef

	May 20 15:12:29 ingress-addon-legacy-371000 kubelet[2792]: E0520 15:12:29.805160    2792 pod_workers.go:191] Error syncing pod 98c4baf6-9329-43ed-b52d-c0b85d658313 ("hello-world-app-5f5d8b66bb-fnflz_default(98c4baf6-9329-43ed-b52d-c0b85d658313)"), skipping: failed to "StartContainer" for "hello-world-app" with CrashLoopBackOff: "back-off 10s restarting failed container=hello-world-app pod=hello-world-app-5f5d8b66bb-fnflz_default(98c4baf6-9329-43ed-b52d-c0b85d658313)"

	May 20 15:12:32 ingress-addon-legacy-371000 kubelet[2792]: I0520 15:12:32.021998    2792 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: a25e115d4f7c286b2e73f601572db0d65e6de17491d438c2e49f7c3b3e935aa9

	May 20 15:12:32 ingress-addon-legacy-371000 kubelet[2792]: E0520 15:12:32.023719    2792 pod_workers.go:191] Error syncing pod 4ed4fe1a-c0b6-45d3-a13f-368ddd542ee2 ("kube-ingress-dns-minikube_kube-system(4ed4fe1a-c0b6-45d3-a13f-368ddd542ee2)"), skipping: failed to "StartContainer" for "minikube-ingress-dns" with CrashLoopBackOff: "back-off 20s restarting failed container=minikube-ingress-dns pod=kube-ingress-dns-minikube_kube-system(4ed4fe1a-c0b6-45d3-a13f-368ddd542ee2)"

	May 20 15:12:40 ingress-addon-legacy-371000 kubelet[2792]: I0520 15:12:40.207387    2792 reconciler.go:196] operationExecutor.UnmountVolume started for volume "minikube-ingress-dns-token-9z2tl" (UniqueName: "kubernetes.io/secret/4ed4fe1a-c0b6-45d3-a13f-368ddd542ee2-minikube-ingress-dns-token-9z2tl") pod "4ed4fe1a-c0b6-45d3-a13f-368ddd542ee2" (UID: "4ed4fe1a-c0b6-45d3-a13f-368ddd542ee2")

	May 20 15:12:40 ingress-addon-legacy-371000 kubelet[2792]: I0520 15:12:40.210491    2792 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ed4fe1a-c0b6-45d3-a13f-368ddd542ee2-minikube-ingress-dns-token-9z2tl" (OuterVolumeSpecName: "minikube-ingress-dns-token-9z2tl") pod "4ed4fe1a-c0b6-45d3-a13f-368ddd542ee2" (UID: "4ed4fe1a-c0b6-45d3-a13f-368ddd542ee2"). InnerVolumeSpecName "minikube-ingress-dns-token-9z2tl". PluginName "kubernetes.io/secret", VolumeGidValue ""

	May 20 15:12:40 ingress-addon-legacy-371000 kubelet[2792]: I0520 15:12:40.312546    2792 reconciler.go:319] Volume detached for volume "minikube-ingress-dns-token-9z2tl" (UniqueName: "kubernetes.io/secret/4ed4fe1a-c0b6-45d3-a13f-368ddd542ee2-minikube-ingress-dns-token-9z2tl") on node "ingress-addon-legacy-371000" DevicePath ""

	May 20 15:12:42 ingress-addon-legacy-371000 kubelet[2792]: I0520 15:12:42.998877    2792 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: a25e115d4f7c286b2e73f601572db0d65e6de17491d438c2e49f7c3b3e935aa9

	May 20 15:12:43 ingress-addon-legacy-371000 kubelet[2792]: I0520 15:12:43.021713    2792 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: d4465ecac2ad8d7a550a1ac69ad6a5ee312b4c46ea721a22863c58bae413e8ef

	May 20 15:12:43 ingress-addon-legacy-371000 kubelet[2792]: W0520 15:12:43.125185    2792 container.go:412] Failed to create summary reader for "/kubepods/besteffort/pod98c4baf6-9329-43ed-b52d-c0b85d658313/853f3c51575ddd256f2d93e9cb8634eebdb3a070394884ae831d44e93d7f6b32": none of the resources are being tracked.

	May 20 15:12:44 ingress-addon-legacy-371000 kubelet[2792]: W0520 15:12:44.026928    2792 docker_sandbox.go:400] failed to read pod IP from plugin/docker: Couldn't find network status for default/hello-world-app-5f5d8b66bb-fnflz through plugin: invalid network status for

	May 20 15:12:44 ingress-addon-legacy-371000 kubelet[2792]: I0520 15:12:44.052257    2792 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: 853f3c51575ddd256f2d93e9cb8634eebdb3a070394884ae831d44e93d7f6b32

	May 20 15:12:44 ingress-addon-legacy-371000 kubelet[2792]: E0520 15:12:44.052465    2792 pod_workers.go:191] Error syncing pod 98c4baf6-9329-43ed-b52d-c0b85d658313 ("hello-world-app-5f5d8b66bb-fnflz_default(98c4baf6-9329-43ed-b52d-c0b85d658313)"), skipping: failed to "StartContainer" for "hello-world-app" with CrashLoopBackOff: "back-off 20s restarting failed container=hello-world-app pod=hello-world-app-5f5d8b66bb-fnflz_default(98c4baf6-9329-43ed-b52d-c0b85d658313)"

	May 20 15:12:44 ingress-addon-legacy-371000 kubelet[2792]: I0520 15:12:44.052759    2792 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: d4465ecac2ad8d7a550a1ac69ad6a5ee312b4c46ea721a22863c58bae413e8ef

	May 20 15:12:44 ingress-addon-legacy-371000 kubelet[2792]: E0520 15:12:44.501210    2792 event.go:260] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"ingress-nginx-controller-7fcf777cb7-tnqdl.1760e2bd94113a9f", GenerateName:"", Namespace:"ingress-nginx", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Pod", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-7fcf777cb7-tnqdl", UID:"409951a3-0492-4c3a-9287-2eb0fafcebec", APIVersion:"v1", ResourceVersion:"439", FieldPath:"spec.containers{controller}"}, Reason:"Killing", Message:"Stoppi

ng container controller", Source:v1.EventSource{Component:"kubelet", Host:"ingress-addon-legacy-371000"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc11256bb1da6029f, ext:86878391897, loc:(*time.Location)(0x6a0ef20)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc11256bb1da6029f, ext:86878391897, loc:(*time.Location)(0x6a0ef20)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'events "ingress-nginx-controller-7fcf777cb7-tnqdl.1760e2bd94113a9f" is forbidden: unable to create new content in namespace ingress-nginx because it is being terminated' (will not retry!)

	May 20 15:12:44 ingress-addon-legacy-371000 kubelet[2792]: E0520 15:12:44.532387    2792 event.go:260] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"ingress-nginx-controller-7fcf777cb7-tnqdl.1760e2bd94113a9f", GenerateName:"", Namespace:"ingress-nginx", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Pod", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-7fcf777cb7-tnqdl", UID:"409951a3-0492-4c3a-9287-2eb0fafcebec", APIVersion:"v1", ResourceVersion:"439", FieldPath:"spec.containers{controller}"}, Reason:"Killing", Message:"Stoppi

ng container controller", Source:v1.EventSource{Component:"kubelet", Host:"ingress-addon-legacy-371000"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc11256bb1da6029f, ext:86878391897, loc:(*time.Location)(0x6a0ef20)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc11256bb1f93babf, ext:86910748281, loc:(*time.Location)(0x6a0ef20)}}, Count:2, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'events "ingress-nginx-controller-7fcf777cb7-tnqdl.1760e2bd94113a9f" is forbidden: unable to create new content in namespace ingress-nginx because it is being terminated' (will not retry!)

	May 20 15:12:45 ingress-addon-legacy-371000 kubelet[2792]: W0520 15:12:45.054706    2792 docker_sandbox.go:400] failed to read pod IP from plugin/docker: Couldn't find network status for default/hello-world-app-5f5d8b66bb-fnflz through plugin: invalid network status for

	May 20 15:12:47 ingress-addon-legacy-371000 kubelet[2792]: W0520 15:12:47.091712    2792 pod_container_deletor.go:77] Container "28f0cf39cfbb68e1cdb2f2013b106a2940c324cf6d0d8d0a15feacabf121b119" not found in pod's containers

	May 20 15:12:48 ingress-addon-legacy-371000 kubelet[2792]: I0520 15:12:48.719607    2792 reconciler.go:196] operationExecutor.UnmountVolume started for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/409951a3-0492-4c3a-9287-2eb0fafcebec-webhook-cert") pod "409951a3-0492-4c3a-9287-2eb0fafcebec" (UID: "409951a3-0492-4c3a-9287-2eb0fafcebec")

	May 20 15:12:48 ingress-addon-legacy-371000 kubelet[2792]: I0520 15:12:48.720604    2792 reconciler.go:196] operationExecutor.UnmountVolume started for volume "ingress-nginx-token-2r84k" (UniqueName: "kubernetes.io/secret/409951a3-0492-4c3a-9287-2eb0fafcebec-ingress-nginx-token-2r84k") pod "409951a3-0492-4c3a-9287-2eb0fafcebec" (UID: "409951a3-0492-4c3a-9287-2eb0fafcebec")

	May 20 15:12:48 ingress-addon-legacy-371000 kubelet[2792]: I0520 15:12:48.726403    2792 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/409951a3-0492-4c3a-9287-2eb0fafcebec-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "409951a3-0492-4c3a-9287-2eb0fafcebec" (UID: "409951a3-0492-4c3a-9287-2eb0fafcebec"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGidValue ""

	May 20 15:12:48 ingress-addon-legacy-371000 kubelet[2792]: I0520 15:12:48.727843    2792 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/409951a3-0492-4c3a-9287-2eb0fafcebec-ingress-nginx-token-2r84k" (OuterVolumeSpecName: "ingress-nginx-token-2r84k") pod "409951a3-0492-4c3a-9287-2eb0fafcebec" (UID: "409951a3-0492-4c3a-9287-2eb0fafcebec"). InnerVolumeSpecName "ingress-nginx-token-2r84k". PluginName "kubernetes.io/secret", VolumeGidValue ""

	May 20 15:12:48 ingress-addon-legacy-371000 kubelet[2792]: I0520 15:12:48.821213    2792 reconciler.go:319] Volume detached for volume "ingress-nginx-token-2r84k" (UniqueName: "kubernetes.io/secret/409951a3-0492-4c3a-9287-2eb0fafcebec-ingress-nginx-token-2r84k") on node "ingress-addon-legacy-371000" DevicePath ""

	May 20 15:12:48 ingress-addon-legacy-371000 kubelet[2792]: I0520 15:12:48.821317    2792 reconciler.go:319] Volume detached for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/409951a3-0492-4c3a-9287-2eb0fafcebec-webhook-cert") on node "ingress-addon-legacy-371000" DevicePath ""

	May 20 15:12:50 ingress-addon-legacy-371000 kubelet[2792]: W0520 15:12:50.038030    2792 kubelet_getters.go:297] Path "/var/lib/kubelet/pods/409951a3-0492-4c3a-9287-2eb0fafcebec/volumes" does not exist

	* 

	* ==> storage-provisioner [e0363764c55e] <==

	* I0520 15:11:36.484693       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0520 15:11:36.489006       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0520 15:11:36.489023       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I0520 15:11:36.491687       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0520 15:11:36.491919       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"9e567354-0a31-4d4e-a1f3-029a762560fb", APIVersion:"v1", ResourceVersion:"389", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' ingress-addon-legacy-371000_6ce73e8e-fe9f-4a20-9c52-7adf0904802c became leader

	I0520 15:11:36.493657       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_ingress-addon-legacy-371000_6ce73e8e-fe9f-4a20-9c52-7adf0904802c!

	I0520 15:11:36.594617       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_ingress-addon-legacy-371000_6ce73e8e-fe9f-4a20-9c52-7adf0904802c!

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.APIServer}} -p ingress-addon-legacy-371000 -n ingress-addon-legacy-371000

helpers_test.go:261: (dbg) Run:  kubectl --context ingress-addon-legacy-371000 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:285: <<< TestIngressAddonLegacy/serial/ValidateIngressAddons FAILED: end of post-mortem logs <<<

helpers_test.go:286: ---------------------/post-mortem---------------------------------

--- FAIL: TestIngressAddonLegacy/serial/ValidateIngressAddons (54.29s)

=== RUN   TestMountStart/serial/StartWithMountFirst

mount_start_test.go:98: (dbg) Run:  out/minikube-darwin-arm64 start -p mount-start-1-937000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=qemu2 

mount_start_test.go:98: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p mount-start-1-937000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=qemu2 : exit status 80 (10.359012375s)

-- stdout --

	* [mount-start-1-937000] minikube v1.30.1 on Darwin 13.3.1 (arm64)

	  - MINIKUBE_LOCATION=16543

	  - KUBECONFIG=/Users/jenkins/minikube-integration/16543-1012/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/16543-1012/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting minikube without Kubernetes in cluster mount-start-1-937000

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "mount-start-1-937000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p mount-start-1-937000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

mount_start_test.go:100: failed to start minikube with args: "out/minikube-darwin-arm64 start -p mount-start-1-937000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=qemu2 " : exit status 80

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p mount-start-1-937000 -n mount-start-1-937000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p mount-start-1-937000 -n mount-start-1-937000: exit status 7 (66.492792ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "mount-start-1-937000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMountStart/serial/StartWithMountFirst (10.43s)

=== RUN   TestMultiNode/serial/FreshStart2Nodes

multinode_test.go:85: (dbg) Run:  out/minikube-darwin-arm64 start -p multinode-046000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=qemu2 

multinode_test.go:85: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p multinode-046000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=qemu2 : exit status 80 (9.846224583s)

-- stdout --

	* [multinode-046000] minikube v1.30.1 on Darwin 13.3.1 (arm64)

	  - MINIKUBE_LOCATION=16543

	  - KUBECONFIG=/Users/jenkins/minikube-integration/16543-1012/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/16543-1012/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting control plane node multinode-046000 in cluster multinode-046000

	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "multinode-046000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0520 08:15:30.544007    2822 out.go:296] Setting OutFile to fd 1 ...

	I0520 08:15:30.544133    2822 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0520 08:15:30.544136    2822 out.go:309] Setting ErrFile to fd 2...

	I0520 08:15:30.544144    2822 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0520 08:15:30.544212    2822 root.go:336] Updating PATH: /Users/jenkins/minikube-integration/16543-1012/.minikube/bin

	I0520 08:15:30.545249    2822 out.go:303] Setting JSON to false

	I0520 08:15:30.561064    2822 start.go:125] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":901,"bootTime":1684594829,"procs":452,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"13.3.1","kernelVersion":"22.4.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}

	W0520 08:15:30.561132    2822 start.go:133] gopshost.Virtualization returned error: not implemented yet

	I0520 08:15:30.566392    2822 out.go:177] * [multinode-046000] minikube v1.30.1 on Darwin 13.3.1 (arm64)

	I0520 08:15:30.574354    2822 notify.go:220] Checking for updates...

	I0520 08:15:30.577387    2822 out.go:177]   - MINIKUBE_LOCATION=16543

	I0520 08:15:30.580376    2822 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/16543-1012/kubeconfig

	I0520 08:15:30.583287    2822 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0520 08:15:30.586316    2822 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0520 08:15:30.592305    2822 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/16543-1012/.minikube

	I0520 08:15:30.595389    2822 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0520 08:15:30.598529    2822 driver.go:375] Setting default libvirt URI to qemu:///system

	I0520 08:15:30.601383    2822 out.go:177] * Using the qemu2 driver based on user configuration

	I0520 08:15:30.608333    2822 start.go:295] selected driver: qemu2

	I0520 08:15:30.608346    2822 start.go:870] validating driver "qemu2" against <nil>

	I0520 08:15:30.608354    2822 start.go:881] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0520 08:15:30.610276    2822 start_flags.go:305] no existing cluster config was found, will generate one from the flags 

	I0520 08:15:30.611759    2822 out.go:177] * Automatically selected the socket_vmnet network

	I0520 08:15:30.614420    2822 start_flags.go:915] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0520 08:15:30.614449    2822 cni.go:84] Creating CNI manager for ""

	I0520 08:15:30.614454    2822 cni.go:136] 0 nodes found, recommending kindnet

	I0520 08:15:30.614458    2822 start_flags.go:314] Found "CNI" CNI - setting NetworkPlugin=cni

	I0520 08:15:30.614469    2822 start_flags.go:319] config:

	{Name:multinode-046000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684523789-16533@sha256:ed200ff6d686f303885e8aaf964442d08018856d63a8e23f7acdc068766ea82b Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.2 ClusterName:multinode-046000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:doc

ker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}

	I0520 08:15:30.614555    2822 iso.go:125] acquiring lock: {Name:mkf05a14b47e9b67445252fbb4917f3bcb37f054 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0520 08:15:30.623337    2822 out.go:177] * Starting control plane node multinode-046000 in cluster multinode-046000

	I0520 08:15:30.627339    2822 preload.go:132] Checking if preload exists for k8s version v1.27.2 and runtime docker

	I0520 08:15:30.627362    2822 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.2-docker-overlay2-arm64.tar.lz4

	I0520 08:15:30.627376    2822 cache.go:57] Caching tarball of preloaded images

	I0520 08:15:30.627440    2822 preload.go:174] Found /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0520 08:15:30.627446    2822 cache.go:60] Finished verifying existence of preloaded tar for  v1.27.2 on docker

	I0520 08:15:30.627667    2822 profile.go:148] Saving config to /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/multinode-046000/config.json ...

	I0520 08:15:30.627681    2822 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/multinode-046000/config.json: {Name:mk825d91868bead5031bc83c2d2f5ea795b1cde2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0520 08:15:30.627884    2822 cache.go:195] Successfully downloaded all kic artifacts

	I0520 08:15:30.627900    2822 start.go:364] acquiring machines lock for multinode-046000: {Name:mk270c257f49033ffda3b70fea9b877c78314aa8 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0520 08:15:30.627930    2822 start.go:368] acquired machines lock for "multinode-046000" in 25.5µs

	I0520 08:15:30.627948    2822 start.go:93] Provisioning new machine with config: &{Name:multinode-046000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/16506/minikube-v1.30.1-1684174510-16506-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684523789-16533@sha256:ed200ff6d686f303885e8aaf964442d08018856d63a8e23f7acdc068766ea82b Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesCo

nfig:{KubernetesVersion:v1.27.2 ClusterName:multinode-046000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSiz

e:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:} &{Name: IP: Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0520 08:15:30.627987    2822 start.go:125] createHost starting for "" (driver="qemu2")

	I0520 08:15:30.636314    2822 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0520 08:15:30.653781    2822 start.go:159] libmachine.API.Create for "multinode-046000" (driver="qemu2")

	I0520 08:15:30.653814    2822 client.go:168] LocalClient.Create starting

	I0520 08:15:30.653883    2822 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/ca.pem

	I0520 08:15:30.653903    2822 main.go:141] libmachine: Decoding PEM data...

	I0520 08:15:30.653916    2822 main.go:141] libmachine: Parsing certificate...

	I0520 08:15:30.653965    2822 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/cert.pem

	I0520 08:15:30.653984    2822 main.go:141] libmachine: Decoding PEM data...

	I0520 08:15:30.653993    2822 main.go:141] libmachine: Parsing certificate...

	I0520 08:15:30.654352    2822 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/16543-1012/.minikube/cache/iso/arm64/minikube-v1.30.1-1684174510-16506-arm64.iso...

	I0520 08:15:30.784672    2822 main.go:141] libmachine: Creating SSH key...

	I0520 08:15:30.974047    2822 main.go:141] libmachine: Creating Disk image...

	I0520 08:15:30.974054    2822 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0520 08:15:30.974215    2822 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/multinode-046000/disk.qcow2.raw /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/multinode-046000/disk.qcow2

	I0520 08:15:30.983260    2822 main.go:141] libmachine: STDOUT: 

	I0520 08:15:30.983274    2822 main.go:141] libmachine: STDERR: 

	I0520 08:15:30.983334    2822 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/multinode-046000/disk.qcow2 +20000M

	I0520 08:15:30.990542    2822 main.go:141] libmachine: STDOUT: Image resized.

	I0520 08:15:30.990564    2822 main.go:141] libmachine: STDERR: 

	I0520 08:15:30.990580    2822 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/multinode-046000/disk.qcow2.raw and /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/multinode-046000/disk.qcow2

	I0520 08:15:30.990586    2822 main.go:141] libmachine: Starting QEMU VM...

	I0520 08:15:30.990625    2822 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/Cellar/qemu/7.2.0/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/multinode-046000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/multinode-046000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/multinode-046000/qemu.pid -device virtio-net-pci,netdev=net0,mac=b6:c9:bf:10:2b:80 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/multinode-046000/disk.qcow2

	I0520 08:15:30.992162    2822 main.go:141] libmachine: STDOUT: 

	I0520 08:15:30.992173    2822 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0520 08:15:30.992190    2822 client.go:171] LocalClient.Create took 338.370333ms

	I0520 08:15:32.994398    2822 start.go:128] duration metric: createHost completed in 2.366380875s

	I0520 08:15:32.994500    2822 start.go:83] releasing machines lock for "multinode-046000", held for 2.36656275s

	W0520 08:15:32.994560    2822 start.go:687] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0520 08:15:33.002170    2822 out.go:177] * Deleting "multinode-046000" in qemu2 ...

	W0520 08:15:33.019240    2822 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0520 08:15:33.019268    2822 start.go:702] Will try again in 5 seconds ...

	I0520 08:15:38.021514    2822 start.go:364] acquiring machines lock for multinode-046000: {Name:mk270c257f49033ffda3b70fea9b877c78314aa8 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0520 08:15:38.022023    2822 start.go:368] acquired machines lock for "multinode-046000" in 410.625µs

	I0520 08:15:38.022139    2822 start.go:93] Provisioning new machine with config: &{Name:multinode-046000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/16506/minikube-v1.30.1-1684174510-16506-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684523789-16533@sha256:ed200ff6d686f303885e8aaf964442d08018856d63a8e23f7acdc068766ea82b Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesCo

nfig:{KubernetesVersion:v1.27.2 ClusterName:multinode-046000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSiz

e:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:} &{Name: IP: Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0520 08:15:38.022466    2822 start.go:125] createHost starting for "" (driver="qemu2")

	I0520 08:15:38.034982    2822 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0520 08:15:38.085095    2822 start.go:159] libmachine.API.Create for "multinode-046000" (driver="qemu2")

	I0520 08:15:38.085140    2822 client.go:168] LocalClient.Create starting

	I0520 08:15:38.085267    2822 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/ca.pem

	I0520 08:15:38.085322    2822 main.go:141] libmachine: Decoding PEM data...

	I0520 08:15:38.085341    2822 main.go:141] libmachine: Parsing certificate...

	I0520 08:15:38.085416    2822 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/cert.pem

	I0520 08:15:38.085447    2822 main.go:141] libmachine: Decoding PEM data...

	I0520 08:15:38.085462    2822 main.go:141] libmachine: Parsing certificate...

	I0520 08:15:38.085976    2822 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/16543-1012/.minikube/cache/iso/arm64/minikube-v1.30.1-1684174510-16506-arm64.iso...

	I0520 08:15:38.209367    2822 main.go:141] libmachine: Creating SSH key...

	I0520 08:15:38.304410    2822 main.go:141] libmachine: Creating Disk image...

	I0520 08:15:38.304417    2822 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0520 08:15:38.304563    2822 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/multinode-046000/disk.qcow2.raw /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/multinode-046000/disk.qcow2

	I0520 08:15:38.313009    2822 main.go:141] libmachine: STDOUT: 

	I0520 08:15:38.313028    2822 main.go:141] libmachine: STDERR: 

	I0520 08:15:38.313077    2822 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/multinode-046000/disk.qcow2 +20000M

	I0520 08:15:38.320191    2822 main.go:141] libmachine: STDOUT: Image resized.

	I0520 08:15:38.320204    2822 main.go:141] libmachine: STDERR: 

	I0520 08:15:38.320214    2822 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/multinode-046000/disk.qcow2.raw and /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/multinode-046000/disk.qcow2

	I0520 08:15:38.320220    2822 main.go:141] libmachine: Starting QEMU VM...

	I0520 08:15:38.320262    2822 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/Cellar/qemu/7.2.0/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/multinode-046000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/multinode-046000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/multinode-046000/qemu.pid -device virtio-net-pci,netdev=net0,mac=ba:e4:f2:61:ab:dc -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/multinode-046000/disk.qcow2

	I0520 08:15:38.321738    2822 main.go:141] libmachine: STDOUT: 

	I0520 08:15:38.321757    2822 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0520 08:15:38.321768    2822 client.go:171] LocalClient.Create took 236.6195ms

	I0520 08:15:40.323923    2822 start.go:128] duration metric: createHost completed in 2.301431s

	I0520 08:15:40.324009    2822 start.go:83] releasing machines lock for "multinode-046000", held for 2.301940625s

	W0520 08:15:40.324562    2822 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p multinode-046000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p multinode-046000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0520 08:15:40.333287    2822 out.go:177] 

	W0520 08:15:40.338432    2822 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0520 08:15:40.338473    2822 out.go:239] * 

	* 

	W0520 08:15:40.341102    2822 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0520 08:15:40.349187    2822 out.go:177] 

** /stderr **

multinode_test.go:87: failed to start cluster. args "out/minikube-darwin-arm64 start -p multinode-046000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=qemu2 " : exit status 80

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-046000 -n multinode-046000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-046000 -n multinode-046000: exit status 7 (64.590708ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-046000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/FreshStart2Nodes (9.91s)

=== RUN   TestMultiNode/serial/DeployApp2Nodes

multinode_test.go:481: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-046000 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml

multinode_test.go:481: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-046000 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml: exit status 1 (122.444084ms)

** stderr ** 

	error: cluster "multinode-046000" does not exist

** /stderr **

multinode_test.go:483: failed to create busybox deployment to multinode cluster

multinode_test.go:486: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-046000 -- rollout status deployment/busybox

multinode_test.go:486: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-046000 -- rollout status deployment/busybox: exit status 1 (55.835208ms)

** stderr ** 

	error: no server found for cluster "multinode-046000"

** /stderr **

multinode_test.go:488: failed to deploy busybox to multinode cluster

multinode_test.go:493: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-046000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-046000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (55.122583ms)

** stderr ** 

	error: no server found for cluster "multinode-046000"

** /stderr **

multinode_test.go:496: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:493: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-046000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-046000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (104.104542ms)

** stderr ** 

	error: no server found for cluster "multinode-046000"

** /stderr **

multinode_test.go:496: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:493: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-046000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-046000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (101.447917ms)

** stderr ** 

	error: no server found for cluster "multinode-046000"

** /stderr **

multinode_test.go:496: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:493: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-046000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-046000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (101.361458ms)

** stderr ** 

	error: no server found for cluster "multinode-046000"

** /stderr **

multinode_test.go:496: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:493: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-046000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-046000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (102.968709ms)

** stderr ** 

	error: no server found for cluster "multinode-046000"

** /stderr **

multinode_test.go:496: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:493: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-046000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-046000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (102.838958ms)

** stderr ** 

	error: no server found for cluster "multinode-046000"

** /stderr **

multinode_test.go:496: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:493: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-046000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-046000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (101.997791ms)

** stderr ** 

	error: no server found for cluster "multinode-046000"

** /stderr **

multinode_test.go:496: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:493: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-046000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-046000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (101.461041ms)

** stderr ** 

	error: no server found for cluster "multinode-046000"

** /stderr **

multinode_test.go:496: failed to retrieve Pod IPs (may be temporary): exit status 1

E0520 08:16:23.609887    1437 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/functional-537000/client.crt: no such file or directory

multinode_test.go:493: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-046000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-046000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (102.057625ms)

** stderr ** 

	error: no server found for cluster "multinode-046000"

** /stderr **

multinode_test.go:496: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:493: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-046000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-046000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (101.79325ms)

** stderr ** 

	error: no server found for cluster "multinode-046000"

** /stderr **

multinode_test.go:496: failed to retrieve Pod IPs (may be temporary): exit status 1

E0520 08:16:57.625401    1437 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/client.crt: no such file or directory

E0520 08:16:57.631789    1437 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/client.crt: no such file or directory

E0520 08:16:57.643861    1437 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/client.crt: no such file or directory

E0520 08:16:57.666073    1437 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/client.crt: no such file or directory

E0520 08:16:57.708188    1437 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/client.crt: no such file or directory

E0520 08:16:57.790325    1437 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/client.crt: no such file or directory

E0520 08:16:57.952441    1437 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/client.crt: no such file or directory

E0520 08:16:58.273580    1437 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/client.crt: no such file or directory

E0520 08:16:58.914495    1437 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/client.crt: no such file or directory

E0520 08:17:00.196889    1437 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/client.crt: no such file or directory

E0520 08:17:02.759267    1437 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/client.crt: no such file or directory

E0520 08:17:07.881557    1437 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/client.crt: no such file or directory

E0520 08:17:18.123932    1437 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/client.crt: no such file or directory

multinode_test.go:493: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-046000 -- get pods -o jsonpath='{.items[*].status.podIP}'

multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-046000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (103.840375ms)

** stderr ** 

	error: no server found for cluster "multinode-046000"

** /stderr **

multinode_test.go:496: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:512: failed to resolve pod IPs: failed to retrieve Pod IPs (may be temporary): exit status 1

multinode_test.go:516: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-046000 -- get pods -o jsonpath='{.items[*].metadata.name}'

multinode_test.go:516: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-046000 -- get pods -o jsonpath='{.items[*].metadata.name}': exit status 1 (54.062292ms)

** stderr ** 

	error: no server found for cluster "multinode-046000"

** /stderr **

multinode_test.go:518: failed get Pod names

multinode_test.go:524: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-046000 -- exec  -- nslookup kubernetes.io

multinode_test.go:524: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-046000 -- exec  -- nslookup kubernetes.io: exit status 1 (53.599167ms)

** stderr ** 

	error: no server found for cluster "multinode-046000"

** /stderr **

multinode_test.go:526: Pod  could not resolve 'kubernetes.io': exit status 1

multinode_test.go:534: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-046000 -- exec  -- nslookup kubernetes.default

multinode_test.go:534: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-046000 -- exec  -- nslookup kubernetes.default: exit status 1 (54.299875ms)

** stderr ** 

	error: no server found for cluster "multinode-046000"

** /stderr **

multinode_test.go:536: Pod  could not resolve 'kubernetes.default': exit status 1

multinode_test.go:542: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-046000 -- exec  -- nslookup kubernetes.default.svc.cluster.local

multinode_test.go:542: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-046000 -- exec  -- nslookup kubernetes.default.svc.cluster.local: exit status 1 (52.77575ms)

** stderr ** 

	error: no server found for cluster "multinode-046000"

** /stderr **

multinode_test.go:544: Pod  could not resolve local service (kubernetes.default.svc.cluster.local): exit status 1

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-046000 -n multinode-046000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-046000 -n multinode-046000: exit status 7 (30.020209ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-046000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/DeployApp2Nodes (101.42s)

=== RUN   TestMultiNode/serial/PingHostFrom2Pods

multinode_test.go:552: (dbg) Run:  out/minikube-darwin-arm64 kubectl -p multinode-046000 -- get pods -o jsonpath='{.items[*].metadata.name}'

multinode_test.go:552: (dbg) Non-zero exit: out/minikube-darwin-arm64 kubectl -p multinode-046000 -- get pods -o jsonpath='{.items[*].metadata.name}': exit status 1 (54.05025ms)

** stderr ** 

	error: no server found for cluster "multinode-046000"

** /stderr **

multinode_test.go:554: failed to get Pod names: exit status 1

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-046000 -n multinode-046000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-046000 -n multinode-046000: exit status 7 (29.181333ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-046000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/PingHostFrom2Pods (0.08s)

=== RUN   TestMultiNode/serial/AddNode

multinode_test.go:110: (dbg) Run:  out/minikube-darwin-arm64 node add -p multinode-046000 -v 3 --alsologtostderr

multinode_test.go:110: (dbg) Non-zero exit: out/minikube-darwin-arm64 node add -p multinode-046000 -v 3 --alsologtostderr: exit status 89 (39.84475ms)

-- stdout --

	* The control plane node must be running for this command

	  To start a cluster, run: "minikube start -p multinode-046000"

-- /stdout --

** stderr ** 

	I0520 08:17:21.962195    2920 out.go:296] Setting OutFile to fd 1 ...

	I0520 08:17:21.962394    2920 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0520 08:17:21.962397    2920 out.go:309] Setting ErrFile to fd 2...

	I0520 08:17:21.962399    2920 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0520 08:17:21.962462    2920 root.go:336] Updating PATH: /Users/jenkins/minikube-integration/16543-1012/.minikube/bin

	I0520 08:17:21.962687    2920 mustload.go:65] Loading cluster: multinode-046000

	I0520 08:17:21.962848    2920 config.go:182] Loaded profile config "multinode-046000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.27.2

	I0520 08:17:21.967830    2920 out.go:177] * The control plane node must be running for this command

	I0520 08:17:21.971245    2920 out.go:177]   To start a cluster, run: "minikube start -p multinode-046000"

** /stderr **

multinode_test.go:112: failed to add node to current cluster. args "out/minikube-darwin-arm64 node add -p multinode-046000 -v 3 --alsologtostderr" : exit status 89

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-046000 -n multinode-046000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-046000 -n multinode-046000: exit status 7 (28.83775ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-046000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/AddNode (0.07s)

=== RUN   TestMultiNode/serial/ProfileList

multinode_test.go:132: (dbg) Run:  out/minikube-darwin-arm64 profile list --output json

multinode_test.go:155: expected profile "multinode-046000" in json of 'profile list' include 3 nodes but have 1 nodes. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"multinode-046000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"multinode-046000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/16506/minikube-v1.30.1-1684174510-16506-arm64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684523789-16533@sha256:ed200ff6d686f303885e8aaf964442d08018856d63a8e23f7acdc068766ea82b\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"VMDriver\":\"\",\"Driver\":\"qemu2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidd

en\":false,\"KVMNUMACount\":1,\"APIServerPort\":0,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.27.2\",\"ClusterName\":\"multinode-046000\",\"Namespace\":\"default\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\",\"NodeIP\":\"\",\"NodePort\":8443,\"NodeName\":\"\"},\"Nodes\":[{\"Name\":\"\

",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.27.2\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"socket_vmnet\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"/opt/socket_vmnet/bin/socket_vmnet_client\",\"SocketVMnetPat

h\":\"/var/run/socket_vmnet\",\"StaticIP\":\"\"},\"Active\":false}]}"*. args: "out/minikube-darwin-arm64 profile list --output json"

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-046000 -n multinode-046000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-046000 -n multinode-046000: exit status 7 (29.550833ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-046000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/ProfileList (0.11s)

=== RUN   TestMultiNode/serial/CopyFile

multinode_test.go:173: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-046000 status --output json --alsologtostderr

multinode_test.go:173: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-046000 status --output json --alsologtostderr: exit status 7 (28.883875ms)

-- stdout --

	{"Name":"multinode-046000","Host":"Stopped","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Stopped","Worker":false}

-- /stdout --

** stderr ** 

	I0520 08:17:22.144428    2930 out.go:296] Setting OutFile to fd 1 ...

	I0520 08:17:22.144573    2930 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0520 08:17:22.144576    2930 out.go:309] Setting ErrFile to fd 2...

	I0520 08:17:22.144578    2930 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0520 08:17:22.144643    2930 root.go:336] Updating PATH: /Users/jenkins/minikube-integration/16543-1012/.minikube/bin

	I0520 08:17:22.144757    2930 out.go:303] Setting JSON to true

	I0520 08:17:22.144776    2930 mustload.go:65] Loading cluster: multinode-046000

	I0520 08:17:22.144831    2930 notify.go:220] Checking for updates...

	I0520 08:17:22.144967    2930 config.go:182] Loaded profile config "multinode-046000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.27.2

	I0520 08:17:22.144973    2930 status.go:255] checking status of multinode-046000 ...

	I0520 08:17:22.145160    2930 status.go:330] multinode-046000 host status = "Stopped" (err=<nil>)

	I0520 08:17:22.145164    2930 status.go:343] host is not running, skipping remaining checks

	I0520 08:17:22.145168    2930 status.go:257] multinode-046000 status: &{Name:multinode-046000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

multinode_test.go:180: failed to decode json from status: args "out/minikube-darwin-arm64 -p multinode-046000 status --output json --alsologtostderr": json: cannot unmarshal object into Go value of type []cmd.Status

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-046000 -n multinode-046000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-046000 -n multinode-046000: exit status 7 (28.648458ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-046000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/CopyFile (0.06s)

=== RUN   TestMultiNode/serial/StopNode

multinode_test.go:210: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-046000 node stop m03

multinode_test.go:210: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-046000 node stop m03: exit status 85 (45.789125ms)

-- stdout --

-- /stdout --

** stderr ** 

	X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                         │

	│    * If the above advice does not help, please let us know:                                                             │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

	│                                                                                                                         │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

	│    * Please also attach the following file to the GitHub issue:                                                         │

	│    * - /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube_node_295f67d8757edd996fe5c1e7ccde72c355ccf4dc_0.log    │

	│                                                                                                                         │

	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

multinode_test.go:212: node stop returned an error. args "out/minikube-darwin-arm64 -p multinode-046000 node stop m03": exit status 85

multinode_test.go:216: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-046000 status

multinode_test.go:216: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-046000 status: exit status 7 (28.664417ms)

-- stdout --

	multinode-046000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

multinode_test.go:223: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-046000 status --alsologtostderr

multinode_test.go:223: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-046000 status --alsologtostderr: exit status 7 (28.735666ms)

-- stdout --

	multinode-046000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I0520 08:17:22.277108    2938 out.go:296] Setting OutFile to fd 1 ...

	I0520 08:17:22.277248    2938 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0520 08:17:22.277251    2938 out.go:309] Setting ErrFile to fd 2...

	I0520 08:17:22.277253    2938 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0520 08:17:22.277319    2938 root.go:336] Updating PATH: /Users/jenkins/minikube-integration/16543-1012/.minikube/bin

	I0520 08:17:22.277428    2938 out.go:303] Setting JSON to false

	I0520 08:17:22.277440    2938 mustload.go:65] Loading cluster: multinode-046000

	I0520 08:17:22.277500    2938 notify.go:220] Checking for updates...

	I0520 08:17:22.277628    2938 config.go:182] Loaded profile config "multinode-046000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.27.2

	I0520 08:17:22.277634    2938 status.go:255] checking status of multinode-046000 ...

	I0520 08:17:22.277810    2938 status.go:330] multinode-046000 host status = "Stopped" (err=<nil>)

	I0520 08:17:22.277813    2938 status.go:343] host is not running, skipping remaining checks

	I0520 08:17:22.277815    2938 status.go:257] multinode-046000 status: &{Name:multinode-046000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

multinode_test.go:229: incorrect number of running kubelets: args "out/minikube-darwin-arm64 -p multinode-046000 status --alsologtostderr": multinode-046000

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-046000 -n multinode-046000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-046000 -n multinode-046000: exit status 7 (28.453208ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-046000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/StopNode (0.13s)

=== RUN   TestMultiNode/serial/StartAfterStop

multinode_test.go:254: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-046000 node start m03 --alsologtostderr

multinode_test.go:254: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-046000 node start m03 --alsologtostderr: exit status 85 (46.571417ms)

-- stdout --

-- /stdout --

** stderr ** 

	I0520 08:17:22.334977    2942 out.go:296] Setting OutFile to fd 1 ...

	I0520 08:17:22.335207    2942 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0520 08:17:22.335209    2942 out.go:309] Setting ErrFile to fd 2...

	I0520 08:17:22.335212    2942 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0520 08:17:22.335294    2942 root.go:336] Updating PATH: /Users/jenkins/minikube-integration/16543-1012/.minikube/bin

	I0520 08:17:22.335524    2942 mustload.go:65] Loading cluster: multinode-046000

	I0520 08:17:22.335700    2942 config.go:182] Loaded profile config "multinode-046000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.27.2

	I0520 08:17:22.340377    2942 out.go:177] 

	W0520 08:17:22.344360    2942 out.go:239] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03

	X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03

	W0520 08:17:22.344365    2942 out.go:239] * 

	* 

	W0520 08:17:22.346011    2942 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                         │

	│    * If the above advice does not help, please let us know:                                                             │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

	│                                                                                                                         │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

	│    * Please also attach the following file to the GitHub issue:                                                         │

	│    * - /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │

	│                                                                                                                         │

	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                         │

	│    * If the above advice does not help, please let us know:                                                             │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

	│                                                                                                                         │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

	│    * Please also attach the following file to the GitHub issue:                                                         │

	│    * - /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │

	│                                                                                                                         │

	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	I0520 08:17:22.349270    2942 out.go:177] 

** /stderr **

multinode_test.go:256: I0520 08:17:22.334977    2942 out.go:296] Setting OutFile to fd 1 ...

I0520 08:17:22.335207    2942 out.go:343] TERM=,COLORTERM=, which probably does not support color

I0520 08:17:22.335209    2942 out.go:309] Setting ErrFile to fd 2...

I0520 08:17:22.335212    2942 out.go:343] TERM=,COLORTERM=, which probably does not support color

I0520 08:17:22.335294    2942 root.go:336] Updating PATH: /Users/jenkins/minikube-integration/16543-1012/.minikube/bin

I0520 08:17:22.335524    2942 mustload.go:65] Loading cluster: multinode-046000

I0520 08:17:22.335700    2942 config.go:182] Loaded profile config "multinode-046000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.27.2

I0520 08:17:22.340377    2942 out.go:177] 

W0520 08:17:22.344360    2942 out.go:239] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03

X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03

W0520 08:17:22.344365    2942 out.go:239] * 

* 

W0520 08:17:22.346011    2942 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

│                                                                                                                         │

│    * If the above advice does not help, please let us know:                                                             │

│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

│                                                                                                                         │

│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

│    * Please also attach the following file to the GitHub issue:                                                         │

│    * - /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │

│                                                                                                                         │

╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

│                                                                                                                         │

│    * If the above advice does not help, please let us know:                                                             │

│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │

│                                                                                                                         │

│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │

│    * Please also attach the following file to the GitHub issue:                                                         │

│    * - /var/folders/2k/p0kjt1w95hl7b54xjlcc45ph0000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │

│                                                                                                                         │

╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

I0520 08:17:22.349270    2942 out.go:177] 

multinode_test.go:257: node start returned an error. args "out/minikube-darwin-arm64 -p multinode-046000 node start m03 --alsologtostderr": exit status 85

multinode_test.go:261: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-046000 status

multinode_test.go:261: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-046000 status: exit status 7 (29.039166ms)

-- stdout --

	multinode-046000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

multinode_test.go:263: failed to run minikube status. args "out/minikube-darwin-arm64 -p multinode-046000 status" : exit status 7

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-046000 -n multinode-046000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-046000 -n multinode-046000: exit status 7 (28.391167ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-046000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/StartAfterStop (0.10s)

=== RUN   TestMultiNode/serial/RestartKeepsNodes

multinode_test.go:283: (dbg) Run:  out/minikube-darwin-arm64 node list -p multinode-046000

multinode_test.go:290: (dbg) Run:  out/minikube-darwin-arm64 stop -p multinode-046000

multinode_test.go:295: (dbg) Run:  out/minikube-darwin-arm64 start -p multinode-046000 --wait=true -v=8 --alsologtostderr

multinode_test.go:295: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p multinode-046000 --wait=true -v=8 --alsologtostderr: exit status 80 (5.178313125s)

-- stdout --

	* [multinode-046000] minikube v1.30.1 on Darwin 13.3.1 (arm64)

	  - MINIKUBE_LOCATION=16543

	  - KUBECONFIG=/Users/jenkins/minikube-integration/16543-1012/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/16543-1012/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on existing profile

	* Starting control plane node multinode-046000 in cluster multinode-046000

	* Restarting existing qemu2 VM for "multinode-046000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Restarting existing qemu2 VM for "multinode-046000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0520 08:17:22.525432    2952 out.go:296] Setting OutFile to fd 1 ...

	I0520 08:17:22.525531    2952 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0520 08:17:22.525535    2952 out.go:309] Setting ErrFile to fd 2...

	I0520 08:17:22.525538    2952 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0520 08:17:22.525615    2952 root.go:336] Updating PATH: /Users/jenkins/minikube-integration/16543-1012/.minikube/bin

	I0520 08:17:22.526546    2952 out.go:303] Setting JSON to false

	I0520 08:17:22.541527    2952 start.go:125] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":1013,"bootTime":1684594829,"procs":447,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"13.3.1","kernelVersion":"22.4.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}

	W0520 08:17:22.541594    2952 start.go:133] gopshost.Virtualization returned error: not implemented yet

	I0520 08:17:22.546359    2952 out.go:177] * [multinode-046000] minikube v1.30.1 on Darwin 13.3.1 (arm64)

	I0520 08:17:22.553368    2952 out.go:177]   - MINIKUBE_LOCATION=16543

	I0520 08:17:22.553393    2952 notify.go:220] Checking for updates...

	I0520 08:17:22.561155    2952 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/16543-1012/kubeconfig

	I0520 08:17:22.564275    2952 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0520 08:17:22.568349    2952 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0520 08:17:22.569782    2952 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/16543-1012/.minikube

	I0520 08:17:22.573311    2952 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0520 08:17:22.576547    2952 config.go:182] Loaded profile config "multinode-046000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.27.2

	I0520 08:17:22.576570    2952 driver.go:375] Setting default libvirt URI to qemu:///system

	I0520 08:17:22.581079    2952 out.go:177] * Using the qemu2 driver based on existing profile

	I0520 08:17:22.588325    2952 start.go:295] selected driver: qemu2

	I0520 08:17:22.588333    2952 start.go:870] validating driver "qemu2" against &{Name:multinode-046000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/16506/minikube-v1.30.1-1684174510-16506-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684523789-16533@sha256:ed200ff6d686f303885e8aaf964442d08018856d63a8e23f7acdc068766ea82b Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi

g:{KubernetesVersion:v1.27.2 ClusterName:multinode-046000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:2

62144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}

	I0520 08:17:22.588398    2952 start.go:881] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0520 08:17:22.590316    2952 start_flags.go:915] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0520 08:17:22.590336    2952 cni.go:84] Creating CNI manager for ""

	I0520 08:17:22.590340    2952 cni.go:136] 1 nodes found, recommending kindnet

	I0520 08:17:22.590346    2952 start_flags.go:319] config:

	{Name:multinode-046000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/16506/minikube-v1.30.1-1684174510-16506-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684523789-16533@sha256:ed200ff6d686f303885e8aaf964442d08018856d63a8e23f7acdc068766ea82b Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.2 ClusterName:multinode-046000 Namespace:default API

ServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Di

sableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}

	I0520 08:17:22.590406    2952 iso.go:125] acquiring lock: {Name:mkf05a14b47e9b67445252fbb4917f3bcb37f054 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0520 08:17:22.598272    2952 out.go:177] * Starting control plane node multinode-046000 in cluster multinode-046000

	I0520 08:17:22.602295    2952 preload.go:132] Checking if preload exists for k8s version v1.27.2 and runtime docker

	I0520 08:17:22.602320    2952 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.2-docker-overlay2-arm64.tar.lz4

	I0520 08:17:22.602334    2952 cache.go:57] Caching tarball of preloaded images

	I0520 08:17:22.602385    2952 preload.go:174] Found /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0520 08:17:22.602390    2952 cache.go:60] Finished verifying existence of preloaded tar for  v1.27.2 on docker

	I0520 08:17:22.602448    2952 profile.go:148] Saving config to /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/multinode-046000/config.json ...

	I0520 08:17:22.602788    2952 cache.go:195] Successfully downloaded all kic artifacts

	I0520 08:17:22.602797    2952 start.go:364] acquiring machines lock for multinode-046000: {Name:mk270c257f49033ffda3b70fea9b877c78314aa8 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0520 08:17:22.602826    2952 start.go:368] acquired machines lock for "multinode-046000" in 23.875µs

	I0520 08:17:22.602837    2952 start.go:96] Skipping create...Using existing machine configuration

	I0520 08:17:22.602841    2952 fix.go:55] fixHost starting: 

	I0520 08:17:22.602961    2952 fix.go:103] recreateIfNeeded on multinode-046000: state=Stopped err=<nil>

	W0520 08:17:22.602970    2952 fix.go:129] unexpected machine state, will restart: <nil>

	I0520 08:17:22.610286    2952 out.go:177] * Restarting existing qemu2 VM for "multinode-046000" ...

	I0520 08:17:22.614245    2952 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/Cellar/qemu/7.2.0/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/multinode-046000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/multinode-046000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/multinode-046000/qemu.pid -device virtio-net-pci,netdev=net0,mac=ba:e4:f2:61:ab:dc -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/multinode-046000/disk.qcow2

	I0520 08:17:22.616087    2952 main.go:141] libmachine: STDOUT: 

	I0520 08:17:22.616107    2952 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0520 08:17:22.616138    2952 fix.go:57] fixHost completed within 13.296791ms

	I0520 08:17:22.616143    2952 start.go:83] releasing machines lock for "multinode-046000", held for 13.3125ms

	W0520 08:17:22.616150    2952 start.go:687] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0520 08:17:22.616203    2952 out.go:239] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0520 08:17:22.616208    2952 start.go:702] Will try again in 5 seconds ...

	I0520 08:17:27.618341    2952 start.go:364] acquiring machines lock for multinode-046000: {Name:mk270c257f49033ffda3b70fea9b877c78314aa8 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0520 08:17:27.618748    2952 start.go:368] acquired machines lock for "multinode-046000" in 281.125µs

	I0520 08:17:27.618909    2952 start.go:96] Skipping create...Using existing machine configuration

	I0520 08:17:27.618933    2952 fix.go:55] fixHost starting: 

	I0520 08:17:27.619666    2952 fix.go:103] recreateIfNeeded on multinode-046000: state=Stopped err=<nil>

	W0520 08:17:27.619696    2952 fix.go:129] unexpected machine state, will restart: <nil>

	I0520 08:17:27.628167    2952 out.go:177] * Restarting existing qemu2 VM for "multinode-046000" ...

	I0520 08:17:27.631442    2952 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/Cellar/qemu/7.2.0/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/multinode-046000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/multinode-046000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/multinode-046000/qemu.pid -device virtio-net-pci,netdev=net0,mac=ba:e4:f2:61:ab:dc -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/multinode-046000/disk.qcow2

	I0520 08:17:27.640314    2952 main.go:141] libmachine: STDOUT: 

	I0520 08:17:27.640369    2952 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0520 08:17:27.640453    2952 fix.go:57] fixHost completed within 21.524209ms

	I0520 08:17:27.640478    2952 start.go:83] releasing machines lock for "multinode-046000", held for 21.68875ms

	W0520 08:17:27.640788    2952 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p multinode-046000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p multinode-046000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0520 08:17:27.649295    2952 out.go:177] 

	W0520 08:17:27.653435    2952 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0520 08:17:27.653458    2952 out.go:239] * 

	* 

	W0520 08:17:27.655908    2952 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0520 08:17:27.664065    2952 out.go:177] 

** /stderr **

multinode_test.go:297: failed to run minikube start. args "out/minikube-darwin-arm64 node list -p multinode-046000" : exit status 80

multinode_test.go:300: (dbg) Run:  out/minikube-darwin-arm64 node list -p multinode-046000

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-046000 -n multinode-046000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-046000 -n multinode-046000: exit status 7 (33.273333ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-046000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/RestartKeepsNodes (5.37s)

=== RUN   TestMultiNode/serial/DeleteNode

multinode_test.go:394: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-046000 node delete m03

multinode_test.go:394: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-046000 node delete m03: exit status 89 (38.947917ms)

-- stdout --

	* The control plane node must be running for this command

	  To start a cluster, run: "minikube start -p multinode-046000"

-- /stdout --

multinode_test.go:396: node stop returned an error. args "out/minikube-darwin-arm64 -p multinode-046000 node delete m03": exit status 89

multinode_test.go:400: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-046000 status --alsologtostderr

multinode_test.go:400: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-046000 status --alsologtostderr: exit status 7 (28.516834ms)

-- stdout --

	multinode-046000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I0520 08:17:27.845401    2965 out.go:296] Setting OutFile to fd 1 ...

	I0520 08:17:27.845528    2965 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0520 08:17:27.845531    2965 out.go:309] Setting ErrFile to fd 2...

	I0520 08:17:27.845534    2965 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0520 08:17:27.845609    2965 root.go:336] Updating PATH: /Users/jenkins/minikube-integration/16543-1012/.minikube/bin

	I0520 08:17:27.845719    2965 out.go:303] Setting JSON to false

	I0520 08:17:27.845731    2965 mustload.go:65] Loading cluster: multinode-046000

	I0520 08:17:27.845783    2965 notify.go:220] Checking for updates...

	I0520 08:17:27.845907    2965 config.go:182] Loaded profile config "multinode-046000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.27.2

	I0520 08:17:27.845912    2965 status.go:255] checking status of multinode-046000 ...

	I0520 08:17:27.846085    2965 status.go:330] multinode-046000 host status = "Stopped" (err=<nil>)

	I0520 08:17:27.846089    2965 status.go:343] host is not running, skipping remaining checks

	I0520 08:17:27.846092    2965 status.go:257] multinode-046000 status: &{Name:multinode-046000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

multinode_test.go:402: failed to run minikube status. args "out/minikube-darwin-arm64 -p multinode-046000 status --alsologtostderr" : exit status 7

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-046000 -n multinode-046000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-046000 -n multinode-046000: exit status 7 (28.264792ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-046000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/DeleteNode (0.10s)

=== RUN   TestMultiNode/serial/StopMultiNode

multinode_test.go:314: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-046000 stop

multinode_test.go:320: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-046000 status

multinode_test.go:320: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-046000 status: exit status 7 (29.507125ms)

-- stdout --

	multinode-046000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

multinode_test.go:327: (dbg) Run:  out/minikube-darwin-arm64 -p multinode-046000 status --alsologtostderr

multinode_test.go:327: (dbg) Non-zero exit: out/minikube-darwin-arm64 -p multinode-046000 status --alsologtostderr: exit status 7 (28.58675ms)

-- stdout --

	multinode-046000

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

-- /stdout --

** stderr ** 

	I0520 08:17:27.992091    2973 out.go:296] Setting OutFile to fd 1 ...

	I0520 08:17:27.992222    2973 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0520 08:17:27.992225    2973 out.go:309] Setting ErrFile to fd 2...

	I0520 08:17:27.992228    2973 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0520 08:17:27.992299    2973 root.go:336] Updating PATH: /Users/jenkins/minikube-integration/16543-1012/.minikube/bin

	I0520 08:17:27.992405    2973 out.go:303] Setting JSON to false

	I0520 08:17:27.992416    2973 mustload.go:65] Loading cluster: multinode-046000

	I0520 08:17:27.992470    2973 notify.go:220] Checking for updates...

	I0520 08:17:27.992594    2973 config.go:182] Loaded profile config "multinode-046000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.27.2

	I0520 08:17:27.992601    2973 status.go:255] checking status of multinode-046000 ...

	I0520 08:17:27.992773    2973 status.go:330] multinode-046000 host status = "Stopped" (err=<nil>)

	I0520 08:17:27.992777    2973 status.go:343] host is not running, skipping remaining checks

	I0520 08:17:27.992779    2973 status.go:257] multinode-046000 status: &{Name:multinode-046000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

multinode_test.go:333: incorrect number of stopped hosts: args "out/minikube-darwin-arm64 -p multinode-046000 status --alsologtostderr": multinode-046000

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

multinode_test.go:337: incorrect number of stopped kubelets: args "out/minikube-darwin-arm64 -p multinode-046000 status --alsologtostderr": multinode-046000

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-046000 -n multinode-046000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-046000 -n multinode-046000: exit status 7 (28.540917ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-046000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/StopMultiNode (0.15s)

=== RUN   TestMultiNode/serial/RestartMultiNode

multinode_test.go:354: (dbg) Run:  out/minikube-darwin-arm64 start -p multinode-046000 --wait=true -v=8 --alsologtostderr --driver=qemu2 

multinode_test.go:354: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p multinode-046000 --wait=true -v=8 --alsologtostderr --driver=qemu2 : exit status 80 (5.183346709s)

-- stdout --

	* [multinode-046000] minikube v1.30.1 on Darwin 13.3.1 (arm64)

	  - MINIKUBE_LOCATION=16543

	  - KUBECONFIG=/Users/jenkins/minikube-integration/16543-1012/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/16543-1012/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on existing profile

	* Starting control plane node multinode-046000 in cluster multinode-046000

	* Restarting existing qemu2 VM for "multinode-046000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Restarting existing qemu2 VM for "multinode-046000" ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0520 08:17:28.048688    2977 out.go:296] Setting OutFile to fd 1 ...

	I0520 08:17:28.048786    2977 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0520 08:17:28.048790    2977 out.go:309] Setting ErrFile to fd 2...

	I0520 08:17:28.048793    2977 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0520 08:17:28.049126    2977 root.go:336] Updating PATH: /Users/jenkins/minikube-integration/16543-1012/.minikube/bin

	I0520 08:17:28.050446    2977 out.go:303] Setting JSON to false

	I0520 08:17:28.065765    2977 start.go:125] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":1019,"bootTime":1684594829,"procs":447,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"13.3.1","kernelVersion":"22.4.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}

	W0520 08:17:28.065825    2977 start.go:133] gopshost.Virtualization returned error: not implemented yet

	I0520 08:17:28.070546    2977 out.go:177] * [multinode-046000] minikube v1.30.1 on Darwin 13.3.1 (arm64)

	I0520 08:17:28.077496    2977 notify.go:220] Checking for updates...

	I0520 08:17:28.081498    2977 out.go:177]   - MINIKUBE_LOCATION=16543

	I0520 08:17:28.085491    2977 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/16543-1012/kubeconfig

	I0520 08:17:28.089482    2977 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0520 08:17:28.093526    2977 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0520 08:17:28.094874    2977 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/16543-1012/.minikube

	I0520 08:17:28.097524    2977 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0520 08:17:28.100836    2977 config.go:182] Loaded profile config "multinode-046000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.27.2

	I0520 08:17:28.101071    2977 driver.go:375] Setting default libvirt URI to qemu:///system

	I0520 08:17:28.105395    2977 out.go:177] * Using the qemu2 driver based on existing profile

	I0520 08:17:28.112501    2977 start.go:295] selected driver: qemu2

	I0520 08:17:28.112509    2977 start.go:870] validating driver "qemu2" against &{Name:multinode-046000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/16506/minikube-v1.30.1-1684174510-16506-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684523789-16533@sha256:ed200ff6d686f303885e8aaf964442d08018856d63a8e23f7acdc068766ea82b Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi

g:{KubernetesVersion:v1.27.2 ClusterName:multinode-046000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:2

62144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}

	I0520 08:17:28.112569    2977 start.go:881] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0520 08:17:28.114448    2977 start_flags.go:915] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0520 08:17:28.114470    2977 cni.go:84] Creating CNI manager for ""

	I0520 08:17:28.114474    2977 cni.go:136] 1 nodes found, recommending kindnet

	I0520 08:17:28.114479    2977 start_flags.go:319] config:

	{Name:multinode-046000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/16506/minikube-v1.30.1-1684174510-16506-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684523789-16533@sha256:ed200ff6d686f303885e8aaf964442d08018856d63a8e23f7acdc068766ea82b Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.2 ClusterName:multinode-046000 Namespace:default API

ServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Di

sableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}

	I0520 08:17:28.114553    2977 iso.go:125] acquiring lock: {Name:mkf05a14b47e9b67445252fbb4917f3bcb37f054 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0520 08:17:28.126492    2977 out.go:177] * Starting control plane node multinode-046000 in cluster multinode-046000

	I0520 08:17:28.130570    2977 preload.go:132] Checking if preload exists for k8s version v1.27.2 and runtime docker

	I0520 08:17:28.130593    2977 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.2-docker-overlay2-arm64.tar.lz4

	I0520 08:17:28.130607    2977 cache.go:57] Caching tarball of preloaded images

	I0520 08:17:28.130661    2977 preload.go:174] Found /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0520 08:17:28.130668    2977 cache.go:60] Finished verifying existence of preloaded tar for  v1.27.2 on docker

	I0520 08:17:28.130755    2977 profile.go:148] Saving config to /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/multinode-046000/config.json ...

	I0520 08:17:28.131117    2977 cache.go:195] Successfully downloaded all kic artifacts

	I0520 08:17:28.131127    2977 start.go:364] acquiring machines lock for multinode-046000: {Name:mk270c257f49033ffda3b70fea9b877c78314aa8 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0520 08:17:28.131154    2977 start.go:368] acquired machines lock for "multinode-046000" in 21.416µs

	I0520 08:17:28.131165    2977 start.go:96] Skipping create...Using existing machine configuration

	I0520 08:17:28.131169    2977 fix.go:55] fixHost starting: 

	I0520 08:17:28.131289    2977 fix.go:103] recreateIfNeeded on multinode-046000: state=Stopped err=<nil>

	W0520 08:17:28.131297    2977 fix.go:129] unexpected machine state, will restart: <nil>

	I0520 08:17:28.139484    2977 out.go:177] * Restarting existing qemu2 VM for "multinode-046000" ...

	I0520 08:17:28.143506    2977 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/Cellar/qemu/7.2.0/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/multinode-046000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/multinode-046000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/multinode-046000/qemu.pid -device virtio-net-pci,netdev=net0,mac=ba:e4:f2:61:ab:dc -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/multinode-046000/disk.qcow2

	I0520 08:17:28.145489    2977 main.go:141] libmachine: STDOUT: 

	I0520 08:17:28.145508    2977 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0520 08:17:28.145537    2977 fix.go:57] fixHost completed within 14.366375ms

	I0520 08:17:28.145543    2977 start.go:83] releasing machines lock for "multinode-046000", held for 14.384541ms

	W0520 08:17:28.145551    2977 start.go:687] error starting host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0520 08:17:28.145622    2977 out.go:239] ! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0520 08:17:28.145628    2977 start.go:702] Will try again in 5 seconds ...

	I0520 08:17:33.147766    2977 start.go:364] acquiring machines lock for multinode-046000: {Name:mk270c257f49033ffda3b70fea9b877c78314aa8 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0520 08:17:33.148238    2977 start.go:368] acquired machines lock for "multinode-046000" in 384.75µs

	I0520 08:17:33.148381    2977 start.go:96] Skipping create...Using existing machine configuration

	I0520 08:17:33.148399    2977 fix.go:55] fixHost starting: 

	I0520 08:17:33.149131    2977 fix.go:103] recreateIfNeeded on multinode-046000: state=Stopped err=<nil>

	W0520 08:17:33.149157    2977 fix.go:129] unexpected machine state, will restart: <nil>

	I0520 08:17:33.153487    2977 out.go:177] * Restarting existing qemu2 VM for "multinode-046000" ...

	I0520 08:17:33.160859    2977 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/Cellar/qemu/7.2.0/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/multinode-046000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/multinode-046000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/multinode-046000/qemu.pid -device virtio-net-pci,netdev=net0,mac=ba:e4:f2:61:ab:dc -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/multinode-046000/disk.qcow2

	I0520 08:17:33.170074    2977 main.go:141] libmachine: STDOUT: 

	I0520 08:17:33.170137    2977 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0520 08:17:33.170235    2977 fix.go:57] fixHost completed within 21.836666ms

	I0520 08:17:33.170258    2977 start.go:83] releasing machines lock for "multinode-046000", held for 21.995792ms

	W0520 08:17:33.170592    2977 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p multinode-046000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p multinode-046000" may fix it: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0520 08:17:33.179680    2977 out.go:177] 

	W0520 08:17:33.183711    2977 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0520 08:17:33.183750    2977 out.go:239] * 

	* 

	W0520 08:17:33.186154    2977 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0520 08:17:33.194682    2977 out.go:177] 

** /stderr **

multinode_test.go:356: failed to start cluster. args "out/minikube-darwin-arm64 start -p multinode-046000 --wait=true -v=8 --alsologtostderr --driver=qemu2 " : exit status 80

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-046000 -n multinode-046000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-046000 -n multinode-046000: exit status 7 (70.459083ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-046000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/RestartMultiNode (5.26s)

=== RUN   TestMultiNode/serial/ValidateNameConflict

multinode_test.go:443: (dbg) Run:  out/minikube-darwin-arm64 node list -p multinode-046000

multinode_test.go:452: (dbg) Run:  out/minikube-darwin-arm64 start -p multinode-046000-m01 --driver=qemu2 

E0520 08:17:38.606428    1437 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/ingress-addon-legacy-371000/client.crt: no such file or directory

multinode_test.go:452: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p multinode-046000-m01 --driver=qemu2 : exit status 80 (9.734283625s)

-- stdout --

	* [multinode-046000-m01] minikube v1.30.1 on Darwin 13.3.1 (arm64)

	  - MINIKUBE_LOCATION=16543

	  - KUBECONFIG=/Users/jenkins/minikube-integration/16543-1012/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/16543-1012/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting control plane node multinode-046000-m01 in cluster multinode-046000-m01

	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "multinode-046000-m01" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p multinode-046000-m01" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

multinode_test.go:460: (dbg) Run:  out/minikube-darwin-arm64 start -p multinode-046000-m02 --driver=qemu2 

multinode_test.go:460: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p multinode-046000-m02 --driver=qemu2 : exit status 80 (9.934037542s)

-- stdout --

	* [multinode-046000-m02] minikube v1.30.1 on Darwin 13.3.1 (arm64)

	  - MINIKUBE_LOCATION=16543

	  - KUBECONFIG=/Users/jenkins/minikube-integration/16543-1012/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/16543-1012/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting control plane node multinode-046000-m02 in cluster multinode-046000-m02

	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "multinode-046000-m02" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p multinode-046000-m02" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

multinode_test.go:462: failed to start profile. args "out/minikube-darwin-arm64 start -p multinode-046000-m02 --driver=qemu2 " : exit status 80

multinode_test.go:467: (dbg) Run:  out/minikube-darwin-arm64 node add -p multinode-046000

multinode_test.go:467: (dbg) Non-zero exit: out/minikube-darwin-arm64 node add -p multinode-046000: exit status 89 (80.353916ms)

-- stdout --

	* The control plane node must be running for this command

	  To start a cluster, run: "minikube start -p multinode-046000"

-- /stdout --

multinode_test.go:472: (dbg) Run:  out/minikube-darwin-arm64 delete -p multinode-046000-m02

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-046000 -n multinode-046000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p multinode-046000 -n multinode-046000: exit status 7 (29.462167ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "multinode-046000" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiNode/serial/ValidateNameConflict (19.92s)

=== RUN   TestPreload

preload_test.go:44: (dbg) Run:  out/minikube-darwin-arm64 start -p test-preload-159000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=qemu2  --kubernetes-version=v1.24.4

preload_test.go:44: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p test-preload-159000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=qemu2  --kubernetes-version=v1.24.4: exit status 80 (9.841145542s)

-- stdout --

	* [test-preload-159000] minikube v1.30.1 on Darwin 13.3.1 (arm64)

	  - MINIKUBE_LOCATION=16543

	  - KUBECONFIG=/Users/jenkins/minikube-integration/16543-1012/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/16543-1012/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting control plane node test-preload-159000 in cluster test-preload-159000

	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "test-preload-159000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0520 08:17:53.354053    3031 out.go:296] Setting OutFile to fd 1 ...

	I0520 08:17:53.354184    3031 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0520 08:17:53.354187    3031 out.go:309] Setting ErrFile to fd 2...

	I0520 08:17:53.354190    3031 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0520 08:17:53.354258    3031 root.go:336] Updating PATH: /Users/jenkins/minikube-integration/16543-1012/.minikube/bin

	I0520 08:17:53.355321    3031 out.go:303] Setting JSON to false

	I0520 08:17:53.370504    3031 start.go:125] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":1044,"bootTime":1684594829,"procs":448,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"13.3.1","kernelVersion":"22.4.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}

	W0520 08:17:53.370574    3031 start.go:133] gopshost.Virtualization returned error: not implemented yet

	I0520 08:17:53.375160    3031 out.go:177] * [test-preload-159000] minikube v1.30.1 on Darwin 13.3.1 (arm64)

	I0520 08:17:53.383260    3031 out.go:177]   - MINIKUBE_LOCATION=16543

	I0520 08:17:53.383281    3031 notify.go:220] Checking for updates...

	I0520 08:17:53.394258    3031 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/16543-1012/kubeconfig

	I0520 08:17:53.397322    3031 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0520 08:17:53.400243    3031 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0520 08:17:53.403240    3031 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/16543-1012/.minikube

	I0520 08:17:53.406346    3031 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0520 08:17:53.409452    3031 config.go:182] Loaded profile config "multinode-046000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.27.2

	I0520 08:17:53.409477    3031 driver.go:375] Setting default libvirt URI to qemu:///system

	I0520 08:17:53.413265    3031 out.go:177] * Using the qemu2 driver based on user configuration

	I0520 08:17:53.420162    3031 start.go:295] selected driver: qemu2

	I0520 08:17:53.420167    3031 start.go:870] validating driver "qemu2" against <nil>

	I0520 08:17:53.420173    3031 start.go:881] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0520 08:17:53.422049    3031 start_flags.go:305] no existing cluster config was found, will generate one from the flags 

	I0520 08:17:53.425244    3031 out.go:177] * Automatically selected the socket_vmnet network

	I0520 08:17:53.428346    3031 start_flags.go:915] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0520 08:17:53.428367    3031 cni.go:84] Creating CNI manager for ""

	I0520 08:17:53.428377    3031 cni.go:157] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0520 08:17:53.428398    3031 start_flags.go:314] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0520 08:17:53.428404    3031 start_flags.go:319] config:

	{Name:test-preload-159000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684523789-16533@sha256:ed200ff6d686f303885e8aaf964442d08018856d63a8e23f7acdc068766ea82b Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.4 ClusterName:test-preload-159000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRunti

me:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}

	I0520 08:17:53.428485    3031 iso.go:125] acquiring lock: {Name:mkf05a14b47e9b67445252fbb4917f3bcb37f054 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0520 08:17:53.436185    3031 out.go:177] * Starting control plane node test-preload-159000 in cluster test-preload-159000

	I0520 08:17:53.440217    3031 preload.go:132] Checking if preload exists for k8s version v1.24.4 and runtime docker

	I0520 08:17:53.440303    3031 profile.go:148] Saving config to /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/test-preload-159000/config.json ...

	I0520 08:17:53.440317    3031 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16543-1012/.minikube/profiles/test-preload-159000/config.json: {Name:mkf2cbaac18334a5326eecbe5450994aa47c34c6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0520 08:17:53.440362    3031 cache.go:107] acquiring lock: {Name:mk027ea34a428aeb94a39d4c2ef931f6bfff1a65 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0520 08:17:53.440359    3031 cache.go:107] acquiring lock: {Name:mk16b62ad5d32a020aeda5397f7794760ecffb2d Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0520 08:17:53.440375    3031 cache.go:107] acquiring lock: {Name:mkfd3f4579726342cccf032fd4ac85e31d1e2641 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0520 08:17:53.440360    3031 cache.go:107] acquiring lock: {Name:mk979165501f8d0b460b31346e420b8bb36ea216 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0520 08:17:53.440551    3031 cache.go:195] Successfully downloaded all kic artifacts

	I0520 08:17:53.440549    3031 cache.go:107] acquiring lock: {Name:mk3f3c08cb5ba79e109638f4dc92bd616c126477 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0520 08:17:53.440567    3031 start.go:364] acquiring machines lock for test-preload-159000: {Name:mk270c257f49033ffda3b70fea9b877c78314aa8 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0520 08:17:53.440570    3031 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5

	I0520 08:17:53.440606    3031 cache.go:107] acquiring lock: {Name:mk75229732f1df22c2040fea73cbdea7b3d5891f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0520 08:17:53.440619    3031 cache.go:107] acquiring lock: {Name:mk4ae9c4c22bd2dc58a3a64cb0d121f0b4b0f4dd Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0520 08:17:53.440641    3031 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.24.4

	I0520 08:17:53.440638    3031 start.go:368] acquired machines lock for "test-preload-159000" in 59.542µs

	I0520 08:17:53.440700    3031 image.go:134] retrieving image: registry.k8s.io/pause:3.7

	I0520 08:17:53.440685    3031 cache.go:107] acquiring lock: {Name:mk5fe58ed850d7ab27a9e95360f7c6049bbee3cc Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0520 08:17:53.440748    3031 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.24.4

	I0520 08:17:53.440754    3031 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.24.4

	I0520 08:17:53.440775    3031 image.go:134] retrieving image: registry.k8s.io/etcd:3.5.3-0

	I0520 08:17:53.440811    3031 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.24.4

	I0520 08:17:53.440673    3031 start.go:93] Provisioning new machine with config: &{Name:test-preload-159000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/16506/minikube-v1.30.1-1684174510-16506-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684523789-16533@sha256:ed200ff6d686f303885e8aaf964442d08018856d63a8e23f7acdc068766ea82b Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernete

sConfig:{KubernetesVersion:v1.24.4 ClusterName:test-preload-159000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: Mo

untMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:} &{Name: IP: Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0520 08:17:53.440912    3031 start.go:125] createHost starting for "" (driver="qemu2")

	I0520 08:17:53.440932    3031 image.go:134] retrieving image: registry.k8s.io/coredns/coredns:v1.8.6

	I0520 08:17:53.448180    3031 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0520 08:17:53.461885    3031 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5

	I0520 08:17:53.464371    3031 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.24.4: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.24.4

	I0520 08:17:53.464541    3031 image.go:177] daemon lookup for registry.k8s.io/coredns/coredns:v1.8.6: Error response from daemon: No such image: registry.k8s.io/coredns/coredns:v1.8.6

	I0520 08:17:53.465620    3031 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.24.4: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.24.4

	I0520 08:17:53.466078    3031 image.go:177] daemon lookup for registry.k8s.io/etcd:3.5.3-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.5.3-0

	I0520 08:17:53.466349    3031 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.24.4: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.24.4

	I0520 08:17:53.468530    3031 image.go:177] daemon lookup for registry.k8s.io/pause:3.7: Error response from daemon: No such image: registry.k8s.io/pause:3.7

	I0520 08:17:53.468684    3031 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.24.4: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.24.4

	I0520 08:17:53.469190    3031 start.go:159] libmachine.API.Create for "test-preload-159000" (driver="qemu2")

	I0520 08:17:53.469201    3031 client.go:168] LocalClient.Create starting

	I0520 08:17:53.469261    3031 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/ca.pem

	I0520 08:17:53.469283    3031 main.go:141] libmachine: Decoding PEM data...

	I0520 08:17:53.469294    3031 main.go:141] libmachine: Parsing certificate...

	I0520 08:17:53.469345    3031 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/cert.pem

	I0520 08:17:53.469360    3031 main.go:141] libmachine: Decoding PEM data...

	I0520 08:17:53.469366    3031 main.go:141] libmachine: Parsing certificate...

	I0520 08:17:53.469658    3031 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/16543-1012/.minikube/cache/iso/arm64/minikube-v1.30.1-1684174510-16506-arm64.iso...

	I0520 08:17:53.649844    3031 main.go:141] libmachine: Creating SSH key...

	I0520 08:17:53.829185    3031 main.go:141] libmachine: Creating Disk image...

	I0520 08:17:53.829203    3031 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0520 08:17:53.829412    3031 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/test-preload-159000/disk.qcow2.raw /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/test-preload-159000/disk.qcow2

	I0520 08:17:53.837982    3031 main.go:141] libmachine: STDOUT: 

	I0520 08:17:53.838001    3031 main.go:141] libmachine: STDERR: 

	I0520 08:17:53.838070    3031 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/test-preload-159000/disk.qcow2 +20000M

	I0520 08:17:53.845517    3031 main.go:141] libmachine: STDOUT: Image resized.

	I0520 08:17:53.845527    3031 main.go:141] libmachine: STDERR: 

	I0520 08:17:53.845541    3031 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/test-preload-159000/disk.qcow2.raw and /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/test-preload-159000/disk.qcow2

	I0520 08:17:53.845546    3031 main.go:141] libmachine: Starting QEMU VM...

	I0520 08:17:53.845585    3031 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/Cellar/qemu/7.2.0/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/test-preload-159000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/test-preload-159000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/test-preload-159000/qemu.pid -device virtio-net-pci,netdev=net0,mac=92:c2:bf:e4:94:0c -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/test-preload-159000/disk.qcow2

	I0520 08:17:53.847133    3031 main.go:141] libmachine: STDOUT: 

	I0520 08:17:53.847154    3031 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0520 08:17:53.847172    3031 client.go:171] LocalClient.Create took 377.965417ms

	W0520 08:17:54.710598    3031 image.go:265] image gcr.io/k8s-minikube/storage-provisioner:v5 arch mismatch: want arm64 got amd64. fixing

	I0520 08:17:54.710629    3031 cache.go:162] opening:  /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5

	W0520 08:17:54.953376    3031 image.go:265] image registry.k8s.io/coredns/coredns:v1.8.6 arch mismatch: want arm64 got amd64. fixing

	I0520 08:17:54.953406    3031 cache.go:162] opening:  /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.8.6

	I0520 08:17:54.972635    3031 cache.go:162] opening:  /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.24.4

	I0520 08:17:55.036960    3031 cache.go:162] opening:  /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.24.4

	I0520 08:17:55.199161    3031 cache.go:162] opening:  /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.3-0

	I0520 08:17:55.262884    3031 cache.go:162] opening:  /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.24.4

	I0520 08:17:55.414168    3031 cache.go:162] opening:  /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/images/arm64/registry.k8s.io/pause_3.7

	I0520 08:17:55.504236    3031 cache.go:157] /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 exists

	I0520 08:17:55.504257    3031 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/Users/jenkins/minikube-integration/16543-1012/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5" took 2.063902917s

	I0520 08:17:55.504283    3031 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded

	I0520 08:17:55.544543    3031 cache.go:157] /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/images/arm64/registry.k8s.io/pause_3.7 exists

	I0520 08:17:55.544587    3031 cache.go:96] cache image "registry.k8s.io/pause:3.7" -> "/Users/jenkins/minikube-integration/16543-1012/.minikube/cache/images/arm64/registry.k8s.io/pause_3.7" took 2.104214333s

	I0520 08:17:55.544605    3031 cache.go:80] save to tar file registry.k8s.io/pause:3.7 -> /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/images/arm64/registry.k8s.io/pause_3.7 succeeded

	I0520 08:17:55.637427    3031 cache.go:162] opening:  /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.24.4

	I0520 08:17:55.847372    3031 start.go:128] duration metric: createHost completed in 2.406443833s

	I0520 08:17:55.847410    3031 start.go:83] releasing machines lock for "test-preload-159000", held for 2.406758667s

	W0520 08:17:55.847480    3031 start.go:687] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0520 08:17:55.859695    3031 out.go:177] * Deleting "test-preload-159000" in qemu2 ...

	W0520 08:17:55.880656    3031 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0520 08:17:55.880692    3031 start.go:702] Will try again in 5 seconds ...

	I0520 08:17:56.629226    3031 cache.go:157] /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.24.4 exists

	I0520 08:17:56.629278    3031 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.24.4" -> "/Users/jenkins/minikube-integration/16543-1012/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.24.4" took 3.188782667s

	I0520 08:17:56.629307    3031 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.24.4 -> /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.24.4 succeeded

	I0520 08:17:57.968766    3031 cache.go:157] /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.8.6 exists

	I0520 08:17:57.968816    3031 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.8.6" -> "/Users/jenkins/minikube-integration/16543-1012/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.8.6" took 4.528202209s

	I0520 08:17:57.968843    3031 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.8.6 -> /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.8.6 succeeded

	I0520 08:17:58.653083    3031 cache.go:157] /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.24.4 exists

	I0520 08:17:58.653132    3031 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.24.4" -> "/Users/jenkins/minikube-integration/16543-1012/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.24.4" took 5.212516958s

	I0520 08:17:58.653160    3031 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.24.4 -> /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.24.4 succeeded

	I0520 08:17:58.856733    3031 cache.go:157] /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.24.4 exists

	I0520 08:17:58.856784    3031 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.24.4" -> "/Users/jenkins/minikube-integration/16543-1012/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.24.4" took 5.416436583s

	I0520 08:17:58.856815    3031 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.24.4 -> /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.24.4 succeeded

	I0520 08:17:59.563019    3031 cache.go:157] /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.24.4 exists

	I0520 08:17:59.563059    3031 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.24.4" -> "/Users/jenkins/minikube-integration/16543-1012/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.24.4" took 6.122723166s

	I0520 08:17:59.563120    3031 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.24.4 -> /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.24.4 succeeded

	I0520 08:18:00.880945    3031 start.go:364] acquiring machines lock for test-preload-159000: {Name:mk270c257f49033ffda3b70fea9b877c78314aa8 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0520 08:18:00.881448    3031 start.go:368] acquired machines lock for "test-preload-159000" in 429.917µs

	I0520 08:18:00.881552    3031 start.go:93] Provisioning new machine with config: &{Name:test-preload-159000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/16506/minikube-v1.30.1-1684174510-16506-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684523789-16533@sha256:ed200ff6d686f303885e8aaf964442d08018856d63a8e23f7acdc068766ea82b Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernete

sConfig:{KubernetesVersion:v1.24.4 ClusterName:test-preload-159000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: Mo

untMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:} &{Name: IP: Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0520 08:18:00.881783    3031 start.go:125] createHost starting for "" (driver="qemu2")

	I0520 08:18:00.890598    3031 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0520 08:18:00.937307    3031 start.go:159] libmachine.API.Create for "test-preload-159000" (driver="qemu2")

	I0520 08:18:00.937348    3031 client.go:168] LocalClient.Create starting

	I0520 08:18:00.937477    3031 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/ca.pem

	I0520 08:18:00.937524    3031 main.go:141] libmachine: Decoding PEM data...

	I0520 08:18:00.937551    3031 main.go:141] libmachine: Parsing certificate...

	I0520 08:18:00.937643    3031 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/16543-1012/.minikube/certs/cert.pem

	I0520 08:18:00.937688    3031 main.go:141] libmachine: Decoding PEM data...

	I0520 08:18:00.937704    3031 main.go:141] libmachine: Parsing certificate...

	I0520 08:18:00.938212    3031 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/16543-1012/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/16543-1012/.minikube/cache/iso/arm64/minikube-v1.30.1-1684174510-16506-arm64.iso...

	I0520 08:18:01.076067    3031 main.go:141] libmachine: Creating SSH key...

	I0520 08:18:01.107932    3031 main.go:141] libmachine: Creating Disk image...

	I0520 08:18:01.107938    3031 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0520 08:18:01.108071    3031 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/test-preload-159000/disk.qcow2.raw /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/test-preload-159000/disk.qcow2

	I0520 08:18:01.116590    3031 main.go:141] libmachine: STDOUT: 

	I0520 08:18:01.116604    3031 main.go:141] libmachine: STDERR: 

	I0520 08:18:01.116674    3031 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/test-preload-159000/disk.qcow2 +20000M

	I0520 08:18:01.123868    3031 main.go:141] libmachine: STDOUT: Image resized.

	I0520 08:18:01.123879    3031 main.go:141] libmachine: STDERR: 

	I0520 08:18:01.123894    3031 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/test-preload-159000/disk.qcow2.raw and /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/test-preload-159000/disk.qcow2

	I0520 08:18:01.123900    3031 main.go:141] libmachine: Starting QEMU VM...

	I0520 08:18:01.123954    3031 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/Cellar/qemu/7.2.0/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2200 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/test-preload-159000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/16543-1012/.minikube/machines/test-preload-159000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/test-preload-159000/qemu.pid -device virtio-net-pci,netdev=net0,mac=52:1a:53:b8:95:7b -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/16543-1012/.minikube/machines/test-preload-159000/disk.qcow2

	I0520 08:18:01.125449    3031 main.go:141] libmachine: STDOUT: 

	I0520 08:18:01.125472    3031 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0520 08:18:01.125484    3031 client.go:171] LocalClient.Create took 188.130583ms

	I0520 08:18:03.127537    3031 start.go:128] duration metric: createHost completed in 2.245722292s

	I0520 08:18:03.127585    3031 start.go:83] releasing machines lock for "test-preload-159000", held for 2.24611575s

	W0520 08:18:03.128065    3031 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p test-preload-159000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p test-preload-159000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0520 08:18:03.137427    3031 out.go:177] 

	W0520 08:18:03.142775    3031 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0520 08:18:03.142847    3031 out.go:239] * 

	* 

	W0520 08:18:03.145151    3031 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0520 08:18:03.153591    3031 out.go:177] 

** /stderr **

preload_test.go:46: out/minikube-darwin-arm64 start -p test-preload-159000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=qemu2  --kubernetes-version=v1.24.4 failed: exit status 80

panic.go:522: *** TestPreload FAILED at 2023-05-20 08:18:03.17157 -0700 PDT m=+860.160330543

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p test-preload-159000 -n test-preload-159000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p test-preload-159000 -n test-preload-159000: exit status 7 (66.958125ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "test-preload-159000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "test-preload-159000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p test-preload-159000

--- FAIL: TestPreload (10.01s)