=== RUN   TestDownloadOnly/v1.16.0/json-events

aaa_download_only_test.go:69: (dbg) Run:  out/minikube-darwin-arm64 start -o=json --download-only -p download-only-108000 --force --alsologtostderr --kubernetes-version=v1.16.0 --container-runtime=docker --driver=qemu2 

aaa_download_only_test.go:69: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -o=json --download-only -p download-only-108000 --force --alsologtostderr --kubernetes-version=v1.16.0 --container-runtime=docker --driver=qemu2 : exit status 40 (14.976524458s)

-- stdout --

	{"specversion":"1.0","id":"7950dd0e-3a0b-406e-ab0d-203058d294d9","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[download-only-108000] minikube v1.30.1 on Darwin 13.3.1 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}

	{"specversion":"1.0","id":"4e90f293-c143-4b9e-9667-a6742dd22967","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=16573"}}

	{"specversion":"1.0","id":"0b23c870-22ba-4683-b7c7-e98ba485e196","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/Users/jenkins/minikube-integration/16573-1024/kubeconfig"}}

	{"specversion":"1.0","id":"16c8e8cd-8601-4ca3-8572-1cb6e93a6b44","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-darwin-arm64"}}

	{"specversion":"1.0","id":"fb2c719a-71df-4c31-af5b-1c592d544642","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}

	{"specversion":"1.0","id":"872f2653-75e3-4878-886b-e51e326172ab","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/Users/jenkins/minikube-integration/16573-1024/.minikube"}}

	{"specversion":"1.0","id":"661d21d7-559a-4199-8de4-3ce4cc161a6a","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.warning","datacontenttype":"application/json","data":{"message":"minikube skips various validations when --force is supplied; this may lead to unexpected behavior"}}

	{"specversion":"1.0","id":"90b87169-af33-48ad-9b86-ff90022cb6f1","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the qemu2 driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}

	{"specversion":"1.0","id":"3721baaa-8afd-450b-bd78-0d0767828b85","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Automatically selected the socket_vmnet network"}}

	{"specversion":"1.0","id":"c3ada96d-b136-4b5c-a934-46a53ead2c9b","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Downloading VM boot image ...","name":"Selecting Driver","totalsteps":"19"}}

	{"specversion":"1.0","id":"cd5a74bf-0e81-4f88-ae90-9d098eca629b","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting control plane node download-only-108000 in cluster download-only-108000","name":"Starting Node","totalsteps":"19"}}

	{"specversion":"1.0","id":"c933bdd6-2dba-45f0-a735-d7375a1e9164","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Downloading Kubernetes v1.16.0 preload ...","name":"Starting Node","totalsteps":"19"}}

	{"specversion":"1.0","id":"736c26ef-b4ed-4a3f-a814-4ad5d80aec23","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"40","issues":"","message":"Failed to cache kubectl: download failed: https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl.sha1: getter: \u0026{Ctx:context.Background Src:https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl.sha1 Dst:/Users/jenkins/minikube-integration/16573-1024/.minikube/cache/darwin/arm64/v1.16.0/kubectl.download Pwd: Mode:2 Umask:---------- Detectors:[0x103be6378 0x103be6378 0x103be6378 0x103be6378 0x103be6378 0x103be6378 0x103be6378] Decompressors:map[bz2:0x1400049a838 gz:0x1400049a890 tar:0x1400049a840 tar.bz2:0x1400049a850 tar.gz:0x1400049a860 tar.xz:0x1400049a870 tar.zst:0x1400049a880 tbz2:0x1400049a850 tgz:0x140004

9a860 txz:0x1400049a870 tzst:0x1400049a880 xz:0x1400049a898 zip:0x1400049a8a0 zst:0x1400049a8b0] Getters:map[file:0x14000ab97c0 http:0x14000a22aa0 https:0x14000a22af0] Dir:false ProgressListener:\u003cnil\u003e Insecure:false DisableSymlinks:false Options:[]}: invalid checksum: Error downloading checksum file: bad response code: 404","name":"INET_CACHE_KUBECTL","url":""}}

	{"specversion":"1.0","id":"3f56dc0b-7395-4645-9420-f60b13bd1e40","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"╭───────────────────────────────────────────────────────────────────────────────────────────╮\n│                                                                                           │\n│    If the above advice does not help, please let us know:                                 │\n│    https://github.com/kubernetes/minikube/issues/new/choose                               │\n│                                                                                           │\n│    Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │\n│

│\n╰───────────────────────────────────────────────────────────────────────────────────────────╯"}}

-- /stdout --

** stderr ** 

	I0524 11:35:43.247013    1456 out.go:296] Setting OutFile to fd 1 ...

	I0524 11:35:43.247159    1456 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0524 11:35:43.247162    1456 out.go:309] Setting ErrFile to fd 2...

	I0524 11:35:43.247165    1456 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0524 11:35:43.247229    1456 root.go:336] Updating PATH: /Users/jenkins/minikube-integration/16573-1024/.minikube/bin

	W0524 11:35:43.247359    1456 root.go:312] Error reading config file at /Users/jenkins/minikube-integration/16573-1024/.minikube/config/config.json: open /Users/jenkins/minikube-integration/16573-1024/.minikube/config/config.json: no such file or directory

	I0524 11:35:43.248572    1456 out.go:303] Setting JSON to true

	I0524 11:35:43.265684    1456 start.go:125] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":314,"bootTime":1684953029,"procs":415,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"13.3.1","kernelVersion":"22.4.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}

	W0524 11:35:43.265738    1456 start.go:133] gopshost.Virtualization returned error: not implemented yet

	I0524 11:35:43.269580    1456 out.go:97] [download-only-108000] minikube v1.30.1 on Darwin 13.3.1 (arm64)

	I0524 11:35:43.273607    1456 out.go:169] MINIKUBE_LOCATION=16573

	I0524 11:35:43.269733    1456 notify.go:220] Checking for updates...

	W0524 11:35:43.269768    1456 preload.go:295] Failed to list preload files: open /Users/jenkins/minikube-integration/16573-1024/.minikube/cache/preloaded-tarball: no such file or directory

	I0524 11:35:43.278486    1456 out.go:169] KUBECONFIG=/Users/jenkins/minikube-integration/16573-1024/kubeconfig

	I0524 11:35:43.281606    1456 out.go:169] MINIKUBE_BIN=out/minikube-darwin-arm64

	I0524 11:35:43.283036    1456 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0524 11:35:43.286482    1456 out.go:169] MINIKUBE_HOME=/Users/jenkins/minikube-integration/16573-1024/.minikube

	W0524 11:35:43.292553    1456 out.go:272] minikube skips various validations when --force is supplied; this may lead to unexpected behavior

	I0524 11:35:43.292745    1456 driver.go:375] Setting default libvirt URI to qemu:///system

	I0524 11:35:43.297497    1456 out.go:97] Using the qemu2 driver based on user configuration

	I0524 11:35:43.297517    1456 start.go:295] selected driver: qemu2

	I0524 11:35:43.297532    1456 start.go:870] validating driver "qemu2" against <nil>

	I0524 11:35:43.297588    1456 start_flags.go:305] no existing cluster config was found, will generate one from the flags 

	I0524 11:35:43.301532    1456 out.go:169] Automatically selected the socket_vmnet network

	I0524 11:35:43.307076    1456 start_flags.go:382] Using suggested 4000MB memory alloc based on sys=16384MB, container=0MB

	I0524 11:35:43.307213    1456 start_flags.go:897] Wait components to verify : map[apiserver:true system_pods:true]

	I0524 11:35:43.307234    1456 cni.go:84] Creating CNI manager for ""

	I0524 11:35:43.307257    1456 cni.go:161] CNI unnecessary in this configuration, recommending no CNI

	I0524 11:35:43.307261    1456 start_flags.go:319] config:

	{Name:download-only-108000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684536746-16501@sha256:f5d93abf1d1cfb142a7cf0b58b24029595d621e5f943105b16c61199094d77de Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:download-only-108000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRun

time:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}

	I0524 11:35:43.307399    1456 iso.go:125] acquiring lock: {Name:mk78431aa792d64459e9d8bd2fb1ce84dc420421 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0524 11:35:43.311547    1456 out.go:97] Downloading VM boot image ...

	I0524 11:35:43.311585    1456 download.go:107] Downloading: https://storage.googleapis.com/minikube-builds/iso/16501/minikube-v1.30.1-1684536668-16501-arm64.iso?checksum=file:https://storage.googleapis.com/minikube-builds/iso/16501/minikube-v1.30.1-1684536668-16501-arm64.iso.sha256 -> /Users/jenkins/minikube-integration/16573-1024/.minikube/cache/iso/arm64/minikube-v1.30.1-1684536668-16501-arm64.iso

	I0524 11:35:50.541475    1456 out.go:97] Starting control plane node download-only-108000 in cluster download-only-108000

	I0524 11:35:50.541501    1456 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker

	I0524 11:35:50.594774    1456 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.16.0/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4

	I0524 11:35:50.594832    1456 cache.go:57] Caching tarball of preloaded images

	I0524 11:35:50.594990    1456 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker

	I0524 11:35:50.599399    1456 out.go:97] Downloading Kubernetes v1.16.0 preload ...

	I0524 11:35:50.599405    1456 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4 ...

	I0524 11:35:50.675234    1456 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.16.0/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4?checksum=md5:a000baffb0664b293d602f95ed25caa6 -> /Users/jenkins/minikube-integration/16573-1024/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4

	I0524 11:35:57.182614    1456 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4 ...

	I0524 11:35:57.182748    1456 preload.go:256] verifying checksum of /Users/jenkins/minikube-integration/16573-1024/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4 ...

	I0524 11:35:57.826801    1456 cache.go:60] Finished verifying existence of preloaded tar for  v1.16.0 on docker

	I0524 11:35:57.826976    1456 profile.go:148] Saving config to /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/download-only-108000/config.json ...

	I0524 11:35:57.827004    1456 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/download-only-108000/config.json: {Name:mkb01c988bf51437b0ec4fd4bf88d2090d77f626 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:35:57.827258    1456 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker

	I0524 11:35:57.827437    1456 download.go:107] Downloading: https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl.sha1 -> /Users/jenkins/minikube-integration/16573-1024/.minikube/cache/darwin/arm64/v1.16.0/kubectl

	I0524 11:35:58.153748    1456 out.go:169] 

	W0524 11:35:58.158931    1456 out_reason.go:110] Failed to cache kubectl: download failed: https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl.sha1: getter: &{Ctx:context.Background Src:https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.16.0/bin/darwin/arm64/kubectl.sha1 Dst:/Users/jenkins/minikube-integration/16573-1024/.minikube/cache/darwin/arm64/v1.16.0/kubectl.download Pwd: Mode:2 Umask:---------- Detectors:[0x103be6378 0x103be6378 0x103be6378 0x103be6378 0x103be6378 0x103be6378 0x103be6378] Decompressors:map[bz2:0x1400049a838 gz:0x1400049a890 tar:0x1400049a840 tar.bz2:0x1400049a850 tar.gz:0x1400049a860 tar.xz:0x1400049a870 tar.zst:0x1400049a880 tbz2:0x1400049a850 tgz:0x1400049a860 txz:0x1400049a870 tzst:0x1400049a880 xz:0x1400049a898 zip:0x1400049a8a0 zst:0x1400049a8b0] Getters:map[file:0x14000ab97c0 http:0x14000a22aa0 https:0x14000a22af0] Dir:false ProgressListener

:<nil> Insecure:false DisableSymlinks:false Options:[]}: invalid checksum: Error downloading checksum file: bad response code: 404

	W0524 11:35:58.158961    1456 out_reason.go:110] 

	W0524 11:35:58.166752    1456 out.go:229] ╭───────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                           │

	│    If the above advice does not help, please let us know:                                 │

	│    https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                           │

	│    Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                           │

	╰───────────────────────────────────────────────────────────────────────────────────────────╯

	I0524 11:35:58.169797    1456 out.go:169] 

** /stderr **

aaa_download_only_test.go:71: failed to download only. args: ["start" "-o=json" "--download-only" "-p" "download-only-108000" "--force" "--alsologtostderr" "--kubernetes-version=v1.16.0" "--container-runtime=docker" "--driver=qemu2" ""] exit status 40

--- FAIL: TestDownloadOnly/v1.16.0/json-events (14.98s)

=== RUN   TestDownloadOnly/v1.16.0/kubectl

aaa_download_only_test.go:160: expected the file for binary exist at "/Users/jenkins/minikube-integration/16573-1024/.minikube/cache/darwin/arm64/v1.16.0/kubectl" but got error stat /Users/jenkins/minikube-integration/16573-1024/.minikube/cache/darwin/arm64/v1.16.0/kubectl: no such file or directory

--- FAIL: TestDownloadOnly/v1.16.0/kubectl (0.00s)

=== RUN   TestOffline

=== PAUSE TestOffline

=== CONT  TestOffline

aab_offline_test.go:55: (dbg) Run:  out/minikube-darwin-arm64 start -p offline-docker-088000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=qemu2 

aab_offline_test.go:55: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p offline-docker-088000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=qemu2 : exit status 80 (9.74738475s)

-- stdout --

	* [offline-docker-088000] minikube v1.30.1 on Darwin 13.3.1 (arm64)

	  - MINIKUBE_LOCATION=16573

	  - KUBECONFIG=/Users/jenkins/minikube-integration/16573-1024/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-arm64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/16573-1024/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the qemu2 driver based on user configuration

	* Automatically selected the socket_vmnet network

	* Starting control plane node offline-docker-088000 in cluster offline-docker-088000

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	* Deleting "offline-docker-088000" in qemu2 ...

	* Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	OUTPUT: 

	ERROR: Failed to connect to "/var/run/socket_vmnet": Connection refused

-- /stdout --

** stderr ** 

	I0524 12:28:51.163174    3779 out.go:296] Setting OutFile to fd 1 ...

	I0524 12:28:51.163318    3779 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0524 12:28:51.163321    3779 out.go:309] Setting ErrFile to fd 2...

	I0524 12:28:51.163323    3779 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0524 12:28:51.163402    3779 root.go:336] Updating PATH: /Users/jenkins/minikube-integration/16573-1024/.minikube/bin

	I0524 12:28:51.164435    3779 out.go:303] Setting JSON to false

	I0524 12:28:51.181138    3779 start.go:125] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":3502,"bootTime":1684953029,"procs":419,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"13.3.1","kernelVersion":"22.4.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}

	W0524 12:28:51.181242    3779 start.go:133] gopshost.Virtualization returned error: not implemented yet

	I0524 12:28:51.185287    3779 out.go:177] * [offline-docker-088000] minikube v1.30.1 on Darwin 13.3.1 (arm64)

	I0524 12:28:51.192124    3779 out.go:177]   - MINIKUBE_LOCATION=16573

	I0524 12:28:51.192142    3779 notify.go:220] Checking for updates...

	I0524 12:28:51.195213    3779 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/16573-1024/kubeconfig

	I0524 12:28:51.199134    3779 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0524 12:28:51.202184    3779 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0524 12:28:51.205208    3779 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/16573-1024/.minikube

	I0524 12:28:51.208358    3779 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0524 12:28:51.211434    3779 config.go:182] Loaded profile config "multinode-636000-m01": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.27.2

	I0524 12:28:51.211463    3779 driver.go:375] Setting default libvirt URI to qemu:///system

	I0524 12:28:51.215153    3779 out.go:177] * Using the qemu2 driver based on user configuration

	I0524 12:28:51.221054    3779 start.go:295] selected driver: qemu2

	I0524 12:28:51.221059    3779 start.go:870] validating driver "qemu2" against <nil>

	I0524 12:28:51.221065    3779 start.go:881] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0524 12:28:51.222985    3779 start_flags.go:305] no existing cluster config was found, will generate one from the flags 

	I0524 12:28:51.226102    3779 out.go:177] * Automatically selected the socket_vmnet network

	I0524 12:28:51.229225    3779 start_flags.go:915] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0524 12:28:51.229244    3779 cni.go:84] Creating CNI manager for ""

	I0524 12:28:51.229252    3779 cni.go:157] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0524 12:28:51.229257    3779 start_flags.go:314] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0524 12:28:51.229264    3779 start_flags.go:319] config:

	{Name:offline-docker-088000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684536746-16501@sha256:f5d93abf1d1cfb142a7cf0b58b24029595d621e5f943105b16c61199094d77de Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.2 ClusterName:offline-docker-088000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerR

untime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}

	I0524 12:28:51.229350    3779 iso.go:125] acquiring lock: {Name:mk78431aa792d64459e9d8bd2fb1ce84dc420421 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0524 12:28:51.236175    3779 out.go:177] * Starting control plane node offline-docker-088000 in cluster offline-docker-088000

	I0524 12:28:51.240084    3779 preload.go:132] Checking if preload exists for k8s version v1.27.2 and runtime docker

	I0524 12:28:51.240117    3779 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/16573-1024/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.2-docker-overlay2-arm64.tar.lz4

	I0524 12:28:51.240129    3779 cache.go:57] Caching tarball of preloaded images

	I0524 12:28:51.240195    3779 preload.go:174] Found /Users/jenkins/minikube-integration/16573-1024/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0524 12:28:51.240202    3779 cache.go:60] Finished verifying existence of preloaded tar for  v1.27.2 on docker

	I0524 12:28:51.240259    3779 profile.go:148] Saving config to /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/offline-docker-088000/config.json ...

	I0524 12:28:51.240275    3779 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/offline-docker-088000/config.json: {Name:mke0371ff1fb606e40b522204065b04509dd5bed Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 12:28:51.240475    3779 cache.go:195] Successfully downloaded all kic artifacts

	I0524 12:28:51.240487    3779 start.go:364] acquiring machines lock for offline-docker-088000: {Name:mkb37a68e9ac84a7c17b3cbe42c3966e2ec65b65 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0524 12:28:51.240509    3779 start.go:368] acquired machines lock for "offline-docker-088000" in 18.291µs

	I0524 12:28:51.240521    3779 start.go:93] Provisioning new machine with config: &{Name:offline-docker-088000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/16501/minikube-v1.30.1-1684536668-16501-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684536746-16501@sha256:f5d93abf1d1cfb142a7cf0b58b24029595d621e5f943105b16c61199094d77de Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne

tesConfig:{KubernetesVersion:v1.27.2 ClusterName:offline-docker-088000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP

: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:} &{Name: IP: Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0524 12:28:51.240547    3779 start.go:125] createHost starting for "" (driver="qemu2")

	I0524 12:28:51.249203    3779 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0524 12:28:51.263545    3779 start.go:159] libmachine.API.Create for "offline-docker-088000" (driver="qemu2")

	I0524 12:28:51.263578    3779 client.go:168] LocalClient.Create starting

	I0524 12:28:51.263644    3779 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca.pem

	I0524 12:28:51.263665    3779 main.go:141] libmachine: Decoding PEM data...

	I0524 12:28:51.263677    3779 main.go:141] libmachine: Parsing certificate...

	I0524 12:28:51.263732    3779 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/cert.pem

	I0524 12:28:51.263746    3779 main.go:141] libmachine: Decoding PEM data...

	I0524 12:28:51.263753    3779 main.go:141] libmachine: Parsing certificate...

	I0524 12:28:51.264071    3779 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/16573-1024/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/16573-1024/.minikube/cache/iso/arm64/minikube-v1.30.1-1684536668-16501-arm64.iso...

	I0524 12:28:51.391544    3779 main.go:141] libmachine: Creating SSH key...

	I0524 12:28:51.542605    3779 main.go:141] libmachine: Creating Disk image...

	I0524 12:28:51.542614    3779 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0524 12:28:51.542818    3779 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/offline-docker-088000/disk.qcow2.raw /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/offline-docker-088000/disk.qcow2

	I0524 12:28:51.558842    3779 main.go:141] libmachine: STDOUT: 

	I0524 12:28:51.558859    3779 main.go:141] libmachine: STDERR: 

	I0524 12:28:51.558941    3779 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/offline-docker-088000/disk.qcow2 +20000M

	I0524 12:28:51.566722    3779 main.go:141] libmachine: STDOUT: Image resized.

	I0524 12:28:51.566741    3779 main.go:141] libmachine: STDERR: 

	I0524 12:28:51.566765    3779 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/offline-docker-088000/disk.qcow2.raw and /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/offline-docker-088000/disk.qcow2

	I0524 12:28:51.566775    3779 main.go:141] libmachine: Starting QEMU VM...

	I0524 12:28:51.566821    3779 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/Cellar/qemu/7.2.0/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/offline-docker-088000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/offline-docker-088000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/offline-docker-088000/qemu.pid -device virtio-net-pci,netdev=net0,mac=ba:c1:ca:dc:62:8c -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/offline-docker-088000/disk.qcow2

	I0524 12:28:51.568498    3779 main.go:141] libmachine: STDOUT: 

	I0524 12:28:51.568513    3779 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0524 12:28:51.568532    3779 client.go:171] LocalClient.Create took 304.951792ms

	I0524 12:28:53.569858    3779 start.go:128] duration metric: createHost completed in 2.329324667s

	I0524 12:28:53.569877    3779 start.go:83] releasing machines lock for "offline-docker-088000", held for 2.329388208s

	W0524 12:28:53.569891    3779 start.go:687] error starting host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0524 12:28:53.582774    3779 out.go:177] * Deleting "offline-docker-088000" in qemu2 ...

	W0524 12:28:53.593125    3779 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	! StartHost failed, but will try again: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0524 12:28:53.593133    3779 start.go:702] Will try again in 5 seconds ...

	I0524 12:28:58.595271    3779 start.go:364] acquiring machines lock for offline-docker-088000: {Name:mkb37a68e9ac84a7c17b3cbe42c3966e2ec65b65 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0524 12:28:58.595730    3779 start.go:368] acquired machines lock for "offline-docker-088000" in 374.625µs

	I0524 12:28:58.595831    3779 start.go:93] Provisioning new machine with config: &{Name:offline-docker-088000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/16501/minikube-v1.30.1-1684536668-16501-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684536746-16501@sha256:f5d93abf1d1cfb142a7cf0b58b24029595d621e5f943105b16c61199094d77de Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne

tesConfig:{KubernetesVersion:v1.27.2 ClusterName:offline-docker-088000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP

: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:} &{Name: IP: Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0524 12:28:58.596172    3779 start.go:125] createHost starting for "" (driver="qemu2")

	I0524 12:28:58.603971    3779 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0524 12:28:58.650651    3779 start.go:159] libmachine.API.Create for "offline-docker-088000" (driver="qemu2")

	I0524 12:28:58.650711    3779 client.go:168] LocalClient.Create starting

	I0524 12:28:58.650963    3779 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca.pem

	I0524 12:28:58.651034    3779 main.go:141] libmachine: Decoding PEM data...

	I0524 12:28:58.651055    3779 main.go:141] libmachine: Parsing certificate...

	I0524 12:28:58.651145    3779 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/cert.pem

	I0524 12:28:58.651175    3779 main.go:141] libmachine: Decoding PEM data...

	I0524 12:28:58.651188    3779 main.go:141] libmachine: Parsing certificate...

	I0524 12:28:58.651713    3779 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/16573-1024/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/16573-1024/.minikube/cache/iso/arm64/minikube-v1.30.1-1684536668-16501-arm64.iso...

	I0524 12:28:58.775971    3779 main.go:141] libmachine: Creating SSH key...

	I0524 12:28:58.826245    3779 main.go:141] libmachine: Creating Disk image...

	I0524 12:28:58.826251    3779 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0524 12:28:58.826409    3779 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/offline-docker-088000/disk.qcow2.raw /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/offline-docker-088000/disk.qcow2

	I0524 12:28:58.834884    3779 main.go:141] libmachine: STDOUT: 

	I0524 12:28:58.834899    3779 main.go:141] libmachine: STDERR: 

	I0524 12:28:58.834959    3779 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/offline-docker-088000/disk.qcow2 +20000M

	I0524 12:28:58.842068    3779 main.go:141] libmachine: STDOUT: Image resized.

	I0524 12:28:58.842082    3779 main.go:141] libmachine: STDERR: 

	I0524 12:28:58.842097    3779 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/offline-docker-088000/disk.qcow2.raw and /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/offline-docker-088000/disk.qcow2

	I0524 12:28:58.842108    3779 main.go:141] libmachine: Starting QEMU VM...

	I0524 12:28:58.842151    3779 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt,highmem=off -cpu host -drive file=/opt/homebrew/Cellar/qemu/7.2.0/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 2048 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/offline-docker-088000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/offline-docker-088000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/offline-docker-088000/qemu.pid -device virtio-net-pci,netdev=net0,mac=0e:3f:7b:cc:cd:8e -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/offline-docker-088000/disk.qcow2

	I0524 12:28:58.843647    3779 main.go:141] libmachine: STDOUT: 

	I0524 12:28:58.843660    3779 main.go:141] libmachine: STDERR: Failed to connect to "/var/run/socket_vmnet": Connection refused

	I0524 12:28:58.843673    3779 client.go:171] LocalClient.Create took 192.956667ms

	I0524 12:29:00.845723    3779 start.go:128] duration metric: createHost completed in 2.249528333s

	I0524 12:29:00.845755    3779 start.go:83] releasing machines lock for "offline-docker-088000", held for 2.250031s

	W0524 12:29:00.845910    3779 out.go:239] * Failed to start qemu2 VM. Running "minikube delete -p offline-docker-088000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	* Failed to start qemu2 VM. Running "minikube delete -p offline-docker-088000" may fix it: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	I0524 12:29:00.856304    3779 out.go:177] 

	W0524 12:29:00.860420    3779 out.go:239] X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	X Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/var/run/socket_vmnet": Connection refused: exit status 1

	W0524 12:29:00.860437    3779 out.go:239] * 

	* 

	W0524 12:29:00.860909    3779 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0524 12:29:00.871196    3779 out.go:177] 

** /stderr **

aab_offline_test.go:58: out/minikube-darwin-arm64 start -p offline-docker-088000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=qemu2  failed: exit status 80

panic.go:522: *** TestOffline FAILED at 2023-05-24 12:29:00.883283 -0700 PDT m=+3197.752424709

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p offline-docker-088000 -n offline-docker-088000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p offline-docker-088000 -n offline-docker-088000: exit status 7 (32.093125ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "offline-docker-088000" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "offline-docker-088000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-arm64 delete -p offline-docker-088000

--- FAIL: TestOffline (9.88s)

=== RUN   TestAddons/parallel/Registry

=== PAUSE TestAddons/parallel/Registry

=== CONT  TestAddons/parallel/Registry

addons_test.go:304: failed waiting for registry replicacontroller to stabilize: timed out waiting for the condition

addons_test.go:306: registry stabilized in 6m0.001565583s

addons_test.go:308: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...

addons_test.go:308: ***** TestAddons/parallel/Registry: pod "actual-registry=true" failed to start within 6m0s: context deadline exceeded ****

addons_test.go:308: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.APIServer}} -p addons-514000 -n addons-514000

addons_test.go:308: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.APIServer}} -p addons-514000 -n addons-514000: exit status 7 (55.567583ms)

-- stdout --

	Nonexistent

-- /stdout --

** stderr ** 

	E0524 11:54:50.650364    1802 status.go:249] status error: host: state: connect: dial unix /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor: connect: connection refused

** /stderr **

addons_test.go:308: status error: exit status 7 (may be ok)

addons_test.go:308: "addons-514000" apiserver is not running, skipping kubectl commands (state="Nonexistent")

addons_test.go:309: failed waiting for pod actual-registry: actual-registry=true within 6m0s: context deadline exceeded

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p addons-514000 -n addons-514000

helpers_test.go:244: <<< TestAddons/parallel/Registry FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestAddons/parallel/Registry]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-darwin-arm64 -p addons-514000 logs -n 25

helpers_test.go:252: TestAddons/parallel/Registry logs: 

-- stdout --

	* 

	* ==> Audit <==

	* |---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|

	| Command |              Args              |       Profile        |  User   | Version |     Start Time      |      End Time       |

	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|

	| start   | -o=json --download-only        | download-only-108000 | jenkins | v1.30.1 | 24 May 23 11:35 PDT |                     |

	|         | -p download-only-108000        |                      |         |         |                     |                     |

	|         | --force --alsologtostderr      |                      |         |         |                     |                     |

	|         | --kubernetes-version=v1.16.0   |                      |         |         |                     |                     |

	|         | --container-runtime=docker     |                      |         |         |                     |                     |

	|         | --driver=qemu2                 |                      |         |         |                     |                     |

	| start   | -o=json --download-only        | download-only-108000 | jenkins | v1.30.1 | 24 May 23 11:35 PDT |                     |

	|         | -p download-only-108000        |                      |         |         |                     |                     |

	|         | --force --alsologtostderr      |                      |         |         |                     |                     |

	|         | --kubernetes-version=v1.27.2   |                      |         |         |                     |                     |

	|         | --container-runtime=docker     |                      |         |         |                     |                     |

	|         | --driver=qemu2                 |                      |         |         |                     |                     |

	| delete  | --all                          | minikube             | jenkins | v1.30.1 | 24 May 23 11:36 PDT | 24 May 23 11:36 PDT |

	| delete  | -p download-only-108000        | download-only-108000 | jenkins | v1.30.1 | 24 May 23 11:36 PDT | 24 May 23 11:36 PDT |

	| delete  | -p download-only-108000        | download-only-108000 | jenkins | v1.30.1 | 24 May 23 11:36 PDT | 24 May 23 11:36 PDT |

	| start   | --download-only -p             | binary-mirror-689000 | jenkins | v1.30.1 | 24 May 23 11:36 PDT |                     |

	|         | binary-mirror-689000           |                      |         |         |                     |                     |

	|         | --alsologtostderr              |                      |         |         |                     |                     |

	|         | --binary-mirror                |                      |         |         |                     |                     |

	|         | http://127.0.0.1:49309         |                      |         |         |                     |                     |

	|         | --driver=qemu2                 |                      |         |         |                     |                     |

	| delete  | -p binary-mirror-689000        | binary-mirror-689000 | jenkins | v1.30.1 | 24 May 23 11:36 PDT | 24 May 23 11:36 PDT |

	| start   | -p addons-514000               | addons-514000        | jenkins | v1.30.1 | 24 May 23 11:36 PDT | 24 May 23 11:42 PDT |

	|         | --wait=true --memory=4000      |                      |         |         |                     |                     |

	|         | --alsologtostderr              |                      |         |         |                     |                     |

	|         | --addons=registry              |                      |         |         |                     |                     |

	|         | --addons=metrics-server        |                      |         |         |                     |                     |

	|         | --addons=volumesnapshots       |                      |         |         |                     |                     |

	|         | --addons=csi-hostpath-driver   |                      |         |         |                     |                     |

	|         | --addons=gcp-auth              |                      |         |         |                     |                     |

	|         | --addons=cloud-spanner         |                      |         |         |                     |                     |

	|         | --addons=inspektor-gadget      |                      |         |         |                     |                     |

	|         | --driver=qemu2                 |                      |         |         |                     |                     |

	|         | --addons=ingress               |                      |         |         |                     |                     |

	|         | --addons=ingress-dns           |                      |         |         |                     |                     |

	| addons  | disable cloud-spanner -p       | addons-514000        | jenkins | v1.30.1 | 24 May 23 11:54 PDT |                     |

	|         | addons-514000                  |                      |         |         |                     |                     |

	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|

	* 

	* ==> Last Start <==

	* Log file created at: 2023/05/24 11:36:07

	Running on machine: MacOS-M1-Agent-1

	Binary: Built with gc go1.20.4 for darwin/arm64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0524 11:36:07.002339    1534 out.go:296] Setting OutFile to fd 1 ...

	I0524 11:36:07.002453    1534 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0524 11:36:07.002456    1534 out.go:309] Setting ErrFile to fd 2...

	I0524 11:36:07.002459    1534 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0524 11:36:07.002536    1534 root.go:336] Updating PATH: /Users/jenkins/minikube-integration/16573-1024/.minikube/bin

	I0524 11:36:07.003586    1534 out.go:303] Setting JSON to false

	I0524 11:36:07.018861    1534 start.go:125] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":338,"bootTime":1684953029,"procs":422,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"13.3.1","kernelVersion":"22.4.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}

	W0524 11:36:07.018925    1534 start.go:133] gopshost.Virtualization returned error: not implemented yet

	I0524 11:36:07.027769    1534 out.go:177] * [addons-514000] minikube v1.30.1 on Darwin 13.3.1 (arm64)

	I0524 11:36:07.031820    1534 out.go:177]   - MINIKUBE_LOCATION=16573

	I0524 11:36:07.031893    1534 notify.go:220] Checking for updates...

	I0524 11:36:07.038648    1534 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/16573-1024/kubeconfig

	I0524 11:36:07.041871    1534 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0524 11:36:07.045796    1534 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0524 11:36:07.047102    1534 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/16573-1024/.minikube

	I0524 11:36:07.049751    1534 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0524 11:36:07.052962    1534 driver.go:375] Setting default libvirt URI to qemu:///system

	I0524 11:36:07.056656    1534 out.go:177] * Using the qemu2 driver based on user configuration

	I0524 11:36:07.063768    1534 start.go:295] selected driver: qemu2

	I0524 11:36:07.063774    1534 start.go:870] validating driver "qemu2" against <nil>

	I0524 11:36:07.063780    1534 start.go:881] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0524 11:36:07.066216    1534 start_flags.go:305] no existing cluster config was found, will generate one from the flags 

	I0524 11:36:07.068844    1534 out.go:177] * Automatically selected the socket_vmnet network

	I0524 11:36:07.072801    1534 start_flags.go:915] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0524 11:36:07.072817    1534 cni.go:84] Creating CNI manager for ""

	I0524 11:36:07.072825    1534 cni.go:157] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0524 11:36:07.072829    1534 start_flags.go:314] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0524 11:36:07.072834    1534 start_flags.go:319] config:

	{Name:addons-514000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684536746-16501@sha256:f5d93abf1d1cfb142a7cf0b58b24029595d621e5f943105b16c61199094d77de Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.2 ClusterName:addons-514000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CR

ISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}

	I0524 11:36:07.072903    1534 iso.go:125] acquiring lock: {Name:mk78431aa792d64459e9d8bd2fb1ce84dc420421 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0524 11:36:07.080756    1534 out.go:177] * Starting control plane node addons-514000 in cluster addons-514000

	I0524 11:36:07.084763    1534 preload.go:132] Checking if preload exists for k8s version v1.27.2 and runtime docker

	I0524 11:36:07.084787    1534 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/16573-1024/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.2-docker-overlay2-arm64.tar.lz4

	I0524 11:36:07.084798    1534 cache.go:57] Caching tarball of preloaded images

	I0524 11:36:07.084855    1534 preload.go:174] Found /Users/jenkins/minikube-integration/16573-1024/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0524 11:36:07.084860    1534 cache.go:60] Finished verifying existence of preloaded tar for  v1.27.2 on docker

	I0524 11:36:07.085026    1534 profile.go:148] Saving config to /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/config.json ...

	I0524 11:36:07.085039    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/config.json: {Name:mk030e94b16168c63405a9b01e247098a953bb00 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:07.085215    1534 cache.go:195] Successfully downloaded all kic artifacts

	I0524 11:36:07.085252    1534 start.go:364] acquiring machines lock for addons-514000: {Name:mkb37a68e9ac84a7c17b3cbe42c3966e2ec65b65 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0524 11:36:07.085315    1534 start.go:368] acquired machines lock for "addons-514000" in 57.708µs

	I0524 11:36:07.085327    1534 start.go:93] Provisioning new machine with config: &{Name:addons-514000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/16501/minikube-v1.30.1-1684536668-16501-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684536746-16501@sha256:f5d93abf1d1cfb142a7cf0b58b24029595d621e5f943105b16c61199094d77de Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi

g:{KubernetesVersion:v1.27.2 ClusterName:addons-514000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262

144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:} &{Name: IP: Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0524 11:36:07.085355    1534 start.go:125] createHost starting for "" (driver="qemu2")

	I0524 11:36:07.093778    1534 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	I0524 11:36:07.463575    1534 start.go:159] libmachine.API.Create for "addons-514000" (driver="qemu2")

	I0524 11:36:07.463635    1534 client.go:168] LocalClient.Create starting

	I0524 11:36:07.463808    1534 main.go:141] libmachine: Creating CA: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca.pem

	I0524 11:36:07.521208    1534 main.go:141] libmachine: Creating client certificate: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/cert.pem

	I0524 11:36:07.678481    1534 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/16573-1024/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/16573-1024/.minikube/cache/iso/arm64/minikube-v1.30.1-1684536668-16501-arm64.iso...

	I0524 11:36:08.060894    1534 main.go:141] libmachine: Creating SSH key...

	I0524 11:36:08.147520    1534 main.go:141] libmachine: Creating Disk image...

	I0524 11:36:08.147526    1534 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0524 11:36:08.147754    1534 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/disk.qcow2.raw /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/disk.qcow2

	I0524 11:36:08.231403    1534 main.go:141] libmachine: STDOUT: 

	I0524 11:36:08.231426    1534 main.go:141] libmachine: STDERR: 

	I0524 11:36:08.231485    1534 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/disk.qcow2 +20000M

	I0524 11:36:08.238737    1534 main.go:141] libmachine: STDOUT: Image resized.

	I0524 11:36:08.238750    1534 main.go:141] libmachine: STDERR: 

	I0524 11:36:08.238766    1534 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/disk.qcow2.raw and /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/disk.qcow2

	I0524 11:36:08.238773    1534 main.go:141] libmachine: Starting QEMU VM...

	I0524 11:36:08.238817    1534 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt -cpu host -drive file=/opt/homebrew/Cellar/qemu/7.2.0/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 4000 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/qemu.pid -device virtio-net-pci,netdev=net0,mac=0a:73:48:f5:f9:b3 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/disk.qcow2

	I0524 11:36:08.309201    1534 main.go:141] libmachine: STDOUT: 

	I0524 11:36:08.309237    1534 main.go:141] libmachine: STDERR: 

	I0524 11:36:08.309242    1534 main.go:141] libmachine: Attempt 0

	I0524 11:36:08.309258    1534 main.go:141] libmachine: Searching for a:73:48:f5:f9:b3 in /var/db/dhcpd_leases ...

	I0524 11:36:10.311441    1534 main.go:141] libmachine: Attempt 1

	I0524 11:36:10.311529    1534 main.go:141] libmachine: Searching for a:73:48:f5:f9:b3 in /var/db/dhcpd_leases ...

	I0524 11:36:12.313222    1534 main.go:141] libmachine: Attempt 2

	I0524 11:36:12.313245    1534 main.go:141] libmachine: Searching for a:73:48:f5:f9:b3 in /var/db/dhcpd_leases ...

	I0524 11:36:14.315294    1534 main.go:141] libmachine: Attempt 3

	I0524 11:36:14.315307    1534 main.go:141] libmachine: Searching for a:73:48:f5:f9:b3 in /var/db/dhcpd_leases ...

	I0524 11:36:16.317343    1534 main.go:141] libmachine: Attempt 4

	I0524 11:36:16.317356    1534 main.go:141] libmachine: Searching for a:73:48:f5:f9:b3 in /var/db/dhcpd_leases ...

	I0524 11:36:18.319398    1534 main.go:141] libmachine: Attempt 5

	I0524 11:36:18.319426    1534 main.go:141] libmachine: Searching for a:73:48:f5:f9:b3 in /var/db/dhcpd_leases ...

	I0524 11:36:20.321607    1534 main.go:141] libmachine: Attempt 6

	I0524 11:36:20.321690    1534 main.go:141] libmachine: Searching for a:73:48:f5:f9:b3 in /var/db/dhcpd_leases ...

	I0524 11:36:20.321979    1534 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I0524 11:36:20.322073    1534 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:a:73:48:f5:f9:b3 ID:1,a:73:48:f5:f9:b3 Lease:0x646faaa3}

	I0524 11:36:20.322118    1534 main.go:141] libmachine: Found match: a:73:48:f5:f9:b3

	I0524 11:36:20.322159    1534 main.go:141] libmachine: IP: 192.168.105.2

	I0524 11:36:20.322182    1534 main.go:141] libmachine: Waiting for VM to start (ssh -p 22 docker@192.168.105.2)...

	I0524 11:36:22.345943    1534 machine.go:88] provisioning docker machine ...

	I0524 11:36:22.346010    1534 buildroot.go:166] provisioning hostname "addons-514000"

	I0524 11:36:22.346753    1534 main.go:141] libmachine: Using SSH client type: native

	I0524 11:36:22.347771    1534 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100e286d0] 0x100e2b130 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0524 11:36:22.347789    1534 main.go:141] libmachine: About to run SSH command:

	sudo hostname addons-514000 && echo "addons-514000" | sudo tee /etc/hostname

	I0524 11:36:22.440700    1534 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-514000

	I0524 11:36:22.440862    1534 main.go:141] libmachine: Using SSH client type: native

	I0524 11:36:22.441350    1534 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100e286d0] 0x100e2b130 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0524 11:36:22.441366    1534 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\saddons-514000' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-514000/g' /etc/hosts;

				else 

					echo '127.0.1.1 addons-514000' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0524 11:36:22.513129    1534 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0524 11:36:22.513148    1534 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/16573-1024/.minikube CaCertPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/16573-1024/.minikube}

	I0524 11:36:22.513166    1534 buildroot.go:174] setting up certificates

	I0524 11:36:22.513196    1534 provision.go:83] configureAuth start

	I0524 11:36:22.513202    1534 provision.go:138] copyHostCerts

	I0524 11:36:22.513384    1534 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.pem (1078 bytes)

	I0524 11:36:22.513907    1534 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/16573-1024/.minikube/cert.pem (1123 bytes)

	I0524 11:36:22.514185    1534 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/16573-1024/.minikube/key.pem (1675 bytes)

	I0524 11:36:22.514351    1534 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca-key.pem org=jenkins.addons-514000 san=[192.168.105.2 192.168.105.2 localhost 127.0.0.1 minikube addons-514000]

	I0524 11:36:22.615592    1534 provision.go:172] copyRemoteCerts

	I0524 11:36:22.615660    1534 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0524 11:36:22.615678    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:22.647614    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0524 11:36:22.654906    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/server.pem --> /etc/docker/server.pem (1216 bytes)

	I0524 11:36:22.661956    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0524 11:36:22.668901    1534 provision.go:86] duration metric: configureAuth took 155.700959ms

	I0524 11:36:22.668909    1534 buildroot.go:189] setting minikube options for container-runtime

	I0524 11:36:22.669263    1534 config.go:182] Loaded profile config "addons-514000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.27.2

	I0524 11:36:22.669315    1534 main.go:141] libmachine: Using SSH client type: native

	I0524 11:36:22.669538    1534 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100e286d0] 0x100e2b130 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0524 11:36:22.669543    1534 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0524 11:36:22.728343    1534 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I0524 11:36:22.728351    1534 buildroot.go:70] root file system type: tmpfs

	I0524 11:36:22.728414    1534 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I0524 11:36:22.728455    1534 main.go:141] libmachine: Using SSH client type: native

	I0524 11:36:22.728711    1534 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100e286d0] 0x100e2b130 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0524 11:36:22.728749    1534 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0524 11:36:22.797892    1534 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0524 11:36:22.797940    1534 main.go:141] libmachine: Using SSH client type: native

	I0524 11:36:22.798220    1534 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100e286d0] 0x100e2b130 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0524 11:36:22.798231    1534 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0524 11:36:23.149053    1534 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory

	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.

	I0524 11:36:23.149067    1534 machine.go:91] provisioned docker machine in 803.097167ms

	I0524 11:36:23.149073    1534 client.go:171] LocalClient.Create took 15.685539208s

	I0524 11:36:23.149079    1534 start.go:167] duration metric: libmachine.API.Create for "addons-514000" took 15.685619292s

	I0524 11:36:23.149084    1534 start.go:300] post-start starting for "addons-514000" (driver="qemu2")

	I0524 11:36:23.149087    1534 start.go:328] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0524 11:36:23.149151    1534 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0524 11:36:23.149161    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:23.182740    1534 ssh_runner.go:195] Run: cat /etc/os-release

	I0524 11:36:23.184182    1534 info.go:137] Remote host: Buildroot 2021.02.12

	I0524 11:36:23.184191    1534 filesync.go:126] Scanning /Users/jenkins/minikube-integration/16573-1024/.minikube/addons for local assets ...

	I0524 11:36:23.184263    1534 filesync.go:126] Scanning /Users/jenkins/minikube-integration/16573-1024/.minikube/files for local assets ...

	I0524 11:36:23.184291    1534 start.go:303] post-start completed in 35.204125ms

	I0524 11:36:23.184667    1534 profile.go:148] Saving config to /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/config.json ...

	I0524 11:36:23.184838    1534 start.go:128] duration metric: createHost completed in 16.099587584s

	I0524 11:36:23.184860    1534 main.go:141] libmachine: Using SSH client type: native

	I0524 11:36:23.185079    1534 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100e286d0] 0x100e2b130 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0524 11:36:23.185084    1534 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0524 11:36:23.240206    1534 main.go:141] libmachine: SSH cmd err, output: <nil>: 1684953383.421013085

	I0524 11:36:23.240212    1534 fix.go:207] guest clock: 1684953383.421013085

	I0524 11:36:23.240216    1534 fix.go:220] Guest: 2023-05-24 11:36:23.421013085 -0700 PDT Remote: 2023-05-24 11:36:23.184841 -0700 PDT m=+16.200821626 (delta=236.172085ms)

	I0524 11:36:23.240228    1534 fix.go:191] guest clock delta is within tolerance: 236.172085ms

	I0524 11:36:23.240231    1534 start.go:83] releasing machines lock for "addons-514000", held for 16.155020041s

	I0524 11:36:23.240534    1534 ssh_runner.go:195] Run: cat /version.json

	I0524 11:36:23.240542    1534 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0524 11:36:23.240552    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:23.240589    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:23.271294    1534 ssh_runner.go:195] Run: systemctl --version

	I0524 11:36:23.356274    1534 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0524 11:36:23.358206    1534 cni.go:208] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0524 11:36:23.358253    1534 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0524 11:36:23.363251    1534 cni.go:261] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0524 11:36:23.363272    1534 preload.go:132] Checking if preload exists for k8s version v1.27.2 and runtime docker

	I0524 11:36:23.363358    1534 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0524 11:36:23.374219    1534 docker.go:633] Got preloaded images: 

	I0524 11:36:23.374227    1534 docker.go:639] registry.k8s.io/kube-apiserver:v1.27.2 wasn't preloaded

	I0524 11:36:23.374272    1534 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I0524 11:36:23.377135    1534 ssh_runner.go:195] Run: which lz4

	I0524 11:36:23.378475    1534 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4

	I0524 11:36:23.379822    1534 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I0524 11:36:23.379833    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.2-docker-overlay2-arm64.tar.lz4 --> /preloaded.tar.lz4 (343635669 bytes)

	I0524 11:36:24.715030    1534 docker.go:597] Took 1.336609 seconds to copy over tarball

	I0524 11:36:24.715105    1534 ssh_runner.go:195] Run: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4

	I0524 11:36:25.802869    1534 ssh_runner.go:235] Completed: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4: (1.087750334s)

	I0524 11:36:25.802885    1534 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I0524 11:36:25.818539    1534 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I0524 11:36:25.821398    1534 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2629 bytes)

	I0524 11:36:25.826757    1534 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0524 11:36:25.912573    1534 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0524 11:36:27.259007    1534 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.346426625s)

	I0524 11:36:27.259050    1534 start.go:481] detecting cgroup driver to use...

	I0524 11:36:27.259161    1534 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0524 11:36:27.264502    1534 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"

	I0524 11:36:27.267902    1534 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I0524 11:36:27.271357    1534 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...

	I0524 11:36:27.271387    1534 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I0524 11:36:27.274823    1534 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0524 11:36:27.278019    1534 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I0524 11:36:27.280856    1534 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0524 11:36:27.283904    1534 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0524 11:36:27.287473    1534 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I0524 11:36:27.291108    1534 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0524 11:36:27.294288    1534 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0524 11:36:27.297250    1534 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0524 11:36:27.376117    1534 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I0524 11:36:27.384917    1534 start.go:481] detecting cgroup driver to use...

	I0524 11:36:27.384994    1534 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0524 11:36:27.390435    1534 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0524 11:36:27.395426    1534 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0524 11:36:27.402483    1534 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0524 11:36:27.406870    1534 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0524 11:36:27.411215    1534 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I0524 11:36:27.451530    1534 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0524 11:36:27.456795    1534 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0524 11:36:27.461922    1534 ssh_runner.go:195] Run: which cri-dockerd

	I0524 11:36:27.463049    1534 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I0524 11:36:27.465876    1534 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)

	I0524 11:36:27.470660    1534 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I0524 11:36:27.538638    1534 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I0524 11:36:27.616092    1534 docker.go:532] configuring docker to use "cgroupfs" as cgroup driver...

	I0524 11:36:27.616109    1534 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (144 bytes)

	I0524 11:36:27.621459    1534 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0524 11:36:27.708405    1534 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0524 11:36:28.851963    1534 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.143548708s)

	I0524 11:36:28.852015    1534 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I0524 11:36:28.939002    1534 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I0524 11:36:29.020013    1534 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I0524 11:36:29.108812    1534 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0524 11:36:29.187424    1534 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I0524 11:36:29.194801    1534 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0524 11:36:29.274472    1534 ssh_runner.go:195] Run: sudo systemctl restart cri-docker

	I0524 11:36:29.298400    1534 start.go:528] Will wait 60s for socket path /var/run/cri-dockerd.sock

	I0524 11:36:29.298499    1534 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0524 11:36:29.300633    1534 start.go:549] Will wait 60s for crictl version

	I0524 11:36:29.300681    1534 ssh_runner.go:195] Run: which crictl

	I0524 11:36:29.302069    1534 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0524 11:36:29.320125    1534 start.go:565] Version:  0.1.0

	RuntimeName:  docker

	RuntimeVersion:  20.10.23

	RuntimeApiVersion:  v1alpha2

	I0524 11:36:29.320196    1534 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0524 11:36:29.329425    1534 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0524 11:36:29.346012    1534 out.go:204] * Preparing Kubernetes v1.27.2 on Docker 20.10.23 ...

	I0524 11:36:29.346159    1534 ssh_runner.go:195] Run: grep 192.168.105.1	host.minikube.internal$ /etc/hosts

	I0524 11:36:29.347609    1534 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.105.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0524 11:36:29.351578    1534 preload.go:132] Checking if preload exists for k8s version v1.27.2 and runtime docker

	I0524 11:36:29.351619    1534 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0524 11:36:29.359168    1534 docker.go:633] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.27.2

	registry.k8s.io/kube-controller-manager:v1.27.2

	registry.k8s.io/kube-scheduler:v1.27.2

	registry.k8s.io/kube-proxy:v1.27.2

	registry.k8s.io/coredns/coredns:v1.10.1

	registry.k8s.io/etcd:3.5.7-0

	registry.k8s.io/pause:3.9

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I0524 11:36:29.359177    1534 docker.go:563] Images already preloaded, skipping extraction

	I0524 11:36:29.359234    1534 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0524 11:36:29.366578    1534 docker.go:633] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.27.2

	registry.k8s.io/kube-scheduler:v1.27.2

	registry.k8s.io/kube-controller-manager:v1.27.2

	registry.k8s.io/kube-proxy:v1.27.2

	registry.k8s.io/coredns/coredns:v1.10.1

	registry.k8s.io/etcd:3.5.7-0

	registry.k8s.io/pause:3.9

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I0524 11:36:29.366587    1534 cache_images.go:84] Images are preloaded, skipping loading

	I0524 11:36:29.366634    1534 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I0524 11:36:29.376722    1534 cni.go:84] Creating CNI manager for ""

	I0524 11:36:29.376734    1534 cni.go:157] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0524 11:36:29.376743    1534 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I0524 11:36:29.376755    1534 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.105.2 APIServerPort:8443 KubernetesVersion:v1.27.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-514000 NodeName:addons-514000 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.105.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.105.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/ku

bernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I0524 11:36:29.376831    1534 kubeadm.go:181] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.105.2

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/cri-dockerd.sock

	  name: "addons-514000"

	  kubeletExtraArgs:

	    node-ip: 192.168.105.2

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.105.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.27.2

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0524 11:36:29.376873    1534 kubeadm.go:971] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.27.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/cri-dockerd.sock --hostname-override=addons-514000 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.105.2

	[Install]

	 config:

	{KubernetesVersion:v1.27.2 ClusterName:addons-514000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I0524 11:36:29.376934    1534 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.27.2

	I0524 11:36:29.379950    1534 binaries.go:44] Found k8s binaries, skipping transfer

	I0524 11:36:29.379980    1534 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0524 11:36:29.383262    1534 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (375 bytes)

	I0524 11:36:29.388298    1534 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0524 11:36:29.393370    1534 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2099 bytes)

	I0524 11:36:29.398040    1534 ssh_runner.go:195] Run: grep 192.168.105.2	control-plane.minikube.internal$ /etc/hosts

	I0524 11:36:29.399441    1534 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.105.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0524 11:36:29.403560    1534 certs.go:56] Setting up /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000 for IP: 192.168.105.2

	I0524 11:36:29.403576    1534 certs.go:190] acquiring lock for shared ca certs: {Name:mk53f82f750243d1079819acfe50ecbc2a56595a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.403733    1534 certs.go:204] generating minikubeCA CA: /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.key

	I0524 11:36:29.494908    1534 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.crt ...

	I0524 11:36:29.494916    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.crt: {Name:mkde13471093958a457d9307a0c213d7ba461177 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.495144    1534 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.key ...

	I0524 11:36:29.495147    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.key: {Name:mk5b2a6f100829fa25412e4c96a6b4d9b186c9d1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.495264    1534 certs.go:204] generating proxyClientCA CA: /Users/jenkins/minikube-integration/16573-1024/.minikube/proxy-client-ca.key

	I0524 11:36:29.601357    1534 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/16573-1024/.minikube/proxy-client-ca.crt ...

	I0524 11:36:29.601364    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/proxy-client-ca.crt: {Name:mkc3f94501092c9c51cfa6d329a0a2c4cec184ab Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.601593    1534 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/16573-1024/.minikube/proxy-client-ca.key ...

	I0524 11:36:29.601596    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/proxy-client-ca.key: {Name:mk7acf18000a82a656fee32bbd454a3c129dabde Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.601733    1534 certs.go:319] generating minikube-user signed cert: /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/client.key

	I0524 11:36:29.601741    1534 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/client.crt with IP's: []

	I0524 11:36:29.653842    1534 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/client.crt ...

	I0524 11:36:29.653845    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/client.crt: {Name:mk3856cd37d1f07be2cc9902b19f9498b880112f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.654036    1534 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/client.key ...

	I0524 11:36:29.654040    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/client.key: {Name:mkbc8808085e1496dcb2b3e03156e443b7b7994b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.654176    1534 certs.go:319] generating minikube signed cert: /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.key.96055969

	I0524 11:36:29.654188    1534 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.crt.96055969 with IP's: [192.168.105.2 10.96.0.1 127.0.0.1 10.0.0.1]

	I0524 11:36:29.724674    1534 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.crt.96055969 ...

	I0524 11:36:29.724678    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.crt.96055969: {Name:mk424188d0f28cb0aa520452bb8ec4583a153ec6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.724815    1534 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.key.96055969 ...

	I0524 11:36:29.724818    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.key.96055969: {Name:mk98c3231c62717b32e2418cabd759d6ad5645ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.724926    1534 certs.go:337] copying /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.crt.96055969 -> /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.crt

	I0524 11:36:29.725147    1534 certs.go:341] copying /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.key.96055969 -> /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.key

	I0524 11:36:29.725241    1534 certs.go:319] generating aggregator signed cert: /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/proxy-client.key

	I0524 11:36:29.725256    1534 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/proxy-client.crt with IP's: []

	I0524 11:36:29.842949    1534 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/proxy-client.crt ...

	I0524 11:36:29.842953    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/proxy-client.crt: {Name:mk581c30062675e68aafc25cb79bfc8a62fd3e41 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.843105    1534 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/proxy-client.key ...

	I0524 11:36:29.843110    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/proxy-client.key: {Name:mk019f6bac347a368012a36cea939860ce210025 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.843389    1534 certs.go:437] found cert: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca-key.pem (1675 bytes)

	I0524 11:36:29.843593    1534 certs.go:437] found cert: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca.pem (1078 bytes)

	I0524 11:36:29.843619    1534 certs.go:437] found cert: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/cert.pem (1123 bytes)

	I0524 11:36:29.843756    1534 certs.go:437] found cert: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/key.pem (1675 bytes)

	I0524 11:36:29.844302    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I0524 11:36:29.851879    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0524 11:36:29.859249    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0524 11:36:29.866847    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I0524 11:36:29.873646    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0524 11:36:29.880415    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0524 11:36:29.887466    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0524 11:36:29.894575    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0524 11:36:29.901581    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0524 11:36:29.908027    1534 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0524 11:36:29.914140    1534 ssh_runner.go:195] Run: openssl version

	I0524 11:36:29.916182    1534 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0524 11:36:29.919659    1534 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0524 11:36:29.921372    1534 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 May 24 18:36 /usr/share/ca-certificates/minikubeCA.pem

	I0524 11:36:29.921394    1534 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0524 11:36:29.923349    1534 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0524 11:36:29.926902    1534 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd

	I0524 11:36:29.928503    1534 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory

	I0524 11:36:29.928540    1534 kubeadm.go:404] StartCluster: {Name:addons-514000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/16501/minikube-v1.30.1-1684536668-16501-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684536746-16501@sha256:f5d93abf1d1cfb142a7cf0b58b24029595d621e5f943105b16c61199094d77de Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v

1.27.2 ClusterName:addons-514000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.105.2 Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 Mount

Options:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}

	I0524 11:36:29.928599    1534 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0524 11:36:29.935998    1534 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0524 11:36:29.939589    1534 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0524 11:36:29.942818    1534 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0524 11:36:29.945835    1534 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0524 11:36:29.945853    1534 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.27.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"

	I0524 11:36:29.967889    1534 kubeadm.go:322] [init] Using Kubernetes version: v1.27.2

	I0524 11:36:29.967941    1534 kubeadm.go:322] [preflight] Running pre-flight checks

	I0524 11:36:30.020294    1534 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster

	I0524 11:36:30.020350    1534 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I0524 11:36:30.020400    1534 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	I0524 11:36:30.076237    1534 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I0524 11:36:30.084415    1534 out.go:204]   - Generating certificates and keys ...

	I0524 11:36:30.084460    1534 kubeadm.go:322] [certs] Using existing ca certificate authority

	I0524 11:36:30.084494    1534 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk

	I0524 11:36:30.272940    1534 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key

	I0524 11:36:30.453046    1534 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key

	I0524 11:36:30.580586    1534 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key

	I0524 11:36:30.639773    1534 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key

	I0524 11:36:30.738497    1534 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key

	I0524 11:36:30.738567    1534 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [addons-514000 localhost] and IPs [192.168.105.2 127.0.0.1 ::1]

	I0524 11:36:30.858811    1534 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key

	I0524 11:36:30.858875    1534 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [addons-514000 localhost] and IPs [192.168.105.2 127.0.0.1 ::1]

	I0524 11:36:30.935967    1534 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key

	I0524 11:36:30.967281    1534 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key

	I0524 11:36:31.073416    1534 kubeadm.go:322] [certs] Generating "sa" key and public key

	I0524 11:36:31.073445    1534 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I0524 11:36:31.335469    1534 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file

	I0524 11:36:31.530915    1534 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I0524 11:36:31.573436    1534 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I0524 11:36:31.637219    1534 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I0524 11:36:31.645102    1534 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I0524 11:36:31.645531    1534 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I0524 11:36:31.645571    1534 kubeadm.go:322] [kubelet-start] Starting the kubelet

	I0524 11:36:31.737201    1534 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I0524 11:36:31.741345    1534 out.go:204]   - Booting up control plane ...

	I0524 11:36:31.741390    1534 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I0524 11:36:31.741439    1534 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I0524 11:36:31.741469    1534 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I0524 11:36:31.741512    1534 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I0524 11:36:31.741595    1534 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	I0524 11:36:35.739695    1534 kubeadm.go:322] [apiclient] All control plane components are healthy after 4.002246 seconds

	I0524 11:36:35.739796    1534 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I0524 11:36:35.750536    1534 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I0524 11:36:36.270805    1534 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs

	I0524 11:36:36.271028    1534 kubeadm.go:322] [mark-control-plane] Marking the node addons-514000 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I0524 11:36:36.776691    1534 kubeadm.go:322] [bootstrap-token] Using token: zlw52u.ca0agirmjwjpmd4f

	I0524 11:36:36.783931    1534 out.go:204]   - Configuring RBAC rules ...

	I0524 11:36:36.784005    1534 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I0524 11:36:36.785227    1534 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I0524 11:36:36.791945    1534 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I0524 11:36:36.793322    1534 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I0524 11:36:36.794557    1534 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I0524 11:36:36.795891    1534 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I0524 11:36:36.802617    1534 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I0524 11:36:36.956552    1534 kubeadm.go:322] [addons] Applied essential addon: CoreDNS

	I0524 11:36:37.187637    1534 kubeadm.go:322] [addons] Applied essential addon: kube-proxy

	I0524 11:36:37.187937    1534 kubeadm.go:322] 

	I0524 11:36:37.187967    1534 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!

	I0524 11:36:37.187973    1534 kubeadm.go:322] 

	I0524 11:36:37.188044    1534 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:

	I0524 11:36:37.188053    1534 kubeadm.go:322] 

	I0524 11:36:37.188069    1534 kubeadm.go:322]   mkdir -p $HOME/.kube

	I0524 11:36:37.188099    1534 kubeadm.go:322]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I0524 11:36:37.188128    1534 kubeadm.go:322]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I0524 11:36:37.188133    1534 kubeadm.go:322] 

	I0524 11:36:37.188155    1534 kubeadm.go:322] Alternatively, if you are the root user, you can run:

	I0524 11:36:37.188158    1534 kubeadm.go:322] 

	I0524 11:36:37.188189    1534 kubeadm.go:322]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I0524 11:36:37.188193    1534 kubeadm.go:322] 

	I0524 11:36:37.188219    1534 kubeadm.go:322] You should now deploy a pod network to the cluster.

	I0524 11:36:37.188277    1534 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I0524 11:36:37.188314    1534 kubeadm.go:322]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I0524 11:36:37.188322    1534 kubeadm.go:322] 

	I0524 11:36:37.188361    1534 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities

	I0524 11:36:37.188399    1534 kubeadm.go:322] and service account keys on each node and then running the following as root:

	I0524 11:36:37.188411    1534 kubeadm.go:322] 

	I0524 11:36:37.188464    1534 kubeadm.go:322]   kubeadm join control-plane.minikube.internal:8443 --token zlw52u.ca0agirmjwjpmd4f \

	I0524 11:36:37.188516    1534 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:31e7298e5fe39dd9013d3c0dfbef354d505381f39a7a09e3b4af334242438797 \

	I0524 11:36:37.188534    1534 kubeadm.go:322] 	--control-plane 

	I0524 11:36:37.188538    1534 kubeadm.go:322] 

	I0524 11:36:37.188580    1534 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:

	I0524 11:36:37.188584    1534 kubeadm.go:322] 

	I0524 11:36:37.188629    1534 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token zlw52u.ca0agirmjwjpmd4f \

	I0524 11:36:37.188681    1534 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:31e7298e5fe39dd9013d3c0dfbef354d505381f39a7a09e3b4af334242438797 

	I0524 11:36:37.188736    1534 kubeadm.go:322] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I0524 11:36:37.188819    1534 kubeadm.go:322] W0524 18:36:30.200947    1295 images.go:80] could not find officially supported version of etcd for Kubernetes v1.27.2, falling back to the nearest etcd version (3.5.7-0)

	I0524 11:36:37.188904    1534 kubeadm.go:322] W0524 18:36:31.916526    1295 images.go:80] could not find officially supported version of etcd for Kubernetes v1.27.2, falling back to the nearest etcd version (3.5.7-0)

	I0524 11:36:37.188909    1534 cni.go:84] Creating CNI manager for ""

	I0524 11:36:37.188916    1534 cni.go:157] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0524 11:36:37.195686    1534 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...

	I0524 11:36:37.199715    1534 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d

	I0524 11:36:37.203087    1534 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)

	I0524 11:36:37.208259    1534 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0524 11:36:37.208303    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:37.208333    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl label nodes minikube.k8s.io/version=v1.30.1 minikube.k8s.io/commit=d23ad66c17ded3bf1d7d6fb0fa0ee29881f9547e minikube.k8s.io/name=addons-514000 minikube.k8s.io/updated_at=2023_05_24T11_36_37_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:37.258566    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:37.271047    1534 ops.go:34] apiserver oom_adj: -16

	I0524 11:36:37.796169    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:38.296162    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:38.796257    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:39.295049    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:39.796244    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:40.296250    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:40.796162    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:41.296458    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:41.796245    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:42.296250    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:42.796323    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:43.296423    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:43.796432    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:44.296246    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:44.796149    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:45.296189    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:45.796183    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:46.296206    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:46.796370    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:47.296192    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:47.796245    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:48.296219    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:48.796135    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:49.296201    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:49.796192    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:50.296070    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:50.332878    1534 kubeadm.go:1076] duration metric: took 13.124695208s to wait for elevateKubeSystemPrivileges.

	I0524 11:36:50.332892    1534 kubeadm.go:406] StartCluster complete in 20.404490625s

	I0524 11:36:50.332916    1534 settings.go:142] acquiring lock: {Name:mke0e8586c5ffdfb76a30452ad9385e81e1593cb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:50.333079    1534 settings.go:150] Updating kubeconfig:  /Users/jenkins/minikube-integration/16573-1024/kubeconfig

	I0524 11:36:50.333301    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/kubeconfig: {Name:mkd6a5851332ae81ab607caaee690ec1266dd411 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:50.333499    1534 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.27.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0524 11:36:50.333541    1534 addons.go:496] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:true]

	I0524 11:36:50.333603    1534 addons.go:66] Setting ingress=true in profile "addons-514000"

	I0524 11:36:50.333609    1534 addons.go:66] Setting registry=true in profile "addons-514000"

	I0524 11:36:50.333611    1534 addons.go:228] Setting addon ingress=true in "addons-514000"

	I0524 11:36:50.333614    1534 addons.go:228] Setting addon registry=true in "addons-514000"

	I0524 11:36:50.333650    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.333646    1534 addons.go:66] Setting csi-hostpath-driver=true in profile "addons-514000"

	I0524 11:36:50.333656    1534 addons.go:66] Setting storage-provisioner=true in profile "addons-514000"

	I0524 11:36:50.333660    1534 addons.go:228] Setting addon storage-provisioner=true in "addons-514000"

	I0524 11:36:50.333671    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.333804    1534 addons.go:66] Setting metrics-server=true in profile "addons-514000"

	I0524 11:36:50.333879    1534 addons.go:228] Setting addon metrics-server=true in "addons-514000"

	I0524 11:36:50.333906    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.333926    1534 addons.go:228] Setting addon csi-hostpath-driver=true in "addons-514000"

	I0524 11:36:50.333947    1534 config.go:182] Loaded profile config "addons-514000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.27.2

	I0524 11:36:50.333682    1534 addons.go:66] Setting ingress-dns=true in profile "addons-514000"

	I0524 11:36:50.333976    1534 addons.go:228] Setting addon ingress-dns=true in "addons-514000"

	I0524 11:36:50.333995    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.334035    1534 addons.go:66] Setting gcp-auth=true in profile "addons-514000"

	I0524 11:36:50.333605    1534 addons.go:66] Setting volumesnapshots=true in profile "addons-514000"

	I0524 11:36:50.334092    1534 addons.go:228] Setting addon volumesnapshots=true in "addons-514000"

	I0524 11:36:50.334116    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.334159    1534 addons.go:66] Setting default-storageclass=true in profile "addons-514000"

	I0524 11:36:50.334172    1534 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-514000"

	I0524 11:36:50.333653    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.334095    1534 mustload.go:65] Loading cluster: addons-514000

	I0524 11:36:50.334706    1534 addons.go:66] Setting inspektor-gadget=true in profile "addons-514000"

	I0524 11:36:50.334713    1534 addons.go:228] Setting addon inspektor-gadget=true in "addons-514000"

	I0524 11:36:50.333694    1534 addons.go:66] Setting cloud-spanner=true in profile "addons-514000"

	I0524 11:36:50.334861    1534 addons.go:228] Setting addon cloud-spanner=true in "addons-514000"

	I0524 11:36:50.334877    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.334897    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.334942    1534 host.go:66] Checking if "addons-514000" exists ...

	W0524 11:36:50.335292    1534 host.go:54] host status for "addons-514000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor: connect: connection refused

	W0524 11:36:50.335303    1534 addons.go:274] "addons-514000" is not running, setting metrics-server=true and skipping enablement (err=<nil>)

	I0524 11:36:50.335306    1534 addons.go:464] Verifying addon metrics-server=true in "addons-514000"

	W0524 11:36:50.335329    1534 host.go:54] host status for "addons-514000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor: connect: connection refused

	W0524 11:36:50.335333    1534 addons.go:274] "addons-514000" is not running, setting ingress-dns=true and skipping enablement (err=<nil>)

	W0524 11:36:50.335353    1534 host.go:54] host status for "addons-514000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor: connect: connection refused

	W0524 11:36:50.335359    1534 addons.go:274] "addons-514000" is not running, setting registry=true and skipping enablement (err=<nil>)

	I0524 11:36:50.335362    1534 addons.go:464] Verifying addon registry=true in "addons-514000"

	W0524 11:36:50.335391    1534 host.go:54] host status for "addons-514000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor: connect: connection refused

	I0524 11:36:50.339535    1534 out.go:177] * Verifying registry addon...

	W0524 11:36:50.335411    1534 addons.go:274] "addons-514000" is not running, setting ingress=true and skipping enablement (err=<nil>)

	W0524 11:36:50.335412    1534 host.go:54] host status for "addons-514000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor: connect: connection refused

	W0524 11:36:50.335520    1534 host.go:54] host status for "addons-514000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor: connect: connection refused

	W0524 11:36:50.335588    1534 host.go:54] host status for "addons-514000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor: connect: connection refused

	I0524 11:36:50.335599    1534 config.go:182] Loaded profile config "addons-514000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.27.2

	W0524 11:36:50.335650    1534 host.go:54] host status for "addons-514000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor: connect: connection refused

	W0524 11:36:50.349556    1534 addons.go:274] "addons-514000" is not running, setting csi-hostpath-driver=true and skipping enablement (err=<nil>)

	W0524 11:36:50.349673    1534 addons.go:274] "addons-514000" is not running, setting cloud-spanner=true and skipping enablement (err=<nil>)

	I0524 11:36:50.349673    1534 addons.go:464] Verifying addon ingress=true in "addons-514000"

	W0524 11:36:50.349688    1534 addons_storage_classes.go:55] "addons-514000" is not running, writing default-storageclass=true to disk and skipping enablement

	W0524 11:36:50.349678    1534 addons.go:274] "addons-514000" is not running, setting inspektor-gadget=true and skipping enablement (err=<nil>)

	I0524 11:36:50.350008    1534 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...

	I0524 11:36:50.350257    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.353441    1534 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0524 11:36:50.357663    1534 addons.go:228] Setting addon default-storageclass=true in "addons-514000"

	I0524 11:36:50.360618    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.360641    1534 addons.go:420] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0524 11:36:50.360646    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0524 11:36:50.360653    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:50.365539    1534 out.go:177] * Verifying ingress addon...

	I0524 11:36:50.357776    1534 out.go:177]   - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0

	I0524 11:36:50.357776    1534 addons.go:464] Verifying addon csi-hostpath-driver=true in "addons-514000"

	I0524 11:36:50.361446    1534 addons.go:420] installing /etc/kubernetes/addons/storageclass.yaml

	I0524 11:36:50.364279    1534 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=registry

	I0524 11:36:50.381598    1534 out.go:177] * Verifying csi-hostpath-driver addon...

	I0524 11:36:50.369698    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0524 11:36:50.369727    1534 addons.go:420] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml

	I0524 11:36:50.375900    1534 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...

	I0524 11:36:50.387638    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)

	I0524 11:36:50.387638    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:50.387646    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:50.388147    1534 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...

	I0524 11:36:50.390627    1534 kapi.go:86] Found 0 Pods for label selector app.kubernetes.io/name=ingress-nginx

	I0524 11:36:50.391169    1534 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver

	I0524 11:36:50.400375    1534 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.27.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.105.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.27.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0524 11:36:50.433263    1534 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0524 11:36:50.499595    1534 addons.go:420] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml

	I0524 11:36:50.499607    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)

	I0524 11:36:50.511369    1534 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0524 11:36:50.545082    1534 addons.go:420] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml

	I0524 11:36:50.545093    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)

	I0524 11:36:50.571075    1534 addons.go:420] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml

	I0524 11:36:50.571085    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)

	I0524 11:36:50.614490    1534 addons.go:420] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml

	I0524 11:36:50.614502    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)

	I0524 11:36:50.628252    1534 addons.go:420] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0524 11:36:50.628261    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)

	I0524 11:36:50.647925    1534 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0524 11:36:50.858973    1534 kapi.go:248] "coredns" deployment in "kube-system" namespace and "addons-514000" context rescaled to 1 replicas

	I0524 11:36:50.859000    1534 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.105.2 Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0524 11:36:50.862644    1534 out.go:177] * Verifying Kubernetes components...

	I0524 11:36:50.870714    1534 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0524 11:36:51.015230    1534 start.go:916] {"host.minikube.internal": 192.168.105.1} host record injected into CoreDNS's ConfigMap

	W0524 11:36:51.239743    1534 addons.go:446] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I0524 11:36:51.239769    1534 retry.go:31] will retry after 300.967986ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I0524 11:36:51.240163    1534 node_ready.go:35] waiting up to 6m0s for node "addons-514000" to be "Ready" ...

	I0524 11:36:51.242031    1534 node_ready.go:49] node "addons-514000" has status "Ready":"True"

	I0524 11:36:51.242040    1534 node_ready.go:38] duration metric: took 1.869375ms waiting for node "addons-514000" to be "Ready" ...

	I0524 11:36:51.242043    1534 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0524 11:36:51.247820    1534 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5d78c9869d-dmkfx" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:51.542933    1534 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.2/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0524 11:36:53.257970    1534 pod_ready.go:92] pod "coredns-5d78c9869d-dmkfx" in "kube-system" namespace has status "Ready":"True"

	I0524 11:36:53.257986    1534 pod_ready.go:81] duration metric: took 2.01016425s waiting for pod "coredns-5d78c9869d-dmkfx" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.257991    1534 pod_ready.go:78] waiting up to 6m0s for pod "etcd-addons-514000" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.260855    1534 pod_ready.go:92] pod "etcd-addons-514000" in "kube-system" namespace has status "Ready":"True"

	I0524 11:36:53.260862    1534 pod_ready.go:81] duration metric: took 2.866833ms waiting for pod "etcd-addons-514000" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.260867    1534 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-addons-514000" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.263593    1534 pod_ready.go:92] pod "kube-apiserver-addons-514000" in "kube-system" namespace has status "Ready":"True"

	I0524 11:36:53.263598    1534 pod_ready.go:81] duration metric: took 2.728ms waiting for pod "kube-apiserver-addons-514000" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.263603    1534 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-addons-514000" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.266314    1534 pod_ready.go:92] pod "kube-controller-manager-addons-514000" in "kube-system" namespace has status "Ready":"True"

	I0524 11:36:53.266322    1534 pod_ready.go:81] duration metric: took 2.716417ms waiting for pod "kube-controller-manager-addons-514000" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.266326    1534 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-2gj6m" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.268820    1534 pod_ready.go:92] pod "kube-proxy-2gj6m" in "kube-system" namespace has status "Ready":"True"

	I0524 11:36:53.268826    1534 pod_ready.go:81] duration metric: took 2.496209ms waiting for pod "kube-proxy-2gj6m" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.268830    1534 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-addons-514000" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.659694    1534 pod_ready.go:92] pod "kube-scheduler-addons-514000" in "kube-system" namespace has status "Ready":"True"

	I0524 11:36:53.659709    1534 pod_ready.go:81] duration metric: took 390.87725ms waiting for pod "kube-scheduler-addons-514000" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.659719    1534 pod_ready.go:38] duration metric: took 2.417685875s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0524 11:36:53.659737    1534 api_server.go:52] waiting for apiserver process to appear ...

	I0524 11:36:53.659818    1534 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0524 11:36:54.012047    1534 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.2/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (2.469105375s)

	I0524 11:36:54.012061    1534 api_server.go:72] duration metric: took 3.153054583s to wait for apiserver process to appear ...

	I0524 11:36:54.012066    1534 api_server.go:88] waiting for apiserver healthz status ...

	I0524 11:36:54.012074    1534 api_server.go:253] Checking apiserver healthz at https://192.168.105.2:8443/healthz ...

	I0524 11:36:54.015086    1534 api_server.go:279] https://192.168.105.2:8443/healthz returned 200:

	ok

	I0524 11:36:54.015747    1534 api_server.go:141] control plane version: v1.27.2

	I0524 11:36:54.015755    1534 api_server.go:131] duration metric: took 3.685917ms to wait for apiserver health ...

	I0524 11:36:54.015758    1534 system_pods.go:43] waiting for kube-system pods to appear ...

	I0524 11:36:54.018844    1534 system_pods.go:59] 9 kube-system pods found

	I0524 11:36:54.018857    1534 system_pods.go:61] "coredns-5d78c9869d-dmkfx" [03f7079a-733f-488e-a6b1-65e0ca65cffe] Running

	I0524 11:36:54.018861    1534 system_pods.go:61] "etcd-addons-514000" [f53490df-9f65-472d-8c24-fedfb5ff0b40] Running

	I0524 11:36:54.018863    1534 system_pods.go:61] "kube-apiserver-addons-514000" [39ad1080-0c49-4108-8f04-7aded262c978] Running

	I0524 11:36:54.018865    1534 system_pods.go:61] "kube-controller-manager-addons-514000" [8aed5f2f-4439-495f-9454-34920caed37f] Running

	I0524 11:36:54.018868    1534 system_pods.go:61] "kube-proxy-2gj6m" [8d0787ef-32df-4a09-ad1d-48a69a40bb43] Running

	I0524 11:36:54.018870    1534 system_pods.go:61] "kube-scheduler-addons-514000" [98ce7db6-4f70-4fb1-992f-7cf2bf68fb43] Running

	I0524 11:36:54.018873    1534 system_pods.go:61] "snapshot-controller-75bbb956b9-j5jhp" [953964d7-20b0-4fa4-b1ca-f05e6adb94e3] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0524 11:36:54.018876    1534 system_pods.go:61] "snapshot-controller-75bbb956b9-txrxl" [07fe4bd3-7311-4ec4-938d-a195ed8535a8] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0524 11:36:54.018879    1534 system_pods.go:61] "storage-provisioner" [49765353-a5e1-4781-ab06-a554a575daa5] Running

	I0524 11:36:54.018881    1534 system_pods.go:74] duration metric: took 3.121167ms to wait for pod list to return data ...

	I0524 11:36:54.018883    1534 default_sa.go:34] waiting for default service account to be created ...

	I0524 11:36:54.057892    1534 default_sa.go:45] found service account: "default"

	I0524 11:36:54.057899    1534 default_sa.go:55] duration metric: took 39.013541ms for default service account to be created ...

	I0524 11:36:54.057902    1534 system_pods.go:116] waiting for k8s-apps to be running ...

	I0524 11:36:54.259995    1534 system_pods.go:86] 9 kube-system pods found

	I0524 11:36:54.260005    1534 system_pods.go:89] "coredns-5d78c9869d-dmkfx" [03f7079a-733f-488e-a6b1-65e0ca65cffe] Running

	I0524 11:36:54.260008    1534 system_pods.go:89] "etcd-addons-514000" [f53490df-9f65-472d-8c24-fedfb5ff0b40] Running

	I0524 11:36:54.260011    1534 system_pods.go:89] "kube-apiserver-addons-514000" [39ad1080-0c49-4108-8f04-7aded262c978] Running

	I0524 11:36:54.260014    1534 system_pods.go:89] "kube-controller-manager-addons-514000" [8aed5f2f-4439-495f-9454-34920caed37f] Running

	I0524 11:36:54.260016    1534 system_pods.go:89] "kube-proxy-2gj6m" [8d0787ef-32df-4a09-ad1d-48a69a40bb43] Running

	I0524 11:36:54.260019    1534 system_pods.go:89] "kube-scheduler-addons-514000" [98ce7db6-4f70-4fb1-992f-7cf2bf68fb43] Running

	I0524 11:36:54.260023    1534 system_pods.go:89] "snapshot-controller-75bbb956b9-j5jhp" [953964d7-20b0-4fa4-b1ca-f05e6adb94e3] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0524 11:36:54.260027    1534 system_pods.go:89] "snapshot-controller-75bbb956b9-txrxl" [07fe4bd3-7311-4ec4-938d-a195ed8535a8] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0524 11:36:54.260030    1534 system_pods.go:89] "storage-provisioner" [49765353-a5e1-4781-ab06-a554a575daa5] Running

	I0524 11:36:54.260033    1534 system_pods.go:126] duration metric: took 202.129584ms to wait for k8s-apps to be running ...

	I0524 11:36:54.260037    1534 system_svc.go:44] waiting for kubelet service to be running ....

	I0524 11:36:54.260088    1534 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0524 11:36:54.265390    1534 system_svc.go:56] duration metric: took 5.350666ms WaitForService to wait for kubelet.

	I0524 11:36:54.265399    1534 kubeadm.go:581] duration metric: took 3.406395625s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...

	I0524 11:36:54.265408    1534 node_conditions.go:102] verifying NodePressure condition ...

	I0524 11:36:54.458086    1534 node_conditions.go:122] node storage ephemeral capacity is 17784760Ki

	I0524 11:36:54.458097    1534 node_conditions.go:123] node cpu capacity is 2

	I0524 11:36:54.458103    1534 node_conditions.go:105] duration metric: took 192.694167ms to run NodePressure ...

	I0524 11:36:54.458107    1534 start.go:228] waiting for startup goroutines ...

	I0524 11:36:56.972492    1534 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)

	I0524 11:36:56.972559    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:57.029376    1534 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)

	I0524 11:36:57.038824    1534 addons.go:228] Setting addon gcp-auth=true in "addons-514000"

	I0524 11:36:57.038864    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:57.040182    1534 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json

	I0524 11:36:57.040196    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:57.078053    1534 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20230312-helm-chart-4.5.2-28-g66a760794

	I0524 11:36:57.082115    1534 out.go:177]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.0

	I0524 11:36:57.085015    1534 addons.go:420] installing /etc/kubernetes/addons/gcp-auth-ns.yaml

	I0524 11:36:57.085022    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)

	I0524 11:36:57.091862    1534 addons.go:420] installing /etc/kubernetes/addons/gcp-auth-service.yaml

	I0524 11:36:57.091873    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)

	I0524 11:36:57.099462    1534 addons.go:420] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I0524 11:36:57.099472    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5474 bytes)

	I0524 11:36:57.106631    1534 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.2/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I0524 11:36:57.550488    1534 addons.go:464] Verifying addon gcp-auth=true in "addons-514000"

	I0524 11:36:57.555392    1534 out.go:177] * Verifying gcp-auth addon...

	I0524 11:36:57.561721    1534 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...

	I0524 11:36:57.566760    1534 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth

	I0524 11:36:57.566769    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:36:58.070711    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:36:58.570942    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:36:59.076515    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:36:59.570540    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:00.070962    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:00.571104    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:01.071573    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:01.571018    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:02.072518    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:02.570869    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:03.071445    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:03.570661    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:04.070807    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:04.570832    1534 kapi.go:107] duration metric: took 7.009157292s to wait for kubernetes.io/minikube-addons=gcp-auth ...

	I0524 11:37:04.574809    1534 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-514000 cluster.

	I0524 11:37:04.579620    1534 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.

	I0524 11:37:04.583658    1534 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.

	I0524 11:42:50.357445    1534 kapi.go:107] duration metric: took 6m0.009773291s to wait for kubernetes.io/minikube-addons=registry ...

	W0524 11:42:50.357907    1534 out.go:239] ! Enabling 'registry' returned an error: running callbacks: [waiting for kubernetes.io/minikube-addons=registry pods: context deadline exceeded]

	I0524 11:42:50.387243    1534 kapi.go:107] duration metric: took 6m0.001495875s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...

	I0524 11:42:50.387315    1534 kapi.go:107] duration metric: took 6m0.013814333s to wait for app.kubernetes.io/name=ingress-nginx ...

	W0524 11:42:50.387474    1534 out.go:239] ! Enabling 'csi-hostpath-driver' returned an error: running callbacks: [waiting for kubernetes.io/minikube-addons=csi-hostpath-driver pods: context deadline exceeded]

	W0524 11:42:50.387474    1534 out.go:239] ! Enabling 'ingress' returned an error: running callbacks: [waiting for app.kubernetes.io/name=ingress-nginx pods: context deadline exceeded]

	I0524 11:42:50.395532    1534 out.go:177] * Enabled addons: metrics-server, ingress-dns, inspektor-gadget, cloud-spanner, storage-provisioner, default-storageclass, volumesnapshots, gcp-auth

	I0524 11:42:50.403494    1534 addons.go:499] enable addons completed in 6m0.072361709s: enabled=[metrics-server ingress-dns inspektor-gadget cloud-spanner storage-provisioner default-storageclass volumesnapshots gcp-auth]

	I0524 11:42:50.403556    1534 start.go:233] waiting for cluster config update ...

	I0524 11:42:50.403587    1534 start.go:242] writing updated cluster config ...

	I0524 11:42:50.408325    1534 ssh_runner.go:195] Run: rm -f paused

	I0524 11:42:50.568016    1534 start.go:568] kubectl: 1.25.9, cluster: 1.27.2 (minor skew: 2)

	I0524 11:42:50.572568    1534 out.go:177] 

	W0524 11:42:50.576443    1534 out.go:239] ! /usr/local/bin/kubectl is version 1.25.9, which may have incompatibilities with Kubernetes 1.27.2.

	I0524 11:42:50.580476    1534 out.go:177]   - Want kubectl v1.27.2? Try 'minikube kubectl -- get pods -A'

	I0524 11:42:50.587567    1534 out.go:177] * Done! kubectl is now configured to use "addons-514000" cluster and "default" namespace by default

	* 

	* ==> Docker <==

	* -- Journal begins at Wed 2023-05-24 18:36:19 UTC, ends at Wed 2023-05-24 18:54:50 UTC. --

	May 24 18:37:01 addons-514000 dockerd[922]: time="2023-05-24T18:37:01.516120296Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	May 24 18:37:01 addons-514000 dockerd[922]: time="2023-05-24T18:37:01.516129229Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	May 24 18:37:01 addons-514000 dockerd[916]: time="2023-05-24T18:37:01.568789730Z" level=info msg="ignoring event" container=1c671f6b3a5b5c85e0407b694ee5e6e8a1a70743c986a11000612952822acf1e module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 24 18:37:01 addons-514000 dockerd[922]: time="2023-05-24T18:37:01.569050551Z" level=info msg="shim disconnected" id=1c671f6b3a5b5c85e0407b694ee5e6e8a1a70743c986a11000612952822acf1e namespace=moby

	May 24 18:37:01 addons-514000 dockerd[922]: time="2023-05-24T18:37:01.569107330Z" level=warning msg="cleaning up after shim disconnected" id=1c671f6b3a5b5c85e0407b694ee5e6e8a1a70743c986a11000612952822acf1e namespace=moby

	May 24 18:37:01 addons-514000 dockerd[922]: time="2023-05-24T18:37:01.569117420Z" level=info msg="cleaning up dead shim" namespace=moby

	May 24 18:37:01 addons-514000 dockerd[922]: time="2023-05-24T18:37:01.607638824Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	May 24 18:37:01 addons-514000 dockerd[922]: time="2023-05-24T18:37:01.607702137Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	May 24 18:37:01 addons-514000 dockerd[922]: time="2023-05-24T18:37:01.607716942Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	May 24 18:37:01 addons-514000 dockerd[922]: time="2023-05-24T18:37:01.607727942Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	May 24 18:37:01 addons-514000 cri-dockerd[1138]: time="2023-05-24T18:37:01Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/f47df037d99569ad6cd8f4ef2c3926ab0aed2bb5b85f513c520fc0abc42c67f3/resolv.conf as [nameserver 10.96.0.10 search gcp-auth.svc.cluster.local svc.cluster.local cluster.local options ndots:5]"

	May 24 18:37:01 addons-514000 dockerd[916]: time="2023-05-24T18:37:01.953788187Z" level=warning msg="reference for unknown type: " digest="sha256:d730651bb6584f969d95d8279a754cf9d8d31b5055c43dbdb8d7363a8c6371cf" remote="gcr.io/k8s-minikube/gcp-auth-webhook@sha256:d730651bb6584f969d95d8279a754cf9d8d31b5055c43dbdb8d7363a8c6371cf"

	May 24 18:37:02 addons-514000 dockerd[922]: time="2023-05-24T18:37:02.557702813Z" level=info msg="shim disconnected" id=953c17ffdc8ac0b98e66b9d8887f99c9b0a49236e6fd43f2647edb75c5e82150 namespace=moby

	May 24 18:37:02 addons-514000 dockerd[922]: time="2023-05-24T18:37:02.557754555Z" level=warning msg="cleaning up after shim disconnected" id=953c17ffdc8ac0b98e66b9d8887f99c9b0a49236e6fd43f2647edb75c5e82150 namespace=moby

	May 24 18:37:02 addons-514000 dockerd[922]: time="2023-05-24T18:37:02.557759977Z" level=info msg="cleaning up dead shim" namespace=moby

	May 24 18:37:02 addons-514000 dockerd[916]: time="2023-05-24T18:37:02.558086156Z" level=info msg="ignoring event" container=953c17ffdc8ac0b98e66b9d8887f99c9b0a49236e6fd43f2647edb75c5e82150 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 24 18:37:03 addons-514000 dockerd[916]: time="2023-05-24T18:37:03.602683250Z" level=info msg="ignoring event" container=7c145b5b88ef04d8237d20d8374f3a2c4283c8c7c120b4d01e6d9eda3df3496d module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 24 18:37:03 addons-514000 dockerd[922]: time="2023-05-24T18:37:03.603089611Z" level=info msg="shim disconnected" id=7c145b5b88ef04d8237d20d8374f3a2c4283c8c7c120b4d01e6d9eda3df3496d namespace=moby

	May 24 18:37:03 addons-514000 dockerd[922]: time="2023-05-24T18:37:03.603147527Z" level=warning msg="cleaning up after shim disconnected" id=7c145b5b88ef04d8237d20d8374f3a2c4283c8c7c120b4d01e6d9eda3df3496d namespace=moby

	May 24 18:37:03 addons-514000 dockerd[922]: time="2023-05-24T18:37:03.603154445Z" level=info msg="cleaning up dead shim" namespace=moby

	May 24 18:37:03 addons-514000 cri-dockerd[1138]: time="2023-05-24T18:37:03Z" level=info msg="Stop pulling image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.0@sha256:d730651bb6584f969d95d8279a754cf9d8d31b5055c43dbdb8d7363a8c6371cf: Status: Downloaded newer image for gcr.io/k8s-minikube/gcp-auth-webhook@sha256:d730651bb6584f969d95d8279a754cf9d8d31b5055c43dbdb8d7363a8c6371cf"

	May 24 18:37:03 addons-514000 dockerd[922]: time="2023-05-24T18:37:03.856707697Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	May 24 18:37:03 addons-514000 dockerd[922]: time="2023-05-24T18:37:03.856808407Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	May 24 18:37:03 addons-514000 dockerd[922]: time="2023-05-24T18:37:03.856985177Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	May 24 18:37:03 addons-514000 dockerd[922]: time="2023-05-24T18:37:03.856997233Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	* 

	* ==> container status <==

	* CONTAINER           IMAGE                                                                                                                     CREATED             STATE               NAME                         ATTEMPT             POD ID

	d1ad6d2cd7d4d       gcr.io/k8s-minikube/gcp-auth-webhook@sha256:d730651bb6584f969d95d8279a754cf9d8d31b5055c43dbdb8d7363a8c6371cf              17 minutes ago      Running             gcp-auth                     0                   f47df037d9956

	2623eeac77855       registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280   17 minutes ago      Running             volume-snapshot-controller   0                   60ea5019d1f26

	61fdb94dca547       registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280   17 minutes ago      Running             volume-snapshot-controller   0                   1f82f1afb5ca6

	5e708965dbb0a       97e04611ad434                                                                                                             17 minutes ago      Running             coredns                      0                   eaf04536825bb

	c6d1bdca910b8       ba04bb24b9575                                                                                                             17 minutes ago      Running             storage-provisioner          0                   55be207be2898

	bf84d832ec967       29921a0845422                                                                                                             18 minutes ago      Running             kube-proxy                   0                   59d50204b0754

	046435c695b1e       305d7ed1dae28                                                                                                             18 minutes ago      Running             kube-scheduler               0                   cd9a002bb369c

	aa80b21f85087       2ee705380c3c5                                                                                                             18 minutes ago      Running             kube-controller-manager      0                   0ebf3f27cb768

	d5556d8565d49       24bc64e911039                                                                                                             18 minutes ago      Running             etcd                         0                   37fcc92ec98a7

	a485542b186e4       72c9df6be7f1b                                                                                                             18 minutes ago      Running             kube-apiserver               0                   383872bb10f81

	* 

	* ==> coredns [5e708965dbb0] <==

	* .:53

	[INFO] plugin/reload: Running configuration SHA512 = ea7a0d73d9d208f758b1f67640ef03c58089b9d9366cf3478df3bb369b210e39f213811b46224f8a04380814b6e0890ccd358f5b5e8c80bc22ac19c8601ee35b

	CoreDNS-1.10.1

	linux/arm64, go1.20, 055b2c3

	[INFO] 127.0.0.1:59819 - 54023 "HINFO IN 5089267470380203033.66065138292483152. udp 55 false 512" NXDOMAIN qr,rd,ra 130 0.424436073s

	[INFO] 10.244.0.7:57634 - 60032 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000112931s

	[INFO] 10.244.0.7:36916 - 20311 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000078547s

	[INFO] 10.244.0.7:53888 - 30613 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000056548s

	[INFO] 10.244.0.7:40805 - 41575 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000031112s

	[INFO] 10.244.0.7:39418 - 54110 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000031567s

	[INFO] 10.244.0.7:45485 - 20279 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000113676s

	[INFO] 10.244.0.7:49511 - 45953 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 534 0.000780781s

	[INFO] 10.244.0.7:49660 - 37020 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.00090552s

	* 

	* ==> describe nodes <==

	* Name:               addons-514000

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=arm64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=arm64

	                    kubernetes.io/hostname=addons-514000

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=d23ad66c17ded3bf1d7d6fb0fa0ee29881f9547e

	                    minikube.k8s.io/name=addons-514000

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2023_05_24T11_36_37_0700

	                    minikube.k8s.io/version=v1.30.1

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Wed, 24 May 2023 18:36:34 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  addons-514000

	  AcquireTime:     <unset>

	  RenewTime:       Wed, 24 May 2023 18:54:50 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Wed, 24 May 2023 18:52:27 +0000   Wed, 24 May 2023 18:36:33 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Wed, 24 May 2023 18:52:27 +0000   Wed, 24 May 2023 18:36:33 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Wed, 24 May 2023 18:52:27 +0000   Wed, 24 May 2023 18:36:33 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Wed, 24 May 2023 18:52:27 +0000   Wed, 24 May 2023 18:36:39 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.105.2

	  Hostname:    addons-514000

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17784760Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3905972Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17784760Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3905972Ki

	  pods:               110

	System Info:

	  Machine ID:                 cc66183cd0c646be999944d821185b81

	  System UUID:                cc66183cd0c646be999944d821185b81

	  Boot ID:                    2cd753bf-40ed-44ce-928e-d8bb002a6012

	  Kernel Version:             5.10.57

	  OS Image:                   Buildroot 2021.02.12

	  Operating System:           linux

	  Architecture:               arm64

	  Container Runtime Version:  docker://20.10.23

	  Kubelet Version:            v1.27.2

	  Kube-Proxy Version:         v1.27.2

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (10 in total)

	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---

	  gcp-auth                    gcp-auth-58478865f7-5429c                0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         17m

	  kube-system                 coredns-5d78c9869d-dmkfx                 100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (1%!)(MISSING)        170Mi (4%!)(MISSING)     18m

	  kube-system                 etcd-addons-514000                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (2%!)(MISSING)       0 (0%!)(MISSING)         18m

	  kube-system                 kube-apiserver-addons-514000             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         18m

	  kube-system                 kube-controller-manager-addons-514000    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         18m

	  kube-system                 kube-proxy-2gj6m                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         18m

	  kube-system                 kube-scheduler-addons-514000             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         18m

	  kube-system                 snapshot-controller-75bbb956b9-j5jhp     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         18m

	  kube-system                 snapshot-controller-75bbb956b9-txrxl     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         18m

	  kube-system                 storage-provisioner                      0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         18m

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%!)(MISSING)  0 (0%!)(MISSING)

	  memory             170Mi (4%!)(MISSING)  170Mi (4%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-32Mi     0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-64Ki     0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age   From             Message

	  ----    ------                   ----  ----             -------

	  Normal  Starting                 17m   kube-proxy       

	  Normal  Starting                 18m   kubelet          Starting kubelet.

	  Normal  NodeAllocatableEnforced  18m   kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  18m   kubelet          Node addons-514000 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    18m   kubelet          Node addons-514000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     18m   kubelet          Node addons-514000 status is now: NodeHasSufficientPID

	  Normal  NodeReady                18m   kubelet          Node addons-514000 status is now: NodeReady

	  Normal  RegisteredNode           18m   node-controller  Node addons-514000 event: Registered Node addons-514000 in Controller

	* 

	* ==> dmesg <==

	* [May24 18:36] ACPI: SRAT not present

	[  +0.000000] KASLR disabled due to lack of seed

	[  +0.727578] EINJ: EINJ table not found.

	[  +0.656332] systemd-fstab-generator[114]: Ignoring "noauto" for root device

	[  +0.043407] systemd[1]: systemd-journald.service: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.

	[  +0.000915] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)

	[  +3.905553] systemd-fstab-generator[471]: Ignoring "noauto" for root device

	[  +0.096232] systemd-fstab-generator[482]: Ignoring "noauto" for root device

	[  +2.874276] systemd-fstab-generator[684]: Ignoring "noauto" for root device

	[  +1.463827] systemd-fstab-generator[849]: Ignoring "noauto" for root device

	[  +0.166355] systemd-fstab-generator[885]: Ignoring "noauto" for root device

	[  +0.076432] systemd-fstab-generator[896]: Ignoring "noauto" for root device

	[  +0.091985] systemd-fstab-generator[909]: Ignoring "noauto" for root device

	[  +1.135416] kauditd_printk_skb: 53 callbacks suppressed

	[  +0.091978] systemd-fstab-generator[1057]: Ignoring "noauto" for root device

	[  +0.084182] systemd-fstab-generator[1068]: Ignoring "noauto" for root device

	[  +0.089221] systemd-fstab-generator[1079]: Ignoring "noauto" for root device

	[  +0.079548] systemd-fstab-generator[1090]: Ignoring "noauto" for root device

	[  +0.085105] systemd-fstab-generator[1131]: Ignoring "noauto" for root device

	[  +2.454751] systemd-fstab-generator[1385]: Ignoring "noauto" for root device

	[  +5.146027] systemd-fstab-generator[2260]: Ignoring "noauto" for root device

	[ +14.118818] kauditd_printk_skb: 41 callbacks suppressed

	[  +2.617169] TCP: eth0: Driver has suspect GRO implementation, TCP performance may be compromised.

	[  +3.922890] kauditd_printk_skb: 33 callbacks suppressed

	[May24 18:37] kauditd_printk_skb: 17 callbacks suppressed

	* 

	* ==> etcd [d5556d8565d4] <==

	* {"level":"info","ts":"2023-05-24T18:36:33.256Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"6e03e7863b4f9c54","local-member-id":"c46d288d2fcb0590","added-peer-id":"c46d288d2fcb0590","added-peer-peer-urls":["https://192.168.105.2:2380"]}

	{"level":"info","ts":"2023-05-24T18:36:33.832Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 is starting a new election at term 1"}

	{"level":"info","ts":"2023-05-24T18:36:33.832Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 became pre-candidate at term 1"}

	{"level":"info","ts":"2023-05-24T18:36:33.832Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 received MsgPreVoteResp from c46d288d2fcb0590 at term 1"}

	{"level":"info","ts":"2023-05-24T18:36:33.832Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 became candidate at term 2"}

	{"level":"info","ts":"2023-05-24T18:36:33.832Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 received MsgVoteResp from c46d288d2fcb0590 at term 2"}

	{"level":"info","ts":"2023-05-24T18:36:33.832Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 became leader at term 2"}

	{"level":"info","ts":"2023-05-24T18:36:33.832Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: c46d288d2fcb0590 elected leader c46d288d2fcb0590 at term 2"}

	{"level":"info","ts":"2023-05-24T18:36:33.834Z","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"c46d288d2fcb0590","local-member-attributes":"{Name:addons-514000 ClientURLs:[https://192.168.105.2:2379]}","request-path":"/0/members/c46d288d2fcb0590/attributes","cluster-id":"6e03e7863b4f9c54","publish-timeout":"7s"}

	{"level":"info","ts":"2023-05-24T18:36:33.834Z","caller":"embed/serve.go:100","msg":"ready to serve client requests"}

	{"level":"info","ts":"2023-05-24T18:36:33.835Z","caller":"embed/serve.go:198","msg":"serving client traffic securely","address":"192.168.105.2:2379"}

	{"level":"info","ts":"2023-05-24T18:36:33.834Z","caller":"etcdserver/server.go:2571","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}

	{"level":"info","ts":"2023-05-24T18:36:33.835Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}

	{"level":"info","ts":"2023-05-24T18:36:33.835Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}

	{"level":"info","ts":"2023-05-24T18:36:33.834Z","caller":"embed/serve.go:100","msg":"ready to serve client requests"}

	{"level":"info","ts":"2023-05-24T18:36:33.838Z","caller":"embed/serve.go:198","msg":"serving client traffic securely","address":"127.0.0.1:2379"}

	{"level":"info","ts":"2023-05-24T18:36:33.838Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"6e03e7863b4f9c54","local-member-id":"c46d288d2fcb0590","cluster-version":"3.5"}

	{"level":"info","ts":"2023-05-24T18:36:33.838Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}

	{"level":"info","ts":"2023-05-24T18:36:33.838Z","caller":"etcdserver/server.go:2595","msg":"cluster version is updated","cluster-version":"3.5"}

	{"level":"info","ts":"2023-05-24T18:46:33.876Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":846}

	{"level":"info","ts":"2023-05-24T18:46:33.881Z","caller":"mvcc/kvstore_compaction.go:66","msg":"finished scheduled compaction","compact-revision":846,"took":"3.400485ms","hash":3638416343}

	{"level":"info","ts":"2023-05-24T18:46:33.882Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":3638416343,"revision":846,"compact-revision":-1}

	{"level":"info","ts":"2023-05-24T18:51:33.887Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1145}

	{"level":"info","ts":"2023-05-24T18:51:33.890Z","caller":"mvcc/kvstore_compaction.go:66","msg":"finished scheduled compaction","compact-revision":1145,"took":"2.024563ms","hash":894933936}

	{"level":"info","ts":"2023-05-24T18:51:33.890Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":894933936,"revision":1145,"compact-revision":846}

	* 

	* ==> gcp-auth [d1ad6d2cd7d4] <==

	* 2023/05/24 18:37:03 GCP Auth Webhook started!

	* 

	* ==> kernel <==

	*  18:54:51 up 18 min,  0 users,  load average: 0.50, 0.63, 0.47

	Linux addons-514000 5.10.57 #1 SMP PREEMPT Sat May 20 00:35:14 UTC 2023 aarch64 GNU/Linux

	PRETTY_NAME="Buildroot 2021.02.12"

	* 

	* ==> kube-apiserver [a485542b186e] <==

	* I0524 18:36:51.381613       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 18:36:51.386892       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 18:36:51.387012       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 18:36:51.392664       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 18:36:51.393166       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 18:36:51.395637       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 18:36:51.395722       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 18:36:51.400840       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 18:36:51.401085       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 18:36:57.593427       1 alloc.go:330] "allocated clusterIPs" service="gcp-auth/gcp-auth" clusterIPs=map[IPv4:10.98.17.234]

	I0524 18:36:57.610279       1 controller.go:624] quota admission added evaluator for: jobs.batch

	I0524 18:41:34.543984       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 18:41:34.544093       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 18:46:34.544191       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 18:46:34.544366       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 18:46:34.554262       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 18:46:34.554305       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 18:46:34.559325       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 18:46:34.559355       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 18:51:34.542946       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 18:51:34.543557       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 18:51:34.550014       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 18:51:34.550133       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 18:51:34.556769       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 18:51:34.556848       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	* 

	* ==> kube-controller-manager [aa80b21f8508] <==

	* I0524 18:37:01.505510       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-create

	I0524 18:37:01.519013       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch

	I0524 18:37:02.495937       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch

	I0524 18:37:02.582819       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-create

	I0524 18:37:03.506916       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-create

	I0524 18:37:03.513803       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch

	I0524 18:37:03.593747       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-create

	I0524 18:37:03.596306       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-create

	I0524 18:37:03.598360       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-create

	I0524 18:37:03.598521       1 event.go:307] "Event occurred" object="gcp-auth/gcp-auth-certs-create" fieldPath="" kind="Job" apiVersion="batch/v1" type="Normal" reason="Completed" message="Job completed"

	I0524 18:37:03.685792       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch

	I0524 18:37:04.524940       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch

	I0524 18:37:04.535090       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch

	I0524 18:37:04.540969       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch

	I0524 18:37:04.541239       1 event.go:307] "Event occurred" object="gcp-auth/gcp-auth-certs-patch" fieldPath="" kind="Job" apiVersion="batch/v1" type="Normal" reason="Completed" message="Job completed"

	I0524 18:37:04.555353       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch

	I0524 18:37:20.560907       1 resource_quota_monitor.go:223] "QuotaMonitor created object count evaluator" resource="volumesnapshots.snapshot.storage.k8s.io"

	I0524 18:37:20.561333       1 shared_informer.go:311] Waiting for caches to sync for resource quota

	I0524 18:37:20.662721       1 shared_informer.go:318] Caches are synced for resource quota

	I0524 18:37:20.895710       1 shared_informer.go:311] Waiting for caches to sync for garbage collector

	I0524 18:37:20.999329       1 shared_informer.go:318] Caches are synced for garbage collector

	I0524 18:37:33.024397       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-create

	I0524 18:37:33.041354       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-create

	I0524 18:37:34.012720       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch

	I0524 18:37:34.026381       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch

	* 

	* ==> kube-proxy [bf84d832ec96] <==

	* I0524 18:36:51.096070       1 node.go:141] Successfully retrieved node IP: 192.168.105.2

	I0524 18:36:51.096254       1 server_others.go:110] "Detected node IP" address="192.168.105.2"

	I0524 18:36:51.096305       1 server_others.go:551] "Using iptables proxy"

	I0524 18:36:51.129985       1 server_others.go:176] "kube-proxy running in single-stack mode: secondary ipFamily is not supported" ipFamily=IPv6

	I0524 18:36:51.130045       1 server_others.go:190] "Using iptables Proxier"

	I0524 18:36:51.130091       1 proxier.go:253] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"

	I0524 18:36:51.130875       1 server.go:657] "Version info" version="v1.27.2"

	I0524 18:36:51.130883       1 server.go:659] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0524 18:36:51.134580       1 config.go:188] "Starting service config controller"

	I0524 18:36:51.134608       1 shared_informer.go:311] Waiting for caches to sync for service config

	I0524 18:36:51.134627       1 config.go:97] "Starting endpoint slice config controller"

	I0524 18:36:51.134630       1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config

	I0524 18:36:51.134949       1 config.go:315] "Starting node config controller"

	I0524 18:36:51.134952       1 shared_informer.go:311] Waiting for caches to sync for node config

	I0524 18:36:51.240491       1 shared_informer.go:318] Caches are synced for node config

	I0524 18:36:51.240513       1 shared_informer.go:318] Caches are synced for service config

	I0524 18:36:51.240529       1 shared_informer.go:318] Caches are synced for endpoint slice config

	* 

	* ==> kube-scheduler [046435c695b1] <==

	* W0524 18:36:34.551296       1 reflector.go:533] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0524 18:36:34.551335       1 reflector.go:148] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	W0524 18:36:34.555158       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E0524 18:36:34.555224       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	W0524 18:36:34.555257       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0524 18:36:34.555277       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	W0524 18:36:34.555318       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E0524 18:36:34.555338       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	W0524 18:36:34.555364       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0524 18:36:34.555398       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	W0524 18:36:34.555416       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0524 18:36:34.555434       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	W0524 18:36:35.414754       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0524 18:36:35.414831       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	W0524 18:36:35.419590       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0524 18:36:35.419621       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	W0524 18:36:35.431658       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E0524 18:36:35.431697       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	W0524 18:36:35.542100       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0524 18:36:35.542130       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	W0524 18:36:35.557940       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0524 18:36:35.558018       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	W0524 18:36:35.599004       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0524 18:36:35.599089       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	I0524 18:36:36.142741       1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	* 

	* ==> kubelet <==

	* -- Journal begins at Wed 2023-05-24 18:36:19 UTC, ends at Wed 2023-05-24 18:54:51 UTC. --

	May 24 18:49:37 addons-514000 kubelet[2266]: E0524 18:49:37.216874    2266 iptables.go:575] "Could not set up iptables canary" err=<

	May 24 18:49:37 addons-514000 kubelet[2266]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	May 24 18:49:37 addons-514000 kubelet[2266]:         Perhaps ip6tables or your kernel needs to be upgraded.

	May 24 18:49:37 addons-514000 kubelet[2266]:  > table=nat chain=KUBE-KUBELET-CANARY

	May 24 18:50:37 addons-514000 kubelet[2266]: E0524 18:50:37.213172    2266 iptables.go:575] "Could not set up iptables canary" err=<

	May 24 18:50:37 addons-514000 kubelet[2266]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	May 24 18:50:37 addons-514000 kubelet[2266]:         Perhaps ip6tables or your kernel needs to be upgraded.

	May 24 18:50:37 addons-514000 kubelet[2266]:  > table=nat chain=KUBE-KUBELET-CANARY

	May 24 18:51:37 addons-514000 kubelet[2266]: E0524 18:51:37.209933    2266 iptables.go:575] "Could not set up iptables canary" err=<

	May 24 18:51:37 addons-514000 kubelet[2266]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	May 24 18:51:37 addons-514000 kubelet[2266]:         Perhaps ip6tables or your kernel needs to be upgraded.

	May 24 18:51:37 addons-514000 kubelet[2266]:  > table=nat chain=KUBE-KUBELET-CANARY

	May 24 18:51:37 addons-514000 kubelet[2266]: W0524 18:51:37.212802    2266 machine.go:65] Cannot read vendor id correctly, set empty.

	May 24 18:52:37 addons-514000 kubelet[2266]: E0524 18:52:37.222293    2266 iptables.go:575] "Could not set up iptables canary" err=<

	May 24 18:52:37 addons-514000 kubelet[2266]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	May 24 18:52:37 addons-514000 kubelet[2266]:         Perhaps ip6tables or your kernel needs to be upgraded.

	May 24 18:52:37 addons-514000 kubelet[2266]:  > table=nat chain=KUBE-KUBELET-CANARY

	May 24 18:53:37 addons-514000 kubelet[2266]: E0524 18:53:37.219445    2266 iptables.go:575] "Could not set up iptables canary" err=<

	May 24 18:53:37 addons-514000 kubelet[2266]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	May 24 18:53:37 addons-514000 kubelet[2266]:         Perhaps ip6tables or your kernel needs to be upgraded.

	May 24 18:53:37 addons-514000 kubelet[2266]:  > table=nat chain=KUBE-KUBELET-CANARY

	May 24 18:54:37 addons-514000 kubelet[2266]: E0524 18:54:37.209773    2266 iptables.go:575] "Could not set up iptables canary" err=<

	May 24 18:54:37 addons-514000 kubelet[2266]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	May 24 18:54:37 addons-514000 kubelet[2266]:         Perhaps ip6tables or your kernel needs to be upgraded.

	May 24 18:54:37 addons-514000 kubelet[2266]:  > table=nat chain=KUBE-KUBELET-CANARY

	* 

	* ==> storage-provisioner [c6d1bdca910b] <==

	* I0524 18:36:52.162540       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0524 18:36:52.179095       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0524 18:36:52.179236       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I0524 18:36:52.184538       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0524 18:36:52.185437       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-514000_06403223-0fe7-4b51-9128-30a4ab7aa15a!

	I0524 18:36:52.187871       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"6d6698b6-9eb5-4aee-aab5-f9c270917482", APIVersion:"v1", ResourceVersion:"417", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-514000_06403223-0fe7-4b51-9128-30a4ab7aa15a became leader

	I0524 18:36:52.285999       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-514000_06403223-0fe7-4b51-9128-30a4ab7aa15a!

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.APIServer}} -p addons-514000 -n addons-514000

helpers_test.go:261: (dbg) Run:  kubectl --context addons-514000 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:285: <<< TestAddons/parallel/Registry FAILED: end of post-mortem logs <<<

helpers_test.go:286: ---------------------/post-mortem---------------------------------

--- FAIL: TestAddons/parallel/Registry (720.83s)

=== RUN   TestAddons/parallel/Ingress

=== PAUSE TestAddons/parallel/Ingress

=== CONT  TestAddons/parallel/Ingress

addons_test.go:183: (dbg) Run:  kubectl --context addons-514000 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s

addons_test.go:183: (dbg) Non-zero exit: kubectl --context addons-514000 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s: exit status 1 (36.573666ms)

** stderr ** 

	error: no matching resources found

** /stderr **

addons_test.go:184: failed waiting for ingress-nginx-controller : exit status 1

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p addons-514000 -n addons-514000

helpers_test.go:244: <<< TestAddons/parallel/Ingress FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestAddons/parallel/Ingress]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-darwin-arm64 -p addons-514000 logs -n 25

helpers_test.go:252: TestAddons/parallel/Ingress logs: 

-- stdout --

	* 

	* ==> Audit <==

	* |---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|

	| Command |              Args              |       Profile        |  User   | Version |     Start Time      |      End Time       |

	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|

	| start   | -o=json --download-only        | download-only-108000 | jenkins | v1.30.1 | 24 May 23 11:35 PDT |                     |

	|         | -p download-only-108000        |                      |         |         |                     |                     |

	|         | --force --alsologtostderr      |                      |         |         |                     |                     |

	|         | --kubernetes-version=v1.16.0   |                      |         |         |                     |                     |

	|         | --container-runtime=docker     |                      |         |         |                     |                     |

	|         | --driver=qemu2                 |                      |         |         |                     |                     |

	| start   | -o=json --download-only        | download-only-108000 | jenkins | v1.30.1 | 24 May 23 11:35 PDT |                     |

	|         | -p download-only-108000        |                      |         |         |                     |                     |

	|         | --force --alsologtostderr      |                      |         |         |                     |                     |

	|         | --kubernetes-version=v1.27.2   |                      |         |         |                     |                     |

	|         | --container-runtime=docker     |                      |         |         |                     |                     |

	|         | --driver=qemu2                 |                      |         |         |                     |                     |

	| delete  | --all                          | minikube             | jenkins | v1.30.1 | 24 May 23 11:36 PDT | 24 May 23 11:36 PDT |

	| delete  | -p download-only-108000        | download-only-108000 | jenkins | v1.30.1 | 24 May 23 11:36 PDT | 24 May 23 11:36 PDT |

	| delete  | -p download-only-108000        | download-only-108000 | jenkins | v1.30.1 | 24 May 23 11:36 PDT | 24 May 23 11:36 PDT |

	| start   | --download-only -p             | binary-mirror-689000 | jenkins | v1.30.1 | 24 May 23 11:36 PDT |                     |

	|         | binary-mirror-689000           |                      |         |         |                     |                     |

	|         | --alsologtostderr              |                      |         |         |                     |                     |

	|         | --binary-mirror                |                      |         |         |                     |                     |

	|         | http://127.0.0.1:49309         |                      |         |         |                     |                     |

	|         | --driver=qemu2                 |                      |         |         |                     |                     |

	| delete  | -p binary-mirror-689000        | binary-mirror-689000 | jenkins | v1.30.1 | 24 May 23 11:36 PDT | 24 May 23 11:36 PDT |

	| start   | -p addons-514000               | addons-514000        | jenkins | v1.30.1 | 24 May 23 11:36 PDT | 24 May 23 11:42 PDT |

	|         | --wait=true --memory=4000      |                      |         |         |                     |                     |

	|         | --alsologtostderr              |                      |         |         |                     |                     |

	|         | --addons=registry              |                      |         |         |                     |                     |

	|         | --addons=metrics-server        |                      |         |         |                     |                     |

	|         | --addons=volumesnapshots       |                      |         |         |                     |                     |

	|         | --addons=csi-hostpath-driver   |                      |         |         |                     |                     |

	|         | --addons=gcp-auth              |                      |         |         |                     |                     |

	|         | --addons=cloud-spanner         |                      |         |         |                     |                     |

	|         | --addons=inspektor-gadget      |                      |         |         |                     |                     |

	|         | --driver=qemu2                 |                      |         |         |                     |                     |

	|         | --addons=ingress               |                      |         |         |                     |                     |

	|         | --addons=ingress-dns           |                      |         |         |                     |                     |

	| addons  | disable cloud-spanner -p       | addons-514000        | jenkins | v1.30.1 | 24 May 23 11:54 PDT |                     |

	|         | addons-514000                  |                      |         |         |                     |                     |

	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|

	* 

	* ==> Last Start <==

	* Log file created at: 2023/05/24 11:36:07

	Running on machine: MacOS-M1-Agent-1

	Binary: Built with gc go1.20.4 for darwin/arm64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0524 11:36:07.002339    1534 out.go:296] Setting OutFile to fd 1 ...

	I0524 11:36:07.002453    1534 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0524 11:36:07.002456    1534 out.go:309] Setting ErrFile to fd 2...

	I0524 11:36:07.002459    1534 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0524 11:36:07.002536    1534 root.go:336] Updating PATH: /Users/jenkins/minikube-integration/16573-1024/.minikube/bin

	I0524 11:36:07.003586    1534 out.go:303] Setting JSON to false

	I0524 11:36:07.018861    1534 start.go:125] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":338,"bootTime":1684953029,"procs":422,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"13.3.1","kernelVersion":"22.4.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}

	W0524 11:36:07.018925    1534 start.go:133] gopshost.Virtualization returned error: not implemented yet

	I0524 11:36:07.027769    1534 out.go:177] * [addons-514000] minikube v1.30.1 on Darwin 13.3.1 (arm64)

	I0524 11:36:07.031820    1534 out.go:177]   - MINIKUBE_LOCATION=16573

	I0524 11:36:07.031893    1534 notify.go:220] Checking for updates...

	I0524 11:36:07.038648    1534 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/16573-1024/kubeconfig

	I0524 11:36:07.041871    1534 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0524 11:36:07.045796    1534 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0524 11:36:07.047102    1534 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/16573-1024/.minikube

	I0524 11:36:07.049751    1534 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0524 11:36:07.052962    1534 driver.go:375] Setting default libvirt URI to qemu:///system

	I0524 11:36:07.056656    1534 out.go:177] * Using the qemu2 driver based on user configuration

	I0524 11:36:07.063768    1534 start.go:295] selected driver: qemu2

	I0524 11:36:07.063774    1534 start.go:870] validating driver "qemu2" against <nil>

	I0524 11:36:07.063780    1534 start.go:881] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0524 11:36:07.066216    1534 start_flags.go:305] no existing cluster config was found, will generate one from the flags 

	I0524 11:36:07.068844    1534 out.go:177] * Automatically selected the socket_vmnet network

	I0524 11:36:07.072801    1534 start_flags.go:915] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0524 11:36:07.072817    1534 cni.go:84] Creating CNI manager for ""

	I0524 11:36:07.072825    1534 cni.go:157] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0524 11:36:07.072829    1534 start_flags.go:314] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0524 11:36:07.072834    1534 start_flags.go:319] config:

	{Name:addons-514000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684536746-16501@sha256:f5d93abf1d1cfb142a7cf0b58b24029595d621e5f943105b16c61199094d77de Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.2 ClusterName:addons-514000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CR

ISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}

	I0524 11:36:07.072903    1534 iso.go:125] acquiring lock: {Name:mk78431aa792d64459e9d8bd2fb1ce84dc420421 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0524 11:36:07.080756    1534 out.go:177] * Starting control plane node addons-514000 in cluster addons-514000

	I0524 11:36:07.084763    1534 preload.go:132] Checking if preload exists for k8s version v1.27.2 and runtime docker

	I0524 11:36:07.084787    1534 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/16573-1024/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.2-docker-overlay2-arm64.tar.lz4

	I0524 11:36:07.084798    1534 cache.go:57] Caching tarball of preloaded images

	I0524 11:36:07.084855    1534 preload.go:174] Found /Users/jenkins/minikube-integration/16573-1024/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0524 11:36:07.084860    1534 cache.go:60] Finished verifying existence of preloaded tar for  v1.27.2 on docker

	I0524 11:36:07.085026    1534 profile.go:148] Saving config to /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/config.json ...

	I0524 11:36:07.085039    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/config.json: {Name:mk030e94b16168c63405a9b01e247098a953bb00 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:07.085215    1534 cache.go:195] Successfully downloaded all kic artifacts

	I0524 11:36:07.085252    1534 start.go:364] acquiring machines lock for addons-514000: {Name:mkb37a68e9ac84a7c17b3cbe42c3966e2ec65b65 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0524 11:36:07.085315    1534 start.go:368] acquired machines lock for "addons-514000" in 57.708µs

	I0524 11:36:07.085327    1534 start.go:93] Provisioning new machine with config: &{Name:addons-514000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/16501/minikube-v1.30.1-1684536668-16501-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684536746-16501@sha256:f5d93abf1d1cfb142a7cf0b58b24029595d621e5f943105b16c61199094d77de Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi

g:{KubernetesVersion:v1.27.2 ClusterName:addons-514000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262

144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:} &{Name: IP: Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0524 11:36:07.085355    1534 start.go:125] createHost starting for "" (driver="qemu2")

	I0524 11:36:07.093778    1534 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	I0524 11:36:07.463575    1534 start.go:159] libmachine.API.Create for "addons-514000" (driver="qemu2")

	I0524 11:36:07.463635    1534 client.go:168] LocalClient.Create starting

	I0524 11:36:07.463808    1534 main.go:141] libmachine: Creating CA: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca.pem

	I0524 11:36:07.521208    1534 main.go:141] libmachine: Creating client certificate: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/cert.pem

	I0524 11:36:07.678481    1534 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/16573-1024/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/16573-1024/.minikube/cache/iso/arm64/minikube-v1.30.1-1684536668-16501-arm64.iso...

	I0524 11:36:08.060894    1534 main.go:141] libmachine: Creating SSH key...

	I0524 11:36:08.147520    1534 main.go:141] libmachine: Creating Disk image...

	I0524 11:36:08.147526    1534 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0524 11:36:08.147754    1534 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/disk.qcow2.raw /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/disk.qcow2

	I0524 11:36:08.231403    1534 main.go:141] libmachine: STDOUT: 

	I0524 11:36:08.231426    1534 main.go:141] libmachine: STDERR: 

	I0524 11:36:08.231485    1534 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/disk.qcow2 +20000M

	I0524 11:36:08.238737    1534 main.go:141] libmachine: STDOUT: Image resized.

	I0524 11:36:08.238750    1534 main.go:141] libmachine: STDERR: 

	I0524 11:36:08.238766    1534 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/disk.qcow2.raw and /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/disk.qcow2

	I0524 11:36:08.238773    1534 main.go:141] libmachine: Starting QEMU VM...

	I0524 11:36:08.238817    1534 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt -cpu host -drive file=/opt/homebrew/Cellar/qemu/7.2.0/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 4000 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/qemu.pid -device virtio-net-pci,netdev=net0,mac=0a:73:48:f5:f9:b3 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/disk.qcow2

	I0524 11:36:08.309201    1534 main.go:141] libmachine: STDOUT: 

	I0524 11:36:08.309237    1534 main.go:141] libmachine: STDERR: 

	I0524 11:36:08.309242    1534 main.go:141] libmachine: Attempt 0

	I0524 11:36:08.309258    1534 main.go:141] libmachine: Searching for a:73:48:f5:f9:b3 in /var/db/dhcpd_leases ...

	I0524 11:36:10.311441    1534 main.go:141] libmachine: Attempt 1

	I0524 11:36:10.311529    1534 main.go:141] libmachine: Searching for a:73:48:f5:f9:b3 in /var/db/dhcpd_leases ...

	I0524 11:36:12.313222    1534 main.go:141] libmachine: Attempt 2

	I0524 11:36:12.313245    1534 main.go:141] libmachine: Searching for a:73:48:f5:f9:b3 in /var/db/dhcpd_leases ...

	I0524 11:36:14.315294    1534 main.go:141] libmachine: Attempt 3

	I0524 11:36:14.315307    1534 main.go:141] libmachine: Searching for a:73:48:f5:f9:b3 in /var/db/dhcpd_leases ...

	I0524 11:36:16.317343    1534 main.go:141] libmachine: Attempt 4

	I0524 11:36:16.317356    1534 main.go:141] libmachine: Searching for a:73:48:f5:f9:b3 in /var/db/dhcpd_leases ...

	I0524 11:36:18.319398    1534 main.go:141] libmachine: Attempt 5

	I0524 11:36:18.319426    1534 main.go:141] libmachine: Searching for a:73:48:f5:f9:b3 in /var/db/dhcpd_leases ...

	I0524 11:36:20.321607    1534 main.go:141] libmachine: Attempt 6

	I0524 11:36:20.321690    1534 main.go:141] libmachine: Searching for a:73:48:f5:f9:b3 in /var/db/dhcpd_leases ...

	I0524 11:36:20.321979    1534 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I0524 11:36:20.322073    1534 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:a:73:48:f5:f9:b3 ID:1,a:73:48:f5:f9:b3 Lease:0x646faaa3}

	I0524 11:36:20.322118    1534 main.go:141] libmachine: Found match: a:73:48:f5:f9:b3

	I0524 11:36:20.322159    1534 main.go:141] libmachine: IP: 192.168.105.2

	I0524 11:36:20.322182    1534 main.go:141] libmachine: Waiting for VM to start (ssh -p 22 docker@192.168.105.2)...

	I0524 11:36:22.345943    1534 machine.go:88] provisioning docker machine ...

	I0524 11:36:22.346010    1534 buildroot.go:166] provisioning hostname "addons-514000"

	I0524 11:36:22.346753    1534 main.go:141] libmachine: Using SSH client type: native

	I0524 11:36:22.347771    1534 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100e286d0] 0x100e2b130 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0524 11:36:22.347789    1534 main.go:141] libmachine: About to run SSH command:

	sudo hostname addons-514000 && echo "addons-514000" | sudo tee /etc/hostname

	I0524 11:36:22.440700    1534 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-514000

	I0524 11:36:22.440862    1534 main.go:141] libmachine: Using SSH client type: native

	I0524 11:36:22.441350    1534 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100e286d0] 0x100e2b130 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0524 11:36:22.441366    1534 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\saddons-514000' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-514000/g' /etc/hosts;

				else 

					echo '127.0.1.1 addons-514000' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0524 11:36:22.513129    1534 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0524 11:36:22.513148    1534 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/16573-1024/.minikube CaCertPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/16573-1024/.minikube}

	I0524 11:36:22.513166    1534 buildroot.go:174] setting up certificates

	I0524 11:36:22.513196    1534 provision.go:83] configureAuth start

	I0524 11:36:22.513202    1534 provision.go:138] copyHostCerts

	I0524 11:36:22.513384    1534 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.pem (1078 bytes)

	I0524 11:36:22.513907    1534 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/16573-1024/.minikube/cert.pem (1123 bytes)

	I0524 11:36:22.514185    1534 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/16573-1024/.minikube/key.pem (1675 bytes)

	I0524 11:36:22.514351    1534 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca-key.pem org=jenkins.addons-514000 san=[192.168.105.2 192.168.105.2 localhost 127.0.0.1 minikube addons-514000]

	I0524 11:36:22.615592    1534 provision.go:172] copyRemoteCerts

	I0524 11:36:22.615660    1534 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0524 11:36:22.615678    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:22.647614    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0524 11:36:22.654906    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/server.pem --> /etc/docker/server.pem (1216 bytes)

	I0524 11:36:22.661956    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0524 11:36:22.668901    1534 provision.go:86] duration metric: configureAuth took 155.700959ms

	I0524 11:36:22.668909    1534 buildroot.go:189] setting minikube options for container-runtime

	I0524 11:36:22.669263    1534 config.go:182] Loaded profile config "addons-514000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.27.2

	I0524 11:36:22.669315    1534 main.go:141] libmachine: Using SSH client type: native

	I0524 11:36:22.669538    1534 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100e286d0] 0x100e2b130 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0524 11:36:22.669543    1534 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0524 11:36:22.728343    1534 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I0524 11:36:22.728351    1534 buildroot.go:70] root file system type: tmpfs

	I0524 11:36:22.728414    1534 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I0524 11:36:22.728455    1534 main.go:141] libmachine: Using SSH client type: native

	I0524 11:36:22.728711    1534 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100e286d0] 0x100e2b130 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0524 11:36:22.728749    1534 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0524 11:36:22.797892    1534 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0524 11:36:22.797940    1534 main.go:141] libmachine: Using SSH client type: native

	I0524 11:36:22.798220    1534 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100e286d0] 0x100e2b130 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0524 11:36:22.798231    1534 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0524 11:36:23.149053    1534 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory

	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.

	I0524 11:36:23.149067    1534 machine.go:91] provisioned docker machine in 803.097167ms

	I0524 11:36:23.149073    1534 client.go:171] LocalClient.Create took 15.685539208s

	I0524 11:36:23.149079    1534 start.go:167] duration metric: libmachine.API.Create for "addons-514000" took 15.685619292s

	I0524 11:36:23.149084    1534 start.go:300] post-start starting for "addons-514000" (driver="qemu2")

	I0524 11:36:23.149087    1534 start.go:328] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0524 11:36:23.149151    1534 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0524 11:36:23.149161    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:23.182740    1534 ssh_runner.go:195] Run: cat /etc/os-release

	I0524 11:36:23.184182    1534 info.go:137] Remote host: Buildroot 2021.02.12

	I0524 11:36:23.184191    1534 filesync.go:126] Scanning /Users/jenkins/minikube-integration/16573-1024/.minikube/addons for local assets ...

	I0524 11:36:23.184263    1534 filesync.go:126] Scanning /Users/jenkins/minikube-integration/16573-1024/.minikube/files for local assets ...

	I0524 11:36:23.184291    1534 start.go:303] post-start completed in 35.204125ms

	I0524 11:36:23.184667    1534 profile.go:148] Saving config to /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/config.json ...

	I0524 11:36:23.184838    1534 start.go:128] duration metric: createHost completed in 16.099587584s

	I0524 11:36:23.184860    1534 main.go:141] libmachine: Using SSH client type: native

	I0524 11:36:23.185079    1534 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100e286d0] 0x100e2b130 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0524 11:36:23.185084    1534 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0524 11:36:23.240206    1534 main.go:141] libmachine: SSH cmd err, output: <nil>: 1684953383.421013085

	I0524 11:36:23.240212    1534 fix.go:207] guest clock: 1684953383.421013085

	I0524 11:36:23.240216    1534 fix.go:220] Guest: 2023-05-24 11:36:23.421013085 -0700 PDT Remote: 2023-05-24 11:36:23.184841 -0700 PDT m=+16.200821626 (delta=236.172085ms)

	I0524 11:36:23.240228    1534 fix.go:191] guest clock delta is within tolerance: 236.172085ms

	I0524 11:36:23.240231    1534 start.go:83] releasing machines lock for "addons-514000", held for 16.155020041s

	I0524 11:36:23.240534    1534 ssh_runner.go:195] Run: cat /version.json

	I0524 11:36:23.240542    1534 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0524 11:36:23.240552    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:23.240589    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:23.271294    1534 ssh_runner.go:195] Run: systemctl --version

	I0524 11:36:23.356274    1534 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0524 11:36:23.358206    1534 cni.go:208] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0524 11:36:23.358253    1534 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0524 11:36:23.363251    1534 cni.go:261] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0524 11:36:23.363272    1534 preload.go:132] Checking if preload exists for k8s version v1.27.2 and runtime docker

	I0524 11:36:23.363358    1534 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0524 11:36:23.374219    1534 docker.go:633] Got preloaded images: 

	I0524 11:36:23.374227    1534 docker.go:639] registry.k8s.io/kube-apiserver:v1.27.2 wasn't preloaded

	I0524 11:36:23.374272    1534 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I0524 11:36:23.377135    1534 ssh_runner.go:195] Run: which lz4

	I0524 11:36:23.378475    1534 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4

	I0524 11:36:23.379822    1534 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I0524 11:36:23.379833    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.2-docker-overlay2-arm64.tar.lz4 --> /preloaded.tar.lz4 (343635669 bytes)

	I0524 11:36:24.715030    1534 docker.go:597] Took 1.336609 seconds to copy over tarball

	I0524 11:36:24.715105    1534 ssh_runner.go:195] Run: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4

	I0524 11:36:25.802869    1534 ssh_runner.go:235] Completed: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4: (1.087750334s)

	I0524 11:36:25.802885    1534 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I0524 11:36:25.818539    1534 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I0524 11:36:25.821398    1534 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2629 bytes)

	I0524 11:36:25.826757    1534 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0524 11:36:25.912573    1534 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0524 11:36:27.259007    1534 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.346426625s)

	I0524 11:36:27.259050    1534 start.go:481] detecting cgroup driver to use...

	I0524 11:36:27.259161    1534 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0524 11:36:27.264502    1534 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"

	I0524 11:36:27.267902    1534 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I0524 11:36:27.271357    1534 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...

	I0524 11:36:27.271387    1534 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I0524 11:36:27.274823    1534 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0524 11:36:27.278019    1534 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I0524 11:36:27.280856    1534 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0524 11:36:27.283904    1534 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0524 11:36:27.287473    1534 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I0524 11:36:27.291108    1534 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0524 11:36:27.294288    1534 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0524 11:36:27.297250    1534 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0524 11:36:27.376117    1534 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I0524 11:36:27.384917    1534 start.go:481] detecting cgroup driver to use...

	I0524 11:36:27.384994    1534 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0524 11:36:27.390435    1534 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0524 11:36:27.395426    1534 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0524 11:36:27.402483    1534 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0524 11:36:27.406870    1534 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0524 11:36:27.411215    1534 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I0524 11:36:27.451530    1534 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0524 11:36:27.456795    1534 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0524 11:36:27.461922    1534 ssh_runner.go:195] Run: which cri-dockerd

	I0524 11:36:27.463049    1534 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I0524 11:36:27.465876    1534 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)

	I0524 11:36:27.470660    1534 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I0524 11:36:27.538638    1534 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I0524 11:36:27.616092    1534 docker.go:532] configuring docker to use "cgroupfs" as cgroup driver...

	I0524 11:36:27.616109    1534 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (144 bytes)

	I0524 11:36:27.621459    1534 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0524 11:36:27.708405    1534 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0524 11:36:28.851963    1534 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.143548708s)

	I0524 11:36:28.852015    1534 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I0524 11:36:28.939002    1534 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I0524 11:36:29.020013    1534 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I0524 11:36:29.108812    1534 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0524 11:36:29.187424    1534 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I0524 11:36:29.194801    1534 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0524 11:36:29.274472    1534 ssh_runner.go:195] Run: sudo systemctl restart cri-docker

	I0524 11:36:29.298400    1534 start.go:528] Will wait 60s for socket path /var/run/cri-dockerd.sock

	I0524 11:36:29.298499    1534 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0524 11:36:29.300633    1534 start.go:549] Will wait 60s for crictl version

	I0524 11:36:29.300681    1534 ssh_runner.go:195] Run: which crictl

	I0524 11:36:29.302069    1534 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0524 11:36:29.320125    1534 start.go:565] Version:  0.1.0

	RuntimeName:  docker

	RuntimeVersion:  20.10.23

	RuntimeApiVersion:  v1alpha2

	I0524 11:36:29.320196    1534 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0524 11:36:29.329425    1534 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0524 11:36:29.346012    1534 out.go:204] * Preparing Kubernetes v1.27.2 on Docker 20.10.23 ...

	I0524 11:36:29.346159    1534 ssh_runner.go:195] Run: grep 192.168.105.1	host.minikube.internal$ /etc/hosts

	I0524 11:36:29.347609    1534 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.105.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0524 11:36:29.351578    1534 preload.go:132] Checking if preload exists for k8s version v1.27.2 and runtime docker

	I0524 11:36:29.351619    1534 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0524 11:36:29.359168    1534 docker.go:633] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.27.2

	registry.k8s.io/kube-controller-manager:v1.27.2

	registry.k8s.io/kube-scheduler:v1.27.2

	registry.k8s.io/kube-proxy:v1.27.2

	registry.k8s.io/coredns/coredns:v1.10.1

	registry.k8s.io/etcd:3.5.7-0

	registry.k8s.io/pause:3.9

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I0524 11:36:29.359177    1534 docker.go:563] Images already preloaded, skipping extraction

	I0524 11:36:29.359234    1534 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0524 11:36:29.366578    1534 docker.go:633] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.27.2

	registry.k8s.io/kube-scheduler:v1.27.2

	registry.k8s.io/kube-controller-manager:v1.27.2

	registry.k8s.io/kube-proxy:v1.27.2

	registry.k8s.io/coredns/coredns:v1.10.1

	registry.k8s.io/etcd:3.5.7-0

	registry.k8s.io/pause:3.9

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I0524 11:36:29.366587    1534 cache_images.go:84] Images are preloaded, skipping loading

	I0524 11:36:29.366634    1534 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I0524 11:36:29.376722    1534 cni.go:84] Creating CNI manager for ""

	I0524 11:36:29.376734    1534 cni.go:157] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0524 11:36:29.376743    1534 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I0524 11:36:29.376755    1534 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.105.2 APIServerPort:8443 KubernetesVersion:v1.27.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-514000 NodeName:addons-514000 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.105.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.105.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/ku

bernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I0524 11:36:29.376831    1534 kubeadm.go:181] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.105.2

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/cri-dockerd.sock

	  name: "addons-514000"

	  kubeletExtraArgs:

	    node-ip: 192.168.105.2

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.105.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.27.2

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0524 11:36:29.376873    1534 kubeadm.go:971] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.27.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/cri-dockerd.sock --hostname-override=addons-514000 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.105.2

	[Install]

	 config:

	{KubernetesVersion:v1.27.2 ClusterName:addons-514000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I0524 11:36:29.376934    1534 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.27.2

	I0524 11:36:29.379950    1534 binaries.go:44] Found k8s binaries, skipping transfer

	I0524 11:36:29.379980    1534 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0524 11:36:29.383262    1534 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (375 bytes)

	I0524 11:36:29.388298    1534 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0524 11:36:29.393370    1534 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2099 bytes)

	I0524 11:36:29.398040    1534 ssh_runner.go:195] Run: grep 192.168.105.2	control-plane.minikube.internal$ /etc/hosts

	I0524 11:36:29.399441    1534 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.105.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0524 11:36:29.403560    1534 certs.go:56] Setting up /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000 for IP: 192.168.105.2

	I0524 11:36:29.403576    1534 certs.go:190] acquiring lock for shared ca certs: {Name:mk53f82f750243d1079819acfe50ecbc2a56595a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.403733    1534 certs.go:204] generating minikubeCA CA: /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.key

	I0524 11:36:29.494908    1534 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.crt ...

	I0524 11:36:29.494916    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.crt: {Name:mkde13471093958a457d9307a0c213d7ba461177 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.495144    1534 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.key ...

	I0524 11:36:29.495147    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.key: {Name:mk5b2a6f100829fa25412e4c96a6b4d9b186c9d1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.495264    1534 certs.go:204] generating proxyClientCA CA: /Users/jenkins/minikube-integration/16573-1024/.minikube/proxy-client-ca.key

	I0524 11:36:29.601357    1534 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/16573-1024/.minikube/proxy-client-ca.crt ...

	I0524 11:36:29.601364    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/proxy-client-ca.crt: {Name:mkc3f94501092c9c51cfa6d329a0a2c4cec184ab Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.601593    1534 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/16573-1024/.minikube/proxy-client-ca.key ...

	I0524 11:36:29.601596    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/proxy-client-ca.key: {Name:mk7acf18000a82a656fee32bbd454a3c129dabde Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.601733    1534 certs.go:319] generating minikube-user signed cert: /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/client.key

	I0524 11:36:29.601741    1534 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/client.crt with IP's: []

	I0524 11:36:29.653842    1534 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/client.crt ...

	I0524 11:36:29.653845    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/client.crt: {Name:mk3856cd37d1f07be2cc9902b19f9498b880112f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.654036    1534 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/client.key ...

	I0524 11:36:29.654040    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/client.key: {Name:mkbc8808085e1496dcb2b3e03156e443b7b7994b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.654176    1534 certs.go:319] generating minikube signed cert: /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.key.96055969

	I0524 11:36:29.654188    1534 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.crt.96055969 with IP's: [192.168.105.2 10.96.0.1 127.0.0.1 10.0.0.1]

	I0524 11:36:29.724674    1534 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.crt.96055969 ...

	I0524 11:36:29.724678    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.crt.96055969: {Name:mk424188d0f28cb0aa520452bb8ec4583a153ec6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.724815    1534 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.key.96055969 ...

	I0524 11:36:29.724818    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.key.96055969: {Name:mk98c3231c62717b32e2418cabd759d6ad5645ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.724926    1534 certs.go:337] copying /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.crt.96055969 -> /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.crt

	I0524 11:36:29.725147    1534 certs.go:341] copying /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.key.96055969 -> /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.key

	I0524 11:36:29.725241    1534 certs.go:319] generating aggregator signed cert: /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/proxy-client.key

	I0524 11:36:29.725256    1534 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/proxy-client.crt with IP's: []

	I0524 11:36:29.842949    1534 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/proxy-client.crt ...

	I0524 11:36:29.842953    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/proxy-client.crt: {Name:mk581c30062675e68aafc25cb79bfc8a62fd3e41 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.843105    1534 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/proxy-client.key ...

	I0524 11:36:29.843110    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/proxy-client.key: {Name:mk019f6bac347a368012a36cea939860ce210025 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.843389    1534 certs.go:437] found cert: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca-key.pem (1675 bytes)

	I0524 11:36:29.843593    1534 certs.go:437] found cert: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca.pem (1078 bytes)

	I0524 11:36:29.843619    1534 certs.go:437] found cert: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/cert.pem (1123 bytes)

	I0524 11:36:29.843756    1534 certs.go:437] found cert: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/key.pem (1675 bytes)

	I0524 11:36:29.844302    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I0524 11:36:29.851879    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0524 11:36:29.859249    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0524 11:36:29.866847    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I0524 11:36:29.873646    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0524 11:36:29.880415    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0524 11:36:29.887466    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0524 11:36:29.894575    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0524 11:36:29.901581    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0524 11:36:29.908027    1534 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0524 11:36:29.914140    1534 ssh_runner.go:195] Run: openssl version

	I0524 11:36:29.916182    1534 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0524 11:36:29.919659    1534 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0524 11:36:29.921372    1534 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 May 24 18:36 /usr/share/ca-certificates/minikubeCA.pem

	I0524 11:36:29.921394    1534 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0524 11:36:29.923349    1534 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0524 11:36:29.926902    1534 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd

	I0524 11:36:29.928503    1534 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory

	I0524 11:36:29.928540    1534 kubeadm.go:404] StartCluster: {Name:addons-514000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/16501/minikube-v1.30.1-1684536668-16501-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684536746-16501@sha256:f5d93abf1d1cfb142a7cf0b58b24029595d621e5f943105b16c61199094d77de Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v

1.27.2 ClusterName:addons-514000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.105.2 Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 Mount

Options:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}

	I0524 11:36:29.928599    1534 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0524 11:36:29.935998    1534 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0524 11:36:29.939589    1534 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0524 11:36:29.942818    1534 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0524 11:36:29.945835    1534 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0524 11:36:29.945853    1534 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.27.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"

	I0524 11:36:29.967889    1534 kubeadm.go:322] [init] Using Kubernetes version: v1.27.2

	I0524 11:36:29.967941    1534 kubeadm.go:322] [preflight] Running pre-flight checks

	I0524 11:36:30.020294    1534 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster

	I0524 11:36:30.020350    1534 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I0524 11:36:30.020400    1534 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	I0524 11:36:30.076237    1534 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I0524 11:36:30.084415    1534 out.go:204]   - Generating certificates and keys ...

	I0524 11:36:30.084460    1534 kubeadm.go:322] [certs] Using existing ca certificate authority

	I0524 11:36:30.084494    1534 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk

	I0524 11:36:30.272940    1534 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key

	I0524 11:36:30.453046    1534 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key

	I0524 11:36:30.580586    1534 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key

	I0524 11:36:30.639773    1534 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key

	I0524 11:36:30.738497    1534 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key

	I0524 11:36:30.738567    1534 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [addons-514000 localhost] and IPs [192.168.105.2 127.0.0.1 ::1]

	I0524 11:36:30.858811    1534 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key

	I0524 11:36:30.858875    1534 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [addons-514000 localhost] and IPs [192.168.105.2 127.0.0.1 ::1]

	I0524 11:36:30.935967    1534 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key

	I0524 11:36:30.967281    1534 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key

	I0524 11:36:31.073416    1534 kubeadm.go:322] [certs] Generating "sa" key and public key

	I0524 11:36:31.073445    1534 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I0524 11:36:31.335469    1534 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file

	I0524 11:36:31.530915    1534 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I0524 11:36:31.573436    1534 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I0524 11:36:31.637219    1534 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I0524 11:36:31.645102    1534 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I0524 11:36:31.645531    1534 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I0524 11:36:31.645571    1534 kubeadm.go:322] [kubelet-start] Starting the kubelet

	I0524 11:36:31.737201    1534 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I0524 11:36:31.741345    1534 out.go:204]   - Booting up control plane ...

	I0524 11:36:31.741390    1534 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I0524 11:36:31.741439    1534 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I0524 11:36:31.741469    1534 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I0524 11:36:31.741512    1534 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I0524 11:36:31.741595    1534 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	I0524 11:36:35.739695    1534 kubeadm.go:322] [apiclient] All control plane components are healthy after 4.002246 seconds

	I0524 11:36:35.739796    1534 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I0524 11:36:35.750536    1534 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I0524 11:36:36.270805    1534 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs

	I0524 11:36:36.271028    1534 kubeadm.go:322] [mark-control-plane] Marking the node addons-514000 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I0524 11:36:36.776691    1534 kubeadm.go:322] [bootstrap-token] Using token: zlw52u.ca0agirmjwjpmd4f

	I0524 11:36:36.783931    1534 out.go:204]   - Configuring RBAC rules ...

	I0524 11:36:36.784005    1534 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I0524 11:36:36.785227    1534 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I0524 11:36:36.791945    1534 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I0524 11:36:36.793322    1534 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I0524 11:36:36.794557    1534 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I0524 11:36:36.795891    1534 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I0524 11:36:36.802617    1534 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I0524 11:36:36.956552    1534 kubeadm.go:322] [addons] Applied essential addon: CoreDNS

	I0524 11:36:37.187637    1534 kubeadm.go:322] [addons] Applied essential addon: kube-proxy

	I0524 11:36:37.187937    1534 kubeadm.go:322] 

	I0524 11:36:37.187967    1534 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!

	I0524 11:36:37.187973    1534 kubeadm.go:322] 

	I0524 11:36:37.188044    1534 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:

	I0524 11:36:37.188053    1534 kubeadm.go:322] 

	I0524 11:36:37.188069    1534 kubeadm.go:322]   mkdir -p $HOME/.kube

	I0524 11:36:37.188099    1534 kubeadm.go:322]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I0524 11:36:37.188128    1534 kubeadm.go:322]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I0524 11:36:37.188133    1534 kubeadm.go:322] 

	I0524 11:36:37.188155    1534 kubeadm.go:322] Alternatively, if you are the root user, you can run:

	I0524 11:36:37.188158    1534 kubeadm.go:322] 

	I0524 11:36:37.188189    1534 kubeadm.go:322]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I0524 11:36:37.188193    1534 kubeadm.go:322] 

	I0524 11:36:37.188219    1534 kubeadm.go:322] You should now deploy a pod network to the cluster.

	I0524 11:36:37.188277    1534 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I0524 11:36:37.188314    1534 kubeadm.go:322]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I0524 11:36:37.188322    1534 kubeadm.go:322] 

	I0524 11:36:37.188361    1534 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities

	I0524 11:36:37.188399    1534 kubeadm.go:322] and service account keys on each node and then running the following as root:

	I0524 11:36:37.188411    1534 kubeadm.go:322] 

	I0524 11:36:37.188464    1534 kubeadm.go:322]   kubeadm join control-plane.minikube.internal:8443 --token zlw52u.ca0agirmjwjpmd4f \

	I0524 11:36:37.188516    1534 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:31e7298e5fe39dd9013d3c0dfbef354d505381f39a7a09e3b4af334242438797 \

	I0524 11:36:37.188534    1534 kubeadm.go:322] 	--control-plane 

	I0524 11:36:37.188538    1534 kubeadm.go:322] 

	I0524 11:36:37.188580    1534 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:

	I0524 11:36:37.188584    1534 kubeadm.go:322] 

	I0524 11:36:37.188629    1534 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token zlw52u.ca0agirmjwjpmd4f \

	I0524 11:36:37.188681    1534 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:31e7298e5fe39dd9013d3c0dfbef354d505381f39a7a09e3b4af334242438797 

	I0524 11:36:37.188736    1534 kubeadm.go:322] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I0524 11:36:37.188819    1534 kubeadm.go:322] W0524 18:36:30.200947    1295 images.go:80] could not find officially supported version of etcd for Kubernetes v1.27.2, falling back to the nearest etcd version (3.5.7-0)

	I0524 11:36:37.188904    1534 kubeadm.go:322] W0524 18:36:31.916526    1295 images.go:80] could not find officially supported version of etcd for Kubernetes v1.27.2, falling back to the nearest etcd version (3.5.7-0)

	I0524 11:36:37.188909    1534 cni.go:84] Creating CNI manager for ""

	I0524 11:36:37.188916    1534 cni.go:157] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0524 11:36:37.195686    1534 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...

	I0524 11:36:37.199715    1534 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d

	I0524 11:36:37.203087    1534 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)

	I0524 11:36:37.208259    1534 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0524 11:36:37.208303    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:37.208333    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl label nodes minikube.k8s.io/version=v1.30.1 minikube.k8s.io/commit=d23ad66c17ded3bf1d7d6fb0fa0ee29881f9547e minikube.k8s.io/name=addons-514000 minikube.k8s.io/updated_at=2023_05_24T11_36_37_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:37.258566    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:37.271047    1534 ops.go:34] apiserver oom_adj: -16

	I0524 11:36:37.796169    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:38.296162    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:38.796257    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:39.295049    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:39.796244    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:40.296250    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:40.796162    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:41.296458    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:41.796245    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:42.296250    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:42.796323    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:43.296423    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:43.796432    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:44.296246    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:44.796149    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:45.296189    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:45.796183    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:46.296206    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:46.796370    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:47.296192    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:47.796245    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:48.296219    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:48.796135    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:49.296201    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:49.796192    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:50.296070    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:50.332878    1534 kubeadm.go:1076] duration metric: took 13.124695208s to wait for elevateKubeSystemPrivileges.

	I0524 11:36:50.332892    1534 kubeadm.go:406] StartCluster complete in 20.404490625s

	I0524 11:36:50.332916    1534 settings.go:142] acquiring lock: {Name:mke0e8586c5ffdfb76a30452ad9385e81e1593cb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:50.333079    1534 settings.go:150] Updating kubeconfig:  /Users/jenkins/minikube-integration/16573-1024/kubeconfig

	I0524 11:36:50.333301    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/kubeconfig: {Name:mkd6a5851332ae81ab607caaee690ec1266dd411 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:50.333499    1534 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.27.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0524 11:36:50.333541    1534 addons.go:496] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:true]

	I0524 11:36:50.333603    1534 addons.go:66] Setting ingress=true in profile "addons-514000"

	I0524 11:36:50.333609    1534 addons.go:66] Setting registry=true in profile "addons-514000"

	I0524 11:36:50.333611    1534 addons.go:228] Setting addon ingress=true in "addons-514000"

	I0524 11:36:50.333614    1534 addons.go:228] Setting addon registry=true in "addons-514000"

	I0524 11:36:50.333650    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.333646    1534 addons.go:66] Setting csi-hostpath-driver=true in profile "addons-514000"

	I0524 11:36:50.333656    1534 addons.go:66] Setting storage-provisioner=true in profile "addons-514000"

	I0524 11:36:50.333660    1534 addons.go:228] Setting addon storage-provisioner=true in "addons-514000"

	I0524 11:36:50.333671    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.333804    1534 addons.go:66] Setting metrics-server=true in profile "addons-514000"

	I0524 11:36:50.333879    1534 addons.go:228] Setting addon metrics-server=true in "addons-514000"

	I0524 11:36:50.333906    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.333926    1534 addons.go:228] Setting addon csi-hostpath-driver=true in "addons-514000"

	I0524 11:36:50.333947    1534 config.go:182] Loaded profile config "addons-514000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.27.2

	I0524 11:36:50.333682    1534 addons.go:66] Setting ingress-dns=true in profile "addons-514000"

	I0524 11:36:50.333976    1534 addons.go:228] Setting addon ingress-dns=true in "addons-514000"

	I0524 11:36:50.333995    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.334035    1534 addons.go:66] Setting gcp-auth=true in profile "addons-514000"

	I0524 11:36:50.333605    1534 addons.go:66] Setting volumesnapshots=true in profile "addons-514000"

	I0524 11:36:50.334092    1534 addons.go:228] Setting addon volumesnapshots=true in "addons-514000"

	I0524 11:36:50.334116    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.334159    1534 addons.go:66] Setting default-storageclass=true in profile "addons-514000"

	I0524 11:36:50.334172    1534 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-514000"

	I0524 11:36:50.333653    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.334095    1534 mustload.go:65] Loading cluster: addons-514000

	I0524 11:36:50.334706    1534 addons.go:66] Setting inspektor-gadget=true in profile "addons-514000"

	I0524 11:36:50.334713    1534 addons.go:228] Setting addon inspektor-gadget=true in "addons-514000"

	I0524 11:36:50.333694    1534 addons.go:66] Setting cloud-spanner=true in profile "addons-514000"

	I0524 11:36:50.334861    1534 addons.go:228] Setting addon cloud-spanner=true in "addons-514000"

	I0524 11:36:50.334877    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.334897    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.334942    1534 host.go:66] Checking if "addons-514000" exists ...

	W0524 11:36:50.335292    1534 host.go:54] host status for "addons-514000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor: connect: connection refused

	W0524 11:36:50.335303    1534 addons.go:274] "addons-514000" is not running, setting metrics-server=true and skipping enablement (err=<nil>)

	I0524 11:36:50.335306    1534 addons.go:464] Verifying addon metrics-server=true in "addons-514000"

	W0524 11:36:50.335329    1534 host.go:54] host status for "addons-514000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor: connect: connection refused

	W0524 11:36:50.335333    1534 addons.go:274] "addons-514000" is not running, setting ingress-dns=true and skipping enablement (err=<nil>)

	W0524 11:36:50.335353    1534 host.go:54] host status for "addons-514000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor: connect: connection refused

	W0524 11:36:50.335359    1534 addons.go:274] "addons-514000" is not running, setting registry=true and skipping enablement (err=<nil>)

	I0524 11:36:50.335362    1534 addons.go:464] Verifying addon registry=true in "addons-514000"

	W0524 11:36:50.335391    1534 host.go:54] host status for "addons-514000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor: connect: connection refused

	I0524 11:36:50.339535    1534 out.go:177] * Verifying registry addon...

	W0524 11:36:50.335411    1534 addons.go:274] "addons-514000" is not running, setting ingress=true and skipping enablement (err=<nil>)

	W0524 11:36:50.335412    1534 host.go:54] host status for "addons-514000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor: connect: connection refused

	W0524 11:36:50.335520    1534 host.go:54] host status for "addons-514000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor: connect: connection refused

	W0524 11:36:50.335588    1534 host.go:54] host status for "addons-514000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor: connect: connection refused

	I0524 11:36:50.335599    1534 config.go:182] Loaded profile config "addons-514000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.27.2

	W0524 11:36:50.335650    1534 host.go:54] host status for "addons-514000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor: connect: connection refused

	W0524 11:36:50.349556    1534 addons.go:274] "addons-514000" is not running, setting csi-hostpath-driver=true and skipping enablement (err=<nil>)

	W0524 11:36:50.349673    1534 addons.go:274] "addons-514000" is not running, setting cloud-spanner=true and skipping enablement (err=<nil>)

	I0524 11:36:50.349673    1534 addons.go:464] Verifying addon ingress=true in "addons-514000"

	W0524 11:36:50.349688    1534 addons_storage_classes.go:55] "addons-514000" is not running, writing default-storageclass=true to disk and skipping enablement

	W0524 11:36:50.349678    1534 addons.go:274] "addons-514000" is not running, setting inspektor-gadget=true and skipping enablement (err=<nil>)

	I0524 11:36:50.350008    1534 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...

	I0524 11:36:50.350257    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.353441    1534 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0524 11:36:50.357663    1534 addons.go:228] Setting addon default-storageclass=true in "addons-514000"

	I0524 11:36:50.360618    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.360641    1534 addons.go:420] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0524 11:36:50.360646    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0524 11:36:50.360653    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:50.365539    1534 out.go:177] * Verifying ingress addon...

	I0524 11:36:50.357776    1534 out.go:177]   - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0

	I0524 11:36:50.357776    1534 addons.go:464] Verifying addon csi-hostpath-driver=true in "addons-514000"

	I0524 11:36:50.361446    1534 addons.go:420] installing /etc/kubernetes/addons/storageclass.yaml

	I0524 11:36:50.364279    1534 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=registry

	I0524 11:36:50.381598    1534 out.go:177] * Verifying csi-hostpath-driver addon...

	I0524 11:36:50.369698    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0524 11:36:50.369727    1534 addons.go:420] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml

	I0524 11:36:50.375900    1534 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...

	I0524 11:36:50.387638    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)

	I0524 11:36:50.387638    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:50.387646    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:50.388147    1534 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...

	I0524 11:36:50.390627    1534 kapi.go:86] Found 0 Pods for label selector app.kubernetes.io/name=ingress-nginx

	I0524 11:36:50.391169    1534 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver

	I0524 11:36:50.400375    1534 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.27.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.105.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.27.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0524 11:36:50.433263    1534 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0524 11:36:50.499595    1534 addons.go:420] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml

	I0524 11:36:50.499607    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)

	I0524 11:36:50.511369    1534 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0524 11:36:50.545082    1534 addons.go:420] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml

	I0524 11:36:50.545093    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)

	I0524 11:36:50.571075    1534 addons.go:420] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml

	I0524 11:36:50.571085    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)

	I0524 11:36:50.614490    1534 addons.go:420] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml

	I0524 11:36:50.614502    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)

	I0524 11:36:50.628252    1534 addons.go:420] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0524 11:36:50.628261    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)

	I0524 11:36:50.647925    1534 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0524 11:36:50.858973    1534 kapi.go:248] "coredns" deployment in "kube-system" namespace and "addons-514000" context rescaled to 1 replicas

	I0524 11:36:50.859000    1534 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.105.2 Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0524 11:36:50.862644    1534 out.go:177] * Verifying Kubernetes components...

	I0524 11:36:50.870714    1534 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0524 11:36:51.015230    1534 start.go:916] {"host.minikube.internal": 192.168.105.1} host record injected into CoreDNS's ConfigMap

	W0524 11:36:51.239743    1534 addons.go:446] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I0524 11:36:51.239769    1534 retry.go:31] will retry after 300.967986ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I0524 11:36:51.240163    1534 node_ready.go:35] waiting up to 6m0s for node "addons-514000" to be "Ready" ...

	I0524 11:36:51.242031    1534 node_ready.go:49] node "addons-514000" has status "Ready":"True"

	I0524 11:36:51.242040    1534 node_ready.go:38] duration metric: took 1.869375ms waiting for node "addons-514000" to be "Ready" ...

	I0524 11:36:51.242043    1534 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0524 11:36:51.247820    1534 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5d78c9869d-dmkfx" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:51.542933    1534 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.2/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0524 11:36:53.257970    1534 pod_ready.go:92] pod "coredns-5d78c9869d-dmkfx" in "kube-system" namespace has status "Ready":"True"

	I0524 11:36:53.257986    1534 pod_ready.go:81] duration metric: took 2.01016425s waiting for pod "coredns-5d78c9869d-dmkfx" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.257991    1534 pod_ready.go:78] waiting up to 6m0s for pod "etcd-addons-514000" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.260855    1534 pod_ready.go:92] pod "etcd-addons-514000" in "kube-system" namespace has status "Ready":"True"

	I0524 11:36:53.260862    1534 pod_ready.go:81] duration metric: took 2.866833ms waiting for pod "etcd-addons-514000" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.260867    1534 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-addons-514000" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.263593    1534 pod_ready.go:92] pod "kube-apiserver-addons-514000" in "kube-system" namespace has status "Ready":"True"

	I0524 11:36:53.263598    1534 pod_ready.go:81] duration metric: took 2.728ms waiting for pod "kube-apiserver-addons-514000" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.263603    1534 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-addons-514000" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.266314    1534 pod_ready.go:92] pod "kube-controller-manager-addons-514000" in "kube-system" namespace has status "Ready":"True"

	I0524 11:36:53.266322    1534 pod_ready.go:81] duration metric: took 2.716417ms waiting for pod "kube-controller-manager-addons-514000" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.266326    1534 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-2gj6m" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.268820    1534 pod_ready.go:92] pod "kube-proxy-2gj6m" in "kube-system" namespace has status "Ready":"True"

	I0524 11:36:53.268826    1534 pod_ready.go:81] duration metric: took 2.496209ms waiting for pod "kube-proxy-2gj6m" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.268830    1534 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-addons-514000" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.659694    1534 pod_ready.go:92] pod "kube-scheduler-addons-514000" in "kube-system" namespace has status "Ready":"True"

	I0524 11:36:53.659709    1534 pod_ready.go:81] duration metric: took 390.87725ms waiting for pod "kube-scheduler-addons-514000" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.659719    1534 pod_ready.go:38] duration metric: took 2.417685875s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0524 11:36:53.659737    1534 api_server.go:52] waiting for apiserver process to appear ...

	I0524 11:36:53.659818    1534 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0524 11:36:54.012047    1534 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.2/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (2.469105375s)

	I0524 11:36:54.012061    1534 api_server.go:72] duration metric: took 3.153054583s to wait for apiserver process to appear ...

	I0524 11:36:54.012066    1534 api_server.go:88] waiting for apiserver healthz status ...

	I0524 11:36:54.012074    1534 api_server.go:253] Checking apiserver healthz at https://192.168.105.2:8443/healthz ...

	I0524 11:36:54.015086    1534 api_server.go:279] https://192.168.105.2:8443/healthz returned 200:

	ok

	I0524 11:36:54.015747    1534 api_server.go:141] control plane version: v1.27.2

	I0524 11:36:54.015755    1534 api_server.go:131] duration metric: took 3.685917ms to wait for apiserver health ...

	I0524 11:36:54.015758    1534 system_pods.go:43] waiting for kube-system pods to appear ...

	I0524 11:36:54.018844    1534 system_pods.go:59] 9 kube-system pods found

	I0524 11:36:54.018857    1534 system_pods.go:61] "coredns-5d78c9869d-dmkfx" [03f7079a-733f-488e-a6b1-65e0ca65cffe] Running

	I0524 11:36:54.018861    1534 system_pods.go:61] "etcd-addons-514000" [f53490df-9f65-472d-8c24-fedfb5ff0b40] Running

	I0524 11:36:54.018863    1534 system_pods.go:61] "kube-apiserver-addons-514000" [39ad1080-0c49-4108-8f04-7aded262c978] Running

	I0524 11:36:54.018865    1534 system_pods.go:61] "kube-controller-manager-addons-514000" [8aed5f2f-4439-495f-9454-34920caed37f] Running

	I0524 11:36:54.018868    1534 system_pods.go:61] "kube-proxy-2gj6m" [8d0787ef-32df-4a09-ad1d-48a69a40bb43] Running

	I0524 11:36:54.018870    1534 system_pods.go:61] "kube-scheduler-addons-514000" [98ce7db6-4f70-4fb1-992f-7cf2bf68fb43] Running

	I0524 11:36:54.018873    1534 system_pods.go:61] "snapshot-controller-75bbb956b9-j5jhp" [953964d7-20b0-4fa4-b1ca-f05e6adb94e3] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0524 11:36:54.018876    1534 system_pods.go:61] "snapshot-controller-75bbb956b9-txrxl" [07fe4bd3-7311-4ec4-938d-a195ed8535a8] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0524 11:36:54.018879    1534 system_pods.go:61] "storage-provisioner" [49765353-a5e1-4781-ab06-a554a575daa5] Running

	I0524 11:36:54.018881    1534 system_pods.go:74] duration metric: took 3.121167ms to wait for pod list to return data ...

	I0524 11:36:54.018883    1534 default_sa.go:34] waiting for default service account to be created ...

	I0524 11:36:54.057892    1534 default_sa.go:45] found service account: "default"

	I0524 11:36:54.057899    1534 default_sa.go:55] duration metric: took 39.013541ms for default service account to be created ...

	I0524 11:36:54.057902    1534 system_pods.go:116] waiting for k8s-apps to be running ...

	I0524 11:36:54.259995    1534 system_pods.go:86] 9 kube-system pods found

	I0524 11:36:54.260005    1534 system_pods.go:89] "coredns-5d78c9869d-dmkfx" [03f7079a-733f-488e-a6b1-65e0ca65cffe] Running

	I0524 11:36:54.260008    1534 system_pods.go:89] "etcd-addons-514000" [f53490df-9f65-472d-8c24-fedfb5ff0b40] Running

	I0524 11:36:54.260011    1534 system_pods.go:89] "kube-apiserver-addons-514000" [39ad1080-0c49-4108-8f04-7aded262c978] Running

	I0524 11:36:54.260014    1534 system_pods.go:89] "kube-controller-manager-addons-514000" [8aed5f2f-4439-495f-9454-34920caed37f] Running

	I0524 11:36:54.260016    1534 system_pods.go:89] "kube-proxy-2gj6m" [8d0787ef-32df-4a09-ad1d-48a69a40bb43] Running

	I0524 11:36:54.260019    1534 system_pods.go:89] "kube-scheduler-addons-514000" [98ce7db6-4f70-4fb1-992f-7cf2bf68fb43] Running

	I0524 11:36:54.260023    1534 system_pods.go:89] "snapshot-controller-75bbb956b9-j5jhp" [953964d7-20b0-4fa4-b1ca-f05e6adb94e3] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0524 11:36:54.260027    1534 system_pods.go:89] "snapshot-controller-75bbb956b9-txrxl" [07fe4bd3-7311-4ec4-938d-a195ed8535a8] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0524 11:36:54.260030    1534 system_pods.go:89] "storage-provisioner" [49765353-a5e1-4781-ab06-a554a575daa5] Running

	I0524 11:36:54.260033    1534 system_pods.go:126] duration metric: took 202.129584ms to wait for k8s-apps to be running ...

	I0524 11:36:54.260037    1534 system_svc.go:44] waiting for kubelet service to be running ....

	I0524 11:36:54.260088    1534 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0524 11:36:54.265390    1534 system_svc.go:56] duration metric: took 5.350666ms WaitForService to wait for kubelet.

	I0524 11:36:54.265399    1534 kubeadm.go:581] duration metric: took 3.406395625s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...

	I0524 11:36:54.265408    1534 node_conditions.go:102] verifying NodePressure condition ...

	I0524 11:36:54.458086    1534 node_conditions.go:122] node storage ephemeral capacity is 17784760Ki

	I0524 11:36:54.458097    1534 node_conditions.go:123] node cpu capacity is 2

	I0524 11:36:54.458103    1534 node_conditions.go:105] duration metric: took 192.694167ms to run NodePressure ...

	I0524 11:36:54.458107    1534 start.go:228] waiting for startup goroutines ...

	I0524 11:36:56.972492    1534 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)

	I0524 11:36:56.972559    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:57.029376    1534 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)

	I0524 11:36:57.038824    1534 addons.go:228] Setting addon gcp-auth=true in "addons-514000"

	I0524 11:36:57.038864    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:57.040182    1534 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json

	I0524 11:36:57.040196    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:57.078053    1534 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20230312-helm-chart-4.5.2-28-g66a760794

	I0524 11:36:57.082115    1534 out.go:177]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.0

	I0524 11:36:57.085015    1534 addons.go:420] installing /etc/kubernetes/addons/gcp-auth-ns.yaml

	I0524 11:36:57.085022    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)

	I0524 11:36:57.091862    1534 addons.go:420] installing /etc/kubernetes/addons/gcp-auth-service.yaml

	I0524 11:36:57.091873    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)

	I0524 11:36:57.099462    1534 addons.go:420] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I0524 11:36:57.099472    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5474 bytes)

	I0524 11:36:57.106631    1534 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.2/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I0524 11:36:57.550488    1534 addons.go:464] Verifying addon gcp-auth=true in "addons-514000"

	I0524 11:36:57.555392    1534 out.go:177] * Verifying gcp-auth addon...

	I0524 11:36:57.561721    1534 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...

	I0524 11:36:57.566760    1534 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth

	I0524 11:36:57.566769    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:36:58.070711    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:36:58.570942    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:36:59.076515    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:36:59.570540    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:00.070962    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:00.571104    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:01.071573    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:01.571018    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:02.072518    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:02.570869    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:03.071445    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:03.570661    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:04.070807    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:04.570832    1534 kapi.go:107] duration metric: took 7.009157292s to wait for kubernetes.io/minikube-addons=gcp-auth ...

	I0524 11:37:04.574809    1534 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-514000 cluster.

	I0524 11:37:04.579620    1534 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.

	I0524 11:37:04.583658    1534 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.

	I0524 11:42:50.357445    1534 kapi.go:107] duration metric: took 6m0.009773291s to wait for kubernetes.io/minikube-addons=registry ...

	W0524 11:42:50.357907    1534 out.go:239] ! Enabling 'registry' returned an error: running callbacks: [waiting for kubernetes.io/minikube-addons=registry pods: context deadline exceeded]

	I0524 11:42:50.387243    1534 kapi.go:107] duration metric: took 6m0.001495875s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...

	I0524 11:42:50.387315    1534 kapi.go:107] duration metric: took 6m0.013814333s to wait for app.kubernetes.io/name=ingress-nginx ...

	W0524 11:42:50.387474    1534 out.go:239] ! Enabling 'csi-hostpath-driver' returned an error: running callbacks: [waiting for kubernetes.io/minikube-addons=csi-hostpath-driver pods: context deadline exceeded]

	W0524 11:42:50.387474    1534 out.go:239] ! Enabling 'ingress' returned an error: running callbacks: [waiting for app.kubernetes.io/name=ingress-nginx pods: context deadline exceeded]

	I0524 11:42:50.395532    1534 out.go:177] * Enabled addons: metrics-server, ingress-dns, inspektor-gadget, cloud-spanner, storage-provisioner, default-storageclass, volumesnapshots, gcp-auth

	I0524 11:42:50.403494    1534 addons.go:499] enable addons completed in 6m0.072361709s: enabled=[metrics-server ingress-dns inspektor-gadget cloud-spanner storage-provisioner default-storageclass volumesnapshots gcp-auth]

	I0524 11:42:50.403556    1534 start.go:233] waiting for cluster config update ...

	I0524 11:42:50.403587    1534 start.go:242] writing updated cluster config ...

	I0524 11:42:50.408325    1534 ssh_runner.go:195] Run: rm -f paused

	I0524 11:42:50.568016    1534 start.go:568] kubectl: 1.25.9, cluster: 1.27.2 (minor skew: 2)

	I0524 11:42:50.572568    1534 out.go:177] 

	W0524 11:42:50.576443    1534 out.go:239] ! /usr/local/bin/kubectl is version 1.25.9, which may have incompatibilities with Kubernetes 1.27.2.

	I0524 11:42:50.580476    1534 out.go:177]   - Want kubectl v1.27.2? Try 'minikube kubectl -- get pods -A'

	I0524 11:42:50.587567    1534 out.go:177] * Done! kubectl is now configured to use "addons-514000" cluster and "default" namespace by default

	* 

	* ==> Docker <==

	* -- Journal begins at Wed 2023-05-24 18:36:19 UTC, ends at Wed 2023-05-24 19:04:44 UTC. --

	May 24 18:37:01 addons-514000 dockerd[922]: time="2023-05-24T18:37:01.516120296Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	May 24 18:37:01 addons-514000 dockerd[922]: time="2023-05-24T18:37:01.516129229Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	May 24 18:37:01 addons-514000 dockerd[916]: time="2023-05-24T18:37:01.568789730Z" level=info msg="ignoring event" container=1c671f6b3a5b5c85e0407b694ee5e6e8a1a70743c986a11000612952822acf1e module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 24 18:37:01 addons-514000 dockerd[922]: time="2023-05-24T18:37:01.569050551Z" level=info msg="shim disconnected" id=1c671f6b3a5b5c85e0407b694ee5e6e8a1a70743c986a11000612952822acf1e namespace=moby

	May 24 18:37:01 addons-514000 dockerd[922]: time="2023-05-24T18:37:01.569107330Z" level=warning msg="cleaning up after shim disconnected" id=1c671f6b3a5b5c85e0407b694ee5e6e8a1a70743c986a11000612952822acf1e namespace=moby

	May 24 18:37:01 addons-514000 dockerd[922]: time="2023-05-24T18:37:01.569117420Z" level=info msg="cleaning up dead shim" namespace=moby

	May 24 18:37:01 addons-514000 dockerd[922]: time="2023-05-24T18:37:01.607638824Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	May 24 18:37:01 addons-514000 dockerd[922]: time="2023-05-24T18:37:01.607702137Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	May 24 18:37:01 addons-514000 dockerd[922]: time="2023-05-24T18:37:01.607716942Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	May 24 18:37:01 addons-514000 dockerd[922]: time="2023-05-24T18:37:01.607727942Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	May 24 18:37:01 addons-514000 cri-dockerd[1138]: time="2023-05-24T18:37:01Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/f47df037d99569ad6cd8f4ef2c3926ab0aed2bb5b85f513c520fc0abc42c67f3/resolv.conf as [nameserver 10.96.0.10 search gcp-auth.svc.cluster.local svc.cluster.local cluster.local options ndots:5]"

	May 24 18:37:01 addons-514000 dockerd[916]: time="2023-05-24T18:37:01.953788187Z" level=warning msg="reference for unknown type: " digest="sha256:d730651bb6584f969d95d8279a754cf9d8d31b5055c43dbdb8d7363a8c6371cf" remote="gcr.io/k8s-minikube/gcp-auth-webhook@sha256:d730651bb6584f969d95d8279a754cf9d8d31b5055c43dbdb8d7363a8c6371cf"

	May 24 18:37:02 addons-514000 dockerd[922]: time="2023-05-24T18:37:02.557702813Z" level=info msg="shim disconnected" id=953c17ffdc8ac0b98e66b9d8887f99c9b0a49236e6fd43f2647edb75c5e82150 namespace=moby

	May 24 18:37:02 addons-514000 dockerd[922]: time="2023-05-24T18:37:02.557754555Z" level=warning msg="cleaning up after shim disconnected" id=953c17ffdc8ac0b98e66b9d8887f99c9b0a49236e6fd43f2647edb75c5e82150 namespace=moby

	May 24 18:37:02 addons-514000 dockerd[922]: time="2023-05-24T18:37:02.557759977Z" level=info msg="cleaning up dead shim" namespace=moby

	May 24 18:37:02 addons-514000 dockerd[916]: time="2023-05-24T18:37:02.558086156Z" level=info msg="ignoring event" container=953c17ffdc8ac0b98e66b9d8887f99c9b0a49236e6fd43f2647edb75c5e82150 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 24 18:37:03 addons-514000 dockerd[916]: time="2023-05-24T18:37:03.602683250Z" level=info msg="ignoring event" container=7c145b5b88ef04d8237d20d8374f3a2c4283c8c7c120b4d01e6d9eda3df3496d module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 24 18:37:03 addons-514000 dockerd[922]: time="2023-05-24T18:37:03.603089611Z" level=info msg="shim disconnected" id=7c145b5b88ef04d8237d20d8374f3a2c4283c8c7c120b4d01e6d9eda3df3496d namespace=moby

	May 24 18:37:03 addons-514000 dockerd[922]: time="2023-05-24T18:37:03.603147527Z" level=warning msg="cleaning up after shim disconnected" id=7c145b5b88ef04d8237d20d8374f3a2c4283c8c7c120b4d01e6d9eda3df3496d namespace=moby

	May 24 18:37:03 addons-514000 dockerd[922]: time="2023-05-24T18:37:03.603154445Z" level=info msg="cleaning up dead shim" namespace=moby

	May 24 18:37:03 addons-514000 cri-dockerd[1138]: time="2023-05-24T18:37:03Z" level=info msg="Stop pulling image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.0@sha256:d730651bb6584f969d95d8279a754cf9d8d31b5055c43dbdb8d7363a8c6371cf: Status: Downloaded newer image for gcr.io/k8s-minikube/gcp-auth-webhook@sha256:d730651bb6584f969d95d8279a754cf9d8d31b5055c43dbdb8d7363a8c6371cf"

	May 24 18:37:03 addons-514000 dockerd[922]: time="2023-05-24T18:37:03.856707697Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	May 24 18:37:03 addons-514000 dockerd[922]: time="2023-05-24T18:37:03.856808407Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	May 24 18:37:03 addons-514000 dockerd[922]: time="2023-05-24T18:37:03.856985177Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	May 24 18:37:03 addons-514000 dockerd[922]: time="2023-05-24T18:37:03.856997233Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	* 

	* ==> container status <==

	* CONTAINER           IMAGE                                                                                                                     CREATED             STATE               NAME                         ATTEMPT             POD ID

	d1ad6d2cd7d4d       gcr.io/k8s-minikube/gcp-auth-webhook@sha256:d730651bb6584f969d95d8279a754cf9d8d31b5055c43dbdb8d7363a8c6371cf              27 minutes ago      Running             gcp-auth                     0                   f47df037d9956

	2623eeac77855       registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280   27 minutes ago      Running             volume-snapshot-controller   0                   60ea5019d1f26

	61fdb94dca547       registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280   27 minutes ago      Running             volume-snapshot-controller   0                   1f82f1afb5ca6

	5e708965dbb0a       97e04611ad434                                                                                                             27 minutes ago      Running             coredns                      0                   eaf04536825bb

	c6d1bdca910b8       ba04bb24b9575                                                                                                             27 minutes ago      Running             storage-provisioner          0                   55be207be2898

	bf84d832ec967       29921a0845422                                                                                                             27 minutes ago      Running             kube-proxy                   0                   59d50204b0754

	046435c695b1e       305d7ed1dae28                                                                                                             28 minutes ago      Running             kube-scheduler               0                   cd9a002bb369c

	aa80b21f85087       2ee705380c3c5                                                                                                             28 minutes ago      Running             kube-controller-manager      0                   0ebf3f27cb768

	d5556d8565d49       24bc64e911039                                                                                                             28 minutes ago      Running             etcd                         0                   37fcc92ec98a7

	a485542b186e4       72c9df6be7f1b                                                                                                             28 minutes ago      Running             kube-apiserver               0                   383872bb10f81

	* 

	* ==> coredns [5e708965dbb0] <==

	* .:53

	[INFO] plugin/reload: Running configuration SHA512 = ea7a0d73d9d208f758b1f67640ef03c58089b9d9366cf3478df3bb369b210e39f213811b46224f8a04380814b6e0890ccd358f5b5e8c80bc22ac19c8601ee35b

	CoreDNS-1.10.1

	linux/arm64, go1.20, 055b2c3

	[INFO] 127.0.0.1:59819 - 54023 "HINFO IN 5089267470380203033.66065138292483152. udp 55 false 512" NXDOMAIN qr,rd,ra 130 0.424436073s

	[INFO] 10.244.0.7:57634 - 60032 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000112931s

	[INFO] 10.244.0.7:36916 - 20311 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000078547s

	[INFO] 10.244.0.7:53888 - 30613 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000056548s

	[INFO] 10.244.0.7:40805 - 41575 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000031112s

	[INFO] 10.244.0.7:39418 - 54110 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000031567s

	[INFO] 10.244.0.7:45485 - 20279 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000113676s

	[INFO] 10.244.0.7:49511 - 45953 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 534 0.000780781s

	[INFO] 10.244.0.7:49660 - 37020 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.00090552s

	* 

	* ==> describe nodes <==

	* Name:               addons-514000

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=arm64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=arm64

	                    kubernetes.io/hostname=addons-514000

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=d23ad66c17ded3bf1d7d6fb0fa0ee29881f9547e

	                    minikube.k8s.io/name=addons-514000

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2023_05_24T11_36_37_0700

	                    minikube.k8s.io/version=v1.30.1

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Wed, 24 May 2023 18:36:34 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  addons-514000

	  AcquireTime:     <unset>

	  RenewTime:       Wed, 24 May 2023 19:04:43 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Wed, 24 May 2023 19:02:41 +0000   Wed, 24 May 2023 18:36:33 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Wed, 24 May 2023 19:02:41 +0000   Wed, 24 May 2023 18:36:33 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Wed, 24 May 2023 19:02:41 +0000   Wed, 24 May 2023 18:36:33 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Wed, 24 May 2023 19:02:41 +0000   Wed, 24 May 2023 18:36:39 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.105.2

	  Hostname:    addons-514000

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17784760Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3905972Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17784760Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3905972Ki

	  pods:               110

	System Info:

	  Machine ID:                 cc66183cd0c646be999944d821185b81

	  System UUID:                cc66183cd0c646be999944d821185b81

	  Boot ID:                    2cd753bf-40ed-44ce-928e-d8bb002a6012

	  Kernel Version:             5.10.57

	  OS Image:                   Buildroot 2021.02.12

	  Operating System:           linux

	  Architecture:               arm64

	  Container Runtime Version:  docker://20.10.23

	  Kubelet Version:            v1.27.2

	  Kube-Proxy Version:         v1.27.2

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (10 in total)

	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---

	  gcp-auth                    gcp-auth-58478865f7-5429c                0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         27m

	  kube-system                 coredns-5d78c9869d-dmkfx                 100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (1%!)(MISSING)        170Mi (4%!)(MISSING)     27m

	  kube-system                 etcd-addons-514000                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (2%!)(MISSING)       0 (0%!)(MISSING)         28m

	  kube-system                 kube-apiserver-addons-514000             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         28m

	  kube-system                 kube-controller-manager-addons-514000    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         28m

	  kube-system                 kube-proxy-2gj6m                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         27m

	  kube-system                 kube-scheduler-addons-514000             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         28m

	  kube-system                 snapshot-controller-75bbb956b9-j5jhp     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         27m

	  kube-system                 snapshot-controller-75bbb956b9-txrxl     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         27m

	  kube-system                 storage-provisioner                      0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         27m

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%!)(MISSING)  0 (0%!)(MISSING)

	  memory             170Mi (4%!)(MISSING)  170Mi (4%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-32Mi     0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-64Ki     0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age   From             Message

	  ----    ------                   ----  ----             -------

	  Normal  Starting                 27m   kube-proxy       

	  Normal  Starting                 28m   kubelet          Starting kubelet.

	  Normal  NodeAllocatableEnforced  28m   kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  28m   kubelet          Node addons-514000 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    28m   kubelet          Node addons-514000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     28m   kubelet          Node addons-514000 status is now: NodeHasSufficientPID

	  Normal  NodeReady                28m   kubelet          Node addons-514000 status is now: NodeReady

	  Normal  RegisteredNode           27m   node-controller  Node addons-514000 event: Registered Node addons-514000 in Controller

	* 

	* ==> dmesg <==

	* [May24 18:36] ACPI: SRAT not present

	[  +0.000000] KASLR disabled due to lack of seed

	[  +0.727578] EINJ: EINJ table not found.

	[  +0.656332] systemd-fstab-generator[114]: Ignoring "noauto" for root device

	[  +0.043407] systemd[1]: systemd-journald.service: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.

	[  +0.000915] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)

	[  +3.905553] systemd-fstab-generator[471]: Ignoring "noauto" for root device

	[  +0.096232] systemd-fstab-generator[482]: Ignoring "noauto" for root device

	[  +2.874276] systemd-fstab-generator[684]: Ignoring "noauto" for root device

	[  +1.463827] systemd-fstab-generator[849]: Ignoring "noauto" for root device

	[  +0.166355] systemd-fstab-generator[885]: Ignoring "noauto" for root device

	[  +0.076432] systemd-fstab-generator[896]: Ignoring "noauto" for root device

	[  +0.091985] systemd-fstab-generator[909]: Ignoring "noauto" for root device

	[  +1.135416] kauditd_printk_skb: 53 callbacks suppressed

	[  +0.091978] systemd-fstab-generator[1057]: Ignoring "noauto" for root device

	[  +0.084182] systemd-fstab-generator[1068]: Ignoring "noauto" for root device

	[  +0.089221] systemd-fstab-generator[1079]: Ignoring "noauto" for root device

	[  +0.079548] systemd-fstab-generator[1090]: Ignoring "noauto" for root device

	[  +0.085105] systemd-fstab-generator[1131]: Ignoring "noauto" for root device

	[  +2.454751] systemd-fstab-generator[1385]: Ignoring "noauto" for root device

	[  +5.146027] systemd-fstab-generator[2260]: Ignoring "noauto" for root device

	[ +14.118818] kauditd_printk_skb: 41 callbacks suppressed

	[  +2.617169] TCP: eth0: Driver has suspect GRO implementation, TCP performance may be compromised.

	[  +3.922890] kauditd_printk_skb: 33 callbacks suppressed

	[May24 18:37] kauditd_printk_skb: 17 callbacks suppressed

	* 

	* ==> etcd [d5556d8565d4] <==

	* {"level":"info","ts":"2023-05-24T18:36:33.832Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 became leader at term 2"}

	{"level":"info","ts":"2023-05-24T18:36:33.832Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: c46d288d2fcb0590 elected leader c46d288d2fcb0590 at term 2"}

	{"level":"info","ts":"2023-05-24T18:36:33.834Z","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"c46d288d2fcb0590","local-member-attributes":"{Name:addons-514000 ClientURLs:[https://192.168.105.2:2379]}","request-path":"/0/members/c46d288d2fcb0590/attributes","cluster-id":"6e03e7863b4f9c54","publish-timeout":"7s"}

	{"level":"info","ts":"2023-05-24T18:36:33.834Z","caller":"embed/serve.go:100","msg":"ready to serve client requests"}

	{"level":"info","ts":"2023-05-24T18:36:33.835Z","caller":"embed/serve.go:198","msg":"serving client traffic securely","address":"192.168.105.2:2379"}

	{"level":"info","ts":"2023-05-24T18:36:33.834Z","caller":"etcdserver/server.go:2571","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}

	{"level":"info","ts":"2023-05-24T18:36:33.835Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}

	{"level":"info","ts":"2023-05-24T18:36:33.835Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}

	{"level":"info","ts":"2023-05-24T18:36:33.834Z","caller":"embed/serve.go:100","msg":"ready to serve client requests"}

	{"level":"info","ts":"2023-05-24T18:36:33.838Z","caller":"embed/serve.go:198","msg":"serving client traffic securely","address":"127.0.0.1:2379"}

	{"level":"info","ts":"2023-05-24T18:36:33.838Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"6e03e7863b4f9c54","local-member-id":"c46d288d2fcb0590","cluster-version":"3.5"}

	{"level":"info","ts":"2023-05-24T18:36:33.838Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}

	{"level":"info","ts":"2023-05-24T18:36:33.838Z","caller":"etcdserver/server.go:2595","msg":"cluster version is updated","cluster-version":"3.5"}

	{"level":"info","ts":"2023-05-24T18:46:33.876Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":846}

	{"level":"info","ts":"2023-05-24T18:46:33.881Z","caller":"mvcc/kvstore_compaction.go:66","msg":"finished scheduled compaction","compact-revision":846,"took":"3.400485ms","hash":3638416343}

	{"level":"info","ts":"2023-05-24T18:46:33.882Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":3638416343,"revision":846,"compact-revision":-1}

	{"level":"info","ts":"2023-05-24T18:51:33.887Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1145}

	{"level":"info","ts":"2023-05-24T18:51:33.890Z","caller":"mvcc/kvstore_compaction.go:66","msg":"finished scheduled compaction","compact-revision":1145,"took":"2.024563ms","hash":894933936}

	{"level":"info","ts":"2023-05-24T18:51:33.890Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":894933936,"revision":1145,"compact-revision":846}

	{"level":"info","ts":"2023-05-24T18:56:33.899Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1444}

	{"level":"info","ts":"2023-05-24T18:56:33.902Z","caller":"mvcc/kvstore_compaction.go:66","msg":"finished scheduled compaction","compact-revision":1444,"took":"1.805765ms","hash":2332186912}

	{"level":"info","ts":"2023-05-24T18:56:33.902Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":2332186912,"revision":1444,"compact-revision":1145}

	{"level":"info","ts":"2023-05-24T19:01:33.910Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1744}

	{"level":"info","ts":"2023-05-24T19:01:33.913Z","caller":"mvcc/kvstore_compaction.go:66","msg":"finished scheduled compaction","compact-revision":1744,"took":"1.711146ms","hash":1851239145}

	{"level":"info","ts":"2023-05-24T19:01:33.913Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":1851239145,"revision":1744,"compact-revision":1444}

	* 

	* ==> gcp-auth [d1ad6d2cd7d4] <==

	* 2023/05/24 18:37:03 GCP Auth Webhook started!

	* 

	* ==> kernel <==

	*  19:04:44 up 28 min,  0 users,  load average: 0.26, 0.48, 0.48

	Linux addons-514000 5.10.57 #1 SMP PREEMPT Sat May 20 00:35:14 UTC 2023 aarch64 GNU/Linux

	PRETTY_NAME="Buildroot 2021.02.12"

	* 

	* ==> kube-apiserver [a485542b186e] <==

	* I0524 18:36:57.610279       1 controller.go:624] quota admission added evaluator for: jobs.batch

	I0524 18:41:34.543984       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 18:41:34.544093       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 18:46:34.544191       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 18:46:34.544366       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 18:46:34.554262       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 18:46:34.554305       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 18:46:34.559325       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 18:46:34.559355       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 18:51:34.542946       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 18:51:34.543557       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 18:51:34.550014       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 18:51:34.550133       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 18:51:34.556769       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 18:51:34.556848       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 18:56:34.536214       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 18:56:34.536373       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 18:56:34.548003       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 18:56:34.548106       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 19:01:34.537192       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 19:01:34.537290       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 19:01:34.537554       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 19:01:34.537601       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 19:01:34.538264       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 19:01:34.538305       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	* 

	* ==> kube-controller-manager [aa80b21f8508] <==

	* I0524 18:37:01.505510       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-create

	I0524 18:37:01.519013       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch

	I0524 18:37:02.495937       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch

	I0524 18:37:02.582819       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-create

	I0524 18:37:03.506916       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-create

	I0524 18:37:03.513803       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch

	I0524 18:37:03.593747       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-create

	I0524 18:37:03.596306       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-create

	I0524 18:37:03.598360       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-create

	I0524 18:37:03.598521       1 event.go:307] "Event occurred" object="gcp-auth/gcp-auth-certs-create" fieldPath="" kind="Job" apiVersion="batch/v1" type="Normal" reason="Completed" message="Job completed"

	I0524 18:37:03.685792       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch

	I0524 18:37:04.524940       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch

	I0524 18:37:04.535090       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch

	I0524 18:37:04.540969       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch

	I0524 18:37:04.541239       1 event.go:307] "Event occurred" object="gcp-auth/gcp-auth-certs-patch" fieldPath="" kind="Job" apiVersion="batch/v1" type="Normal" reason="Completed" message="Job completed"

	I0524 18:37:04.555353       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch

	I0524 18:37:20.560907       1 resource_quota_monitor.go:223] "QuotaMonitor created object count evaluator" resource="volumesnapshots.snapshot.storage.k8s.io"

	I0524 18:37:20.561333       1 shared_informer.go:311] Waiting for caches to sync for resource quota

	I0524 18:37:20.662721       1 shared_informer.go:318] Caches are synced for resource quota

	I0524 18:37:20.895710       1 shared_informer.go:311] Waiting for caches to sync for garbage collector

	I0524 18:37:20.999329       1 shared_informer.go:318] Caches are synced for garbage collector

	I0524 18:37:33.024397       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-create

	I0524 18:37:33.041354       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-create

	I0524 18:37:34.012720       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch

	I0524 18:37:34.026381       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch

	* 

	* ==> kube-proxy [bf84d832ec96] <==

	* I0524 18:36:51.096070       1 node.go:141] Successfully retrieved node IP: 192.168.105.2

	I0524 18:36:51.096254       1 server_others.go:110] "Detected node IP" address="192.168.105.2"

	I0524 18:36:51.096305       1 server_others.go:551] "Using iptables proxy"

	I0524 18:36:51.129985       1 server_others.go:176] "kube-proxy running in single-stack mode: secondary ipFamily is not supported" ipFamily=IPv6

	I0524 18:36:51.130045       1 server_others.go:190] "Using iptables Proxier"

	I0524 18:36:51.130091       1 proxier.go:253] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"

	I0524 18:36:51.130875       1 server.go:657] "Version info" version="v1.27.2"

	I0524 18:36:51.130883       1 server.go:659] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0524 18:36:51.134580       1 config.go:188] "Starting service config controller"

	I0524 18:36:51.134608       1 shared_informer.go:311] Waiting for caches to sync for service config

	I0524 18:36:51.134627       1 config.go:97] "Starting endpoint slice config controller"

	I0524 18:36:51.134630       1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config

	I0524 18:36:51.134949       1 config.go:315] "Starting node config controller"

	I0524 18:36:51.134952       1 shared_informer.go:311] Waiting for caches to sync for node config

	I0524 18:36:51.240491       1 shared_informer.go:318] Caches are synced for node config

	I0524 18:36:51.240513       1 shared_informer.go:318] Caches are synced for service config

	I0524 18:36:51.240529       1 shared_informer.go:318] Caches are synced for endpoint slice config

	* 

	* ==> kube-scheduler [046435c695b1] <==

	* W0524 18:36:34.551296       1 reflector.go:533] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0524 18:36:34.551335       1 reflector.go:148] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	W0524 18:36:34.555158       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E0524 18:36:34.555224       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	W0524 18:36:34.555257       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0524 18:36:34.555277       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	W0524 18:36:34.555318       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E0524 18:36:34.555338       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	W0524 18:36:34.555364       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0524 18:36:34.555398       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	W0524 18:36:34.555416       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0524 18:36:34.555434       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	W0524 18:36:35.414754       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0524 18:36:35.414831       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	W0524 18:36:35.419590       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0524 18:36:35.419621       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	W0524 18:36:35.431658       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E0524 18:36:35.431697       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	W0524 18:36:35.542100       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0524 18:36:35.542130       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	W0524 18:36:35.557940       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0524 18:36:35.558018       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	W0524 18:36:35.599004       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0524 18:36:35.599089       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	I0524 18:36:36.142741       1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	* 

	* ==> kubelet <==

	* -- Journal begins at Wed 2023-05-24 18:36:19 UTC, ends at Wed 2023-05-24 19:04:44 UTC. --

	May 24 18:59:37 addons-514000 kubelet[2266]: E0524 18:59:37.219146    2266 iptables.go:575] "Could not set up iptables canary" err=<

	May 24 18:59:37 addons-514000 kubelet[2266]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	May 24 18:59:37 addons-514000 kubelet[2266]:         Perhaps ip6tables or your kernel needs to be upgraded.

	May 24 18:59:37 addons-514000 kubelet[2266]:  > table=nat chain=KUBE-KUBELET-CANARY

	May 24 19:00:37 addons-514000 kubelet[2266]: E0524 19:00:37.312409    2266 iptables.go:575] "Could not set up iptables canary" err=<

	May 24 19:00:37 addons-514000 kubelet[2266]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	May 24 19:00:37 addons-514000 kubelet[2266]:         Perhaps ip6tables or your kernel needs to be upgraded.

	May 24 19:00:37 addons-514000 kubelet[2266]:  > table=nat chain=KUBE-KUBELET-CANARY

	May 24 19:01:37 addons-514000 kubelet[2266]: E0524 19:01:37.211178    2266 iptables.go:575] "Could not set up iptables canary" err=<

	May 24 19:01:37 addons-514000 kubelet[2266]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	May 24 19:01:37 addons-514000 kubelet[2266]:         Perhaps ip6tables or your kernel needs to be upgraded.

	May 24 19:01:37 addons-514000 kubelet[2266]:  > table=nat chain=KUBE-KUBELET-CANARY

	May 24 19:01:37 addons-514000 kubelet[2266]: W0524 19:01:37.216820    2266 machine.go:65] Cannot read vendor id correctly, set empty.

	May 24 19:02:37 addons-514000 kubelet[2266]: E0524 19:02:37.212957    2266 iptables.go:575] "Could not set up iptables canary" err=<

	May 24 19:02:37 addons-514000 kubelet[2266]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	May 24 19:02:37 addons-514000 kubelet[2266]:         Perhaps ip6tables or your kernel needs to be upgraded.

	May 24 19:02:37 addons-514000 kubelet[2266]:  > table=nat chain=KUBE-KUBELET-CANARY

	May 24 19:03:37 addons-514000 kubelet[2266]: E0524 19:03:37.209339    2266 iptables.go:575] "Could not set up iptables canary" err=<

	May 24 19:03:37 addons-514000 kubelet[2266]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	May 24 19:03:37 addons-514000 kubelet[2266]:         Perhaps ip6tables or your kernel needs to be upgraded.

	May 24 19:03:37 addons-514000 kubelet[2266]:  > table=nat chain=KUBE-KUBELET-CANARY

	May 24 19:04:37 addons-514000 kubelet[2266]: E0524 19:04:37.208780    2266 iptables.go:575] "Could not set up iptables canary" err=<

	May 24 19:04:37 addons-514000 kubelet[2266]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	May 24 19:04:37 addons-514000 kubelet[2266]:         Perhaps ip6tables or your kernel needs to be upgraded.

	May 24 19:04:37 addons-514000 kubelet[2266]:  > table=nat chain=KUBE-KUBELET-CANARY

	* 

	* ==> storage-provisioner [c6d1bdca910b] <==

	* I0524 18:36:52.162540       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0524 18:36:52.179095       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0524 18:36:52.179236       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I0524 18:36:52.184538       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0524 18:36:52.185437       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-514000_06403223-0fe7-4b51-9128-30a4ab7aa15a!

	I0524 18:36:52.187871       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"6d6698b6-9eb5-4aee-aab5-f9c270917482", APIVersion:"v1", ResourceVersion:"417", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-514000_06403223-0fe7-4b51-9128-30a4ab7aa15a became leader

	I0524 18:36:52.285999       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-514000_06403223-0fe7-4b51-9128-30a4ab7aa15a!

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.APIServer}} -p addons-514000 -n addons-514000

helpers_test.go:261: (dbg) Run:  kubectl --context addons-514000 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:285: <<< TestAddons/parallel/Ingress FAILED: end of post-mortem logs <<<

helpers_test.go:286: ---------------------/post-mortem---------------------------------

--- FAIL: TestAddons/parallel/Ingress (0.79s)

=== RUN   TestAddons/parallel/InspektorGadget

=== PAUSE TestAddons/parallel/InspektorGadget

=== CONT  TestAddons/parallel/InspektorGadget

addons_test.go:814: (dbg) TestAddons/parallel/InspektorGadget: waiting 8m0s for pods matching "k8s-app=gadget" in namespace "gadget" ...

helpers_test.go:329: TestAddons/parallel/InspektorGadget: WARNING: pod list for "gadget" "k8s-app=gadget" returned: client rate limiter Wait returned an error: context deadline exceeded

addons_test.go:814: ***** TestAddons/parallel/InspektorGadget: pod "k8s-app=gadget" failed to start within 8m0s: context deadline exceeded ****

addons_test.go:814: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.APIServer}} -p addons-514000 -n addons-514000

addons_test.go:814: TestAddons/parallel/InspektorGadget: showing logs for failed pods as of 2023-05-24 12:04:42.975461 -0700 PDT m=+1739.826957292

addons_test.go:815: failed waiting for inspektor-gadget pod: k8s-app=gadget within 8m0s: context deadline exceeded

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p addons-514000 -n addons-514000

helpers_test.go:244: <<< TestAddons/parallel/InspektorGadget FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestAddons/parallel/InspektorGadget]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-darwin-arm64 -p addons-514000 logs -n 25

helpers_test.go:252: TestAddons/parallel/InspektorGadget logs: 

-- stdout --

	* 

	* ==> Audit <==

	* |---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|

	| Command |              Args              |       Profile        |  User   | Version |     Start Time      |      End Time       |

	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|

	| start   | -o=json --download-only        | download-only-108000 | jenkins | v1.30.1 | 24 May 23 11:35 PDT |                     |

	|         | -p download-only-108000        |                      |         |         |                     |                     |

	|         | --force --alsologtostderr      |                      |         |         |                     |                     |

	|         | --kubernetes-version=v1.16.0   |                      |         |         |                     |                     |

	|         | --container-runtime=docker     |                      |         |         |                     |                     |

	|         | --driver=qemu2                 |                      |         |         |                     |                     |

	| start   | -o=json --download-only        | download-only-108000 | jenkins | v1.30.1 | 24 May 23 11:35 PDT |                     |

	|         | -p download-only-108000        |                      |         |         |                     |                     |

	|         | --force --alsologtostderr      |                      |         |         |                     |                     |

	|         | --kubernetes-version=v1.27.2   |                      |         |         |                     |                     |

	|         | --container-runtime=docker     |                      |         |         |                     |                     |

	|         | --driver=qemu2                 |                      |         |         |                     |                     |

	| delete  | --all                          | minikube             | jenkins | v1.30.1 | 24 May 23 11:36 PDT | 24 May 23 11:36 PDT |

	| delete  | -p download-only-108000        | download-only-108000 | jenkins | v1.30.1 | 24 May 23 11:36 PDT | 24 May 23 11:36 PDT |

	| delete  | -p download-only-108000        | download-only-108000 | jenkins | v1.30.1 | 24 May 23 11:36 PDT | 24 May 23 11:36 PDT |

	| start   | --download-only -p             | binary-mirror-689000 | jenkins | v1.30.1 | 24 May 23 11:36 PDT |                     |

	|         | binary-mirror-689000           |                      |         |         |                     |                     |

	|         | --alsologtostderr              |                      |         |         |                     |                     |

	|         | --binary-mirror                |                      |         |         |                     |                     |

	|         | http://127.0.0.1:49309         |                      |         |         |                     |                     |

	|         | --driver=qemu2                 |                      |         |         |                     |                     |

	| delete  | -p binary-mirror-689000        | binary-mirror-689000 | jenkins | v1.30.1 | 24 May 23 11:36 PDT | 24 May 23 11:36 PDT |

	| start   | -p addons-514000               | addons-514000        | jenkins | v1.30.1 | 24 May 23 11:36 PDT | 24 May 23 11:42 PDT |

	|         | --wait=true --memory=4000      |                      |         |         |                     |                     |

	|         | --alsologtostderr              |                      |         |         |                     |                     |

	|         | --addons=registry              |                      |         |         |                     |                     |

	|         | --addons=metrics-server        |                      |         |         |                     |                     |

	|         | --addons=volumesnapshots       |                      |         |         |                     |                     |

	|         | --addons=csi-hostpath-driver   |                      |         |         |                     |                     |

	|         | --addons=gcp-auth              |                      |         |         |                     |                     |

	|         | --addons=cloud-spanner         |                      |         |         |                     |                     |

	|         | --addons=inspektor-gadget      |                      |         |         |                     |                     |

	|         | --driver=qemu2                 |                      |         |         |                     |                     |

	|         | --addons=ingress               |                      |         |         |                     |                     |

	|         | --addons=ingress-dns           |                      |         |         |                     |                     |

	| addons  | disable cloud-spanner -p       | addons-514000        | jenkins | v1.30.1 | 24 May 23 11:54 PDT |                     |

	|         | addons-514000                  |                      |         |         |                     |                     |

	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|

	* 

	* ==> Last Start <==

	* Log file created at: 2023/05/24 11:36:07

	Running on machine: MacOS-M1-Agent-1

	Binary: Built with gc go1.20.4 for darwin/arm64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0524 11:36:07.002339    1534 out.go:296] Setting OutFile to fd 1 ...

	I0524 11:36:07.002453    1534 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0524 11:36:07.002456    1534 out.go:309] Setting ErrFile to fd 2...

	I0524 11:36:07.002459    1534 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0524 11:36:07.002536    1534 root.go:336] Updating PATH: /Users/jenkins/minikube-integration/16573-1024/.minikube/bin

	I0524 11:36:07.003586    1534 out.go:303] Setting JSON to false

	I0524 11:36:07.018861    1534 start.go:125] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":338,"bootTime":1684953029,"procs":422,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"13.3.1","kernelVersion":"22.4.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}

	W0524 11:36:07.018925    1534 start.go:133] gopshost.Virtualization returned error: not implemented yet

	I0524 11:36:07.027769    1534 out.go:177] * [addons-514000] minikube v1.30.1 on Darwin 13.3.1 (arm64)

	I0524 11:36:07.031820    1534 out.go:177]   - MINIKUBE_LOCATION=16573

	I0524 11:36:07.031893    1534 notify.go:220] Checking for updates...

	I0524 11:36:07.038648    1534 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/16573-1024/kubeconfig

	I0524 11:36:07.041871    1534 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0524 11:36:07.045796    1534 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0524 11:36:07.047102    1534 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/16573-1024/.minikube

	I0524 11:36:07.049751    1534 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0524 11:36:07.052962    1534 driver.go:375] Setting default libvirt URI to qemu:///system

	I0524 11:36:07.056656    1534 out.go:177] * Using the qemu2 driver based on user configuration

	I0524 11:36:07.063768    1534 start.go:295] selected driver: qemu2

	I0524 11:36:07.063774    1534 start.go:870] validating driver "qemu2" against <nil>

	I0524 11:36:07.063780    1534 start.go:881] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0524 11:36:07.066216    1534 start_flags.go:305] no existing cluster config was found, will generate one from the flags 

	I0524 11:36:07.068844    1534 out.go:177] * Automatically selected the socket_vmnet network

	I0524 11:36:07.072801    1534 start_flags.go:915] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0524 11:36:07.072817    1534 cni.go:84] Creating CNI manager for ""

	I0524 11:36:07.072825    1534 cni.go:157] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0524 11:36:07.072829    1534 start_flags.go:314] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0524 11:36:07.072834    1534 start_flags.go:319] config:

	{Name:addons-514000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684536746-16501@sha256:f5d93abf1d1cfb142a7cf0b58b24029595d621e5f943105b16c61199094d77de Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.2 ClusterName:addons-514000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CR

ISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}

	I0524 11:36:07.072903    1534 iso.go:125] acquiring lock: {Name:mk78431aa792d64459e9d8bd2fb1ce84dc420421 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0524 11:36:07.080756    1534 out.go:177] * Starting control plane node addons-514000 in cluster addons-514000

	I0524 11:36:07.084763    1534 preload.go:132] Checking if preload exists for k8s version v1.27.2 and runtime docker

	I0524 11:36:07.084787    1534 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/16573-1024/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.2-docker-overlay2-arm64.tar.lz4

	I0524 11:36:07.084798    1534 cache.go:57] Caching tarball of preloaded images

	I0524 11:36:07.084855    1534 preload.go:174] Found /Users/jenkins/minikube-integration/16573-1024/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0524 11:36:07.084860    1534 cache.go:60] Finished verifying existence of preloaded tar for  v1.27.2 on docker

	I0524 11:36:07.085026    1534 profile.go:148] Saving config to /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/config.json ...

	I0524 11:36:07.085039    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/config.json: {Name:mk030e94b16168c63405a9b01e247098a953bb00 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:07.085215    1534 cache.go:195] Successfully downloaded all kic artifacts

	I0524 11:36:07.085252    1534 start.go:364] acquiring machines lock for addons-514000: {Name:mkb37a68e9ac84a7c17b3cbe42c3966e2ec65b65 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0524 11:36:07.085315    1534 start.go:368] acquired machines lock for "addons-514000" in 57.708µs

	I0524 11:36:07.085327    1534 start.go:93] Provisioning new machine with config: &{Name:addons-514000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/16501/minikube-v1.30.1-1684536668-16501-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684536746-16501@sha256:f5d93abf1d1cfb142a7cf0b58b24029595d621e5f943105b16c61199094d77de Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi

g:{KubernetesVersion:v1.27.2 ClusterName:addons-514000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262

144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:} &{Name: IP: Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0524 11:36:07.085355    1534 start.go:125] createHost starting for "" (driver="qemu2")

	I0524 11:36:07.093778    1534 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	I0524 11:36:07.463575    1534 start.go:159] libmachine.API.Create for "addons-514000" (driver="qemu2")

	I0524 11:36:07.463635    1534 client.go:168] LocalClient.Create starting

	I0524 11:36:07.463808    1534 main.go:141] libmachine: Creating CA: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca.pem

	I0524 11:36:07.521208    1534 main.go:141] libmachine: Creating client certificate: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/cert.pem

	I0524 11:36:07.678481    1534 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/16573-1024/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/16573-1024/.minikube/cache/iso/arm64/minikube-v1.30.1-1684536668-16501-arm64.iso...

	I0524 11:36:08.060894    1534 main.go:141] libmachine: Creating SSH key...

	I0524 11:36:08.147520    1534 main.go:141] libmachine: Creating Disk image...

	I0524 11:36:08.147526    1534 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0524 11:36:08.147754    1534 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/disk.qcow2.raw /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/disk.qcow2

	I0524 11:36:08.231403    1534 main.go:141] libmachine: STDOUT: 

	I0524 11:36:08.231426    1534 main.go:141] libmachine: STDERR: 

	I0524 11:36:08.231485    1534 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/disk.qcow2 +20000M

	I0524 11:36:08.238737    1534 main.go:141] libmachine: STDOUT: Image resized.

	I0524 11:36:08.238750    1534 main.go:141] libmachine: STDERR: 

	I0524 11:36:08.238766    1534 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/disk.qcow2.raw and /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/disk.qcow2

	I0524 11:36:08.238773    1534 main.go:141] libmachine: Starting QEMU VM...

	I0524 11:36:08.238817    1534 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt -cpu host -drive file=/opt/homebrew/Cellar/qemu/7.2.0/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 4000 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/qemu.pid -device virtio-net-pci,netdev=net0,mac=0a:73:48:f5:f9:b3 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/disk.qcow2

	I0524 11:36:08.309201    1534 main.go:141] libmachine: STDOUT: 

	I0524 11:36:08.309237    1534 main.go:141] libmachine: STDERR: 

	I0524 11:36:08.309242    1534 main.go:141] libmachine: Attempt 0

	I0524 11:36:08.309258    1534 main.go:141] libmachine: Searching for a:73:48:f5:f9:b3 in /var/db/dhcpd_leases ...

	I0524 11:36:10.311441    1534 main.go:141] libmachine: Attempt 1

	I0524 11:36:10.311529    1534 main.go:141] libmachine: Searching for a:73:48:f5:f9:b3 in /var/db/dhcpd_leases ...

	I0524 11:36:12.313222    1534 main.go:141] libmachine: Attempt 2

	I0524 11:36:12.313245    1534 main.go:141] libmachine: Searching for a:73:48:f5:f9:b3 in /var/db/dhcpd_leases ...

	I0524 11:36:14.315294    1534 main.go:141] libmachine: Attempt 3

	I0524 11:36:14.315307    1534 main.go:141] libmachine: Searching for a:73:48:f5:f9:b3 in /var/db/dhcpd_leases ...

	I0524 11:36:16.317343    1534 main.go:141] libmachine: Attempt 4

	I0524 11:36:16.317356    1534 main.go:141] libmachine: Searching for a:73:48:f5:f9:b3 in /var/db/dhcpd_leases ...

	I0524 11:36:18.319398    1534 main.go:141] libmachine: Attempt 5

	I0524 11:36:18.319426    1534 main.go:141] libmachine: Searching for a:73:48:f5:f9:b3 in /var/db/dhcpd_leases ...

	I0524 11:36:20.321607    1534 main.go:141] libmachine: Attempt 6

	I0524 11:36:20.321690    1534 main.go:141] libmachine: Searching for a:73:48:f5:f9:b3 in /var/db/dhcpd_leases ...

	I0524 11:36:20.321979    1534 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I0524 11:36:20.322073    1534 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:a:73:48:f5:f9:b3 ID:1,a:73:48:f5:f9:b3 Lease:0x646faaa3}

	I0524 11:36:20.322118    1534 main.go:141] libmachine: Found match: a:73:48:f5:f9:b3

	I0524 11:36:20.322159    1534 main.go:141] libmachine: IP: 192.168.105.2

	I0524 11:36:20.322182    1534 main.go:141] libmachine: Waiting for VM to start (ssh -p 22 docker@192.168.105.2)...

	I0524 11:36:22.345943    1534 machine.go:88] provisioning docker machine ...

	I0524 11:36:22.346010    1534 buildroot.go:166] provisioning hostname "addons-514000"

	I0524 11:36:22.346753    1534 main.go:141] libmachine: Using SSH client type: native

	I0524 11:36:22.347771    1534 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100e286d0] 0x100e2b130 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0524 11:36:22.347789    1534 main.go:141] libmachine: About to run SSH command:

	sudo hostname addons-514000 && echo "addons-514000" | sudo tee /etc/hostname

	I0524 11:36:22.440700    1534 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-514000

	I0524 11:36:22.440862    1534 main.go:141] libmachine: Using SSH client type: native

	I0524 11:36:22.441350    1534 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100e286d0] 0x100e2b130 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0524 11:36:22.441366    1534 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\saddons-514000' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-514000/g' /etc/hosts;

				else 

					echo '127.0.1.1 addons-514000' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0524 11:36:22.513129    1534 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0524 11:36:22.513148    1534 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/16573-1024/.minikube CaCertPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/16573-1024/.minikube}

	I0524 11:36:22.513166    1534 buildroot.go:174] setting up certificates

	I0524 11:36:22.513196    1534 provision.go:83] configureAuth start

	I0524 11:36:22.513202    1534 provision.go:138] copyHostCerts

	I0524 11:36:22.513384    1534 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.pem (1078 bytes)

	I0524 11:36:22.513907    1534 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/16573-1024/.minikube/cert.pem (1123 bytes)

	I0524 11:36:22.514185    1534 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/16573-1024/.minikube/key.pem (1675 bytes)

	I0524 11:36:22.514351    1534 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca-key.pem org=jenkins.addons-514000 san=[192.168.105.2 192.168.105.2 localhost 127.0.0.1 minikube addons-514000]

	I0524 11:36:22.615592    1534 provision.go:172] copyRemoteCerts

	I0524 11:36:22.615660    1534 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0524 11:36:22.615678    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:22.647614    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0524 11:36:22.654906    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/server.pem --> /etc/docker/server.pem (1216 bytes)

	I0524 11:36:22.661956    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0524 11:36:22.668901    1534 provision.go:86] duration metric: configureAuth took 155.700959ms

	I0524 11:36:22.668909    1534 buildroot.go:189] setting minikube options for container-runtime

	I0524 11:36:22.669263    1534 config.go:182] Loaded profile config "addons-514000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.27.2

	I0524 11:36:22.669315    1534 main.go:141] libmachine: Using SSH client type: native

	I0524 11:36:22.669538    1534 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100e286d0] 0x100e2b130 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0524 11:36:22.669543    1534 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0524 11:36:22.728343    1534 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I0524 11:36:22.728351    1534 buildroot.go:70] root file system type: tmpfs

	I0524 11:36:22.728414    1534 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I0524 11:36:22.728455    1534 main.go:141] libmachine: Using SSH client type: native

	I0524 11:36:22.728711    1534 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100e286d0] 0x100e2b130 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0524 11:36:22.728749    1534 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0524 11:36:22.797892    1534 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0524 11:36:22.797940    1534 main.go:141] libmachine: Using SSH client type: native

	I0524 11:36:22.798220    1534 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100e286d0] 0x100e2b130 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0524 11:36:22.798231    1534 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0524 11:36:23.149053    1534 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory

	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.

	I0524 11:36:23.149067    1534 machine.go:91] provisioned docker machine in 803.097167ms

	I0524 11:36:23.149073    1534 client.go:171] LocalClient.Create took 15.685539208s

	I0524 11:36:23.149079    1534 start.go:167] duration metric: libmachine.API.Create for "addons-514000" took 15.685619292s

	I0524 11:36:23.149084    1534 start.go:300] post-start starting for "addons-514000" (driver="qemu2")

	I0524 11:36:23.149087    1534 start.go:328] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0524 11:36:23.149151    1534 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0524 11:36:23.149161    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:23.182740    1534 ssh_runner.go:195] Run: cat /etc/os-release

	I0524 11:36:23.184182    1534 info.go:137] Remote host: Buildroot 2021.02.12

	I0524 11:36:23.184191    1534 filesync.go:126] Scanning /Users/jenkins/minikube-integration/16573-1024/.minikube/addons for local assets ...

	I0524 11:36:23.184263    1534 filesync.go:126] Scanning /Users/jenkins/minikube-integration/16573-1024/.minikube/files for local assets ...

	I0524 11:36:23.184291    1534 start.go:303] post-start completed in 35.204125ms

	I0524 11:36:23.184667    1534 profile.go:148] Saving config to /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/config.json ...

	I0524 11:36:23.184838    1534 start.go:128] duration metric: createHost completed in 16.099587584s

	I0524 11:36:23.184860    1534 main.go:141] libmachine: Using SSH client type: native

	I0524 11:36:23.185079    1534 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100e286d0] 0x100e2b130 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0524 11:36:23.185084    1534 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0524 11:36:23.240206    1534 main.go:141] libmachine: SSH cmd err, output: <nil>: 1684953383.421013085

	I0524 11:36:23.240212    1534 fix.go:207] guest clock: 1684953383.421013085

	I0524 11:36:23.240216    1534 fix.go:220] Guest: 2023-05-24 11:36:23.421013085 -0700 PDT Remote: 2023-05-24 11:36:23.184841 -0700 PDT m=+16.200821626 (delta=236.172085ms)

	I0524 11:36:23.240228    1534 fix.go:191] guest clock delta is within tolerance: 236.172085ms

	I0524 11:36:23.240231    1534 start.go:83] releasing machines lock for "addons-514000", held for 16.155020041s

	I0524 11:36:23.240534    1534 ssh_runner.go:195] Run: cat /version.json

	I0524 11:36:23.240542    1534 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0524 11:36:23.240552    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:23.240589    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:23.271294    1534 ssh_runner.go:195] Run: systemctl --version

	I0524 11:36:23.356274    1534 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0524 11:36:23.358206    1534 cni.go:208] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0524 11:36:23.358253    1534 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0524 11:36:23.363251    1534 cni.go:261] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0524 11:36:23.363272    1534 preload.go:132] Checking if preload exists for k8s version v1.27.2 and runtime docker

	I0524 11:36:23.363358    1534 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0524 11:36:23.374219    1534 docker.go:633] Got preloaded images: 

	I0524 11:36:23.374227    1534 docker.go:639] registry.k8s.io/kube-apiserver:v1.27.2 wasn't preloaded

	I0524 11:36:23.374272    1534 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I0524 11:36:23.377135    1534 ssh_runner.go:195] Run: which lz4

	I0524 11:36:23.378475    1534 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4

	I0524 11:36:23.379822    1534 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I0524 11:36:23.379833    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.2-docker-overlay2-arm64.tar.lz4 --> /preloaded.tar.lz4 (343635669 bytes)

	I0524 11:36:24.715030    1534 docker.go:597] Took 1.336609 seconds to copy over tarball

	I0524 11:36:24.715105    1534 ssh_runner.go:195] Run: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4

	I0524 11:36:25.802869    1534 ssh_runner.go:235] Completed: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4: (1.087750334s)

	I0524 11:36:25.802885    1534 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I0524 11:36:25.818539    1534 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I0524 11:36:25.821398    1534 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2629 bytes)

	I0524 11:36:25.826757    1534 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0524 11:36:25.912573    1534 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0524 11:36:27.259007    1534 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.346426625s)

	I0524 11:36:27.259050    1534 start.go:481] detecting cgroup driver to use...

	I0524 11:36:27.259161    1534 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0524 11:36:27.264502    1534 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"

	I0524 11:36:27.267902    1534 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I0524 11:36:27.271357    1534 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...

	I0524 11:36:27.271387    1534 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I0524 11:36:27.274823    1534 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0524 11:36:27.278019    1534 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I0524 11:36:27.280856    1534 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0524 11:36:27.283904    1534 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0524 11:36:27.287473    1534 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I0524 11:36:27.291108    1534 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0524 11:36:27.294288    1534 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0524 11:36:27.297250    1534 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0524 11:36:27.376117    1534 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I0524 11:36:27.384917    1534 start.go:481] detecting cgroup driver to use...

	I0524 11:36:27.384994    1534 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0524 11:36:27.390435    1534 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0524 11:36:27.395426    1534 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0524 11:36:27.402483    1534 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0524 11:36:27.406870    1534 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0524 11:36:27.411215    1534 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I0524 11:36:27.451530    1534 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0524 11:36:27.456795    1534 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0524 11:36:27.461922    1534 ssh_runner.go:195] Run: which cri-dockerd

	I0524 11:36:27.463049    1534 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I0524 11:36:27.465876    1534 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)

	I0524 11:36:27.470660    1534 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I0524 11:36:27.538638    1534 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I0524 11:36:27.616092    1534 docker.go:532] configuring docker to use "cgroupfs" as cgroup driver...

	I0524 11:36:27.616109    1534 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (144 bytes)

	I0524 11:36:27.621459    1534 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0524 11:36:27.708405    1534 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0524 11:36:28.851963    1534 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.143548708s)

	I0524 11:36:28.852015    1534 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I0524 11:36:28.939002    1534 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I0524 11:36:29.020013    1534 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I0524 11:36:29.108812    1534 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0524 11:36:29.187424    1534 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I0524 11:36:29.194801    1534 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0524 11:36:29.274472    1534 ssh_runner.go:195] Run: sudo systemctl restart cri-docker

	I0524 11:36:29.298400    1534 start.go:528] Will wait 60s for socket path /var/run/cri-dockerd.sock

	I0524 11:36:29.298499    1534 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0524 11:36:29.300633    1534 start.go:549] Will wait 60s for crictl version

	I0524 11:36:29.300681    1534 ssh_runner.go:195] Run: which crictl

	I0524 11:36:29.302069    1534 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0524 11:36:29.320125    1534 start.go:565] Version:  0.1.0

	RuntimeName:  docker

	RuntimeVersion:  20.10.23

	RuntimeApiVersion:  v1alpha2

	I0524 11:36:29.320196    1534 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0524 11:36:29.329425    1534 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0524 11:36:29.346012    1534 out.go:204] * Preparing Kubernetes v1.27.2 on Docker 20.10.23 ...

	I0524 11:36:29.346159    1534 ssh_runner.go:195] Run: grep 192.168.105.1	host.minikube.internal$ /etc/hosts

	I0524 11:36:29.347609    1534 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.105.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0524 11:36:29.351578    1534 preload.go:132] Checking if preload exists for k8s version v1.27.2 and runtime docker

	I0524 11:36:29.351619    1534 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0524 11:36:29.359168    1534 docker.go:633] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.27.2

	registry.k8s.io/kube-controller-manager:v1.27.2

	registry.k8s.io/kube-scheduler:v1.27.2

	registry.k8s.io/kube-proxy:v1.27.2

	registry.k8s.io/coredns/coredns:v1.10.1

	registry.k8s.io/etcd:3.5.7-0

	registry.k8s.io/pause:3.9

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I0524 11:36:29.359177    1534 docker.go:563] Images already preloaded, skipping extraction

	I0524 11:36:29.359234    1534 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0524 11:36:29.366578    1534 docker.go:633] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.27.2

	registry.k8s.io/kube-scheduler:v1.27.2

	registry.k8s.io/kube-controller-manager:v1.27.2

	registry.k8s.io/kube-proxy:v1.27.2

	registry.k8s.io/coredns/coredns:v1.10.1

	registry.k8s.io/etcd:3.5.7-0

	registry.k8s.io/pause:3.9

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I0524 11:36:29.366587    1534 cache_images.go:84] Images are preloaded, skipping loading

	I0524 11:36:29.366634    1534 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I0524 11:36:29.376722    1534 cni.go:84] Creating CNI manager for ""

	I0524 11:36:29.376734    1534 cni.go:157] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0524 11:36:29.376743    1534 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I0524 11:36:29.376755    1534 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.105.2 APIServerPort:8443 KubernetesVersion:v1.27.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-514000 NodeName:addons-514000 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.105.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.105.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/ku

bernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I0524 11:36:29.376831    1534 kubeadm.go:181] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.105.2

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/cri-dockerd.sock

	  name: "addons-514000"

	  kubeletExtraArgs:

	    node-ip: 192.168.105.2

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.105.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.27.2

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0524 11:36:29.376873    1534 kubeadm.go:971] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.27.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/cri-dockerd.sock --hostname-override=addons-514000 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.105.2

	[Install]

	 config:

	{KubernetesVersion:v1.27.2 ClusterName:addons-514000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I0524 11:36:29.376934    1534 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.27.2

	I0524 11:36:29.379950    1534 binaries.go:44] Found k8s binaries, skipping transfer

	I0524 11:36:29.379980    1534 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0524 11:36:29.383262    1534 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (375 bytes)

	I0524 11:36:29.388298    1534 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0524 11:36:29.393370    1534 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2099 bytes)

	I0524 11:36:29.398040    1534 ssh_runner.go:195] Run: grep 192.168.105.2	control-plane.minikube.internal$ /etc/hosts

	I0524 11:36:29.399441    1534 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.105.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0524 11:36:29.403560    1534 certs.go:56] Setting up /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000 for IP: 192.168.105.2

	I0524 11:36:29.403576    1534 certs.go:190] acquiring lock for shared ca certs: {Name:mk53f82f750243d1079819acfe50ecbc2a56595a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.403733    1534 certs.go:204] generating minikubeCA CA: /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.key

	I0524 11:36:29.494908    1534 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.crt ...

	I0524 11:36:29.494916    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.crt: {Name:mkde13471093958a457d9307a0c213d7ba461177 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.495144    1534 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.key ...

	I0524 11:36:29.495147    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.key: {Name:mk5b2a6f100829fa25412e4c96a6b4d9b186c9d1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.495264    1534 certs.go:204] generating proxyClientCA CA: /Users/jenkins/minikube-integration/16573-1024/.minikube/proxy-client-ca.key

	I0524 11:36:29.601357    1534 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/16573-1024/.minikube/proxy-client-ca.crt ...

	I0524 11:36:29.601364    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/proxy-client-ca.crt: {Name:mkc3f94501092c9c51cfa6d329a0a2c4cec184ab Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.601593    1534 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/16573-1024/.minikube/proxy-client-ca.key ...

	I0524 11:36:29.601596    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/proxy-client-ca.key: {Name:mk7acf18000a82a656fee32bbd454a3c129dabde Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.601733    1534 certs.go:319] generating minikube-user signed cert: /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/client.key

	I0524 11:36:29.601741    1534 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/client.crt with IP's: []

	I0524 11:36:29.653842    1534 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/client.crt ...

	I0524 11:36:29.653845    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/client.crt: {Name:mk3856cd37d1f07be2cc9902b19f9498b880112f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.654036    1534 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/client.key ...

	I0524 11:36:29.654040    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/client.key: {Name:mkbc8808085e1496dcb2b3e03156e443b7b7994b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.654176    1534 certs.go:319] generating minikube signed cert: /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.key.96055969

	I0524 11:36:29.654188    1534 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.crt.96055969 with IP's: [192.168.105.2 10.96.0.1 127.0.0.1 10.0.0.1]

	I0524 11:36:29.724674    1534 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.crt.96055969 ...

	I0524 11:36:29.724678    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.crt.96055969: {Name:mk424188d0f28cb0aa520452bb8ec4583a153ec6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.724815    1534 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.key.96055969 ...

	I0524 11:36:29.724818    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.key.96055969: {Name:mk98c3231c62717b32e2418cabd759d6ad5645ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.724926    1534 certs.go:337] copying /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.crt.96055969 -> /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.crt

	I0524 11:36:29.725147    1534 certs.go:341] copying /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.key.96055969 -> /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.key

	I0524 11:36:29.725241    1534 certs.go:319] generating aggregator signed cert: /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/proxy-client.key

	I0524 11:36:29.725256    1534 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/proxy-client.crt with IP's: []

	I0524 11:36:29.842949    1534 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/proxy-client.crt ...

	I0524 11:36:29.842953    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/proxy-client.crt: {Name:mk581c30062675e68aafc25cb79bfc8a62fd3e41 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.843105    1534 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/proxy-client.key ...

	I0524 11:36:29.843110    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/proxy-client.key: {Name:mk019f6bac347a368012a36cea939860ce210025 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.843389    1534 certs.go:437] found cert: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca-key.pem (1675 bytes)

	I0524 11:36:29.843593    1534 certs.go:437] found cert: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca.pem (1078 bytes)

	I0524 11:36:29.843619    1534 certs.go:437] found cert: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/cert.pem (1123 bytes)

	I0524 11:36:29.843756    1534 certs.go:437] found cert: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/key.pem (1675 bytes)

	I0524 11:36:29.844302    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I0524 11:36:29.851879    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0524 11:36:29.859249    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0524 11:36:29.866847    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I0524 11:36:29.873646    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0524 11:36:29.880415    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0524 11:36:29.887466    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0524 11:36:29.894575    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0524 11:36:29.901581    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0524 11:36:29.908027    1534 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0524 11:36:29.914140    1534 ssh_runner.go:195] Run: openssl version

	I0524 11:36:29.916182    1534 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0524 11:36:29.919659    1534 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0524 11:36:29.921372    1534 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 May 24 18:36 /usr/share/ca-certificates/minikubeCA.pem

	I0524 11:36:29.921394    1534 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0524 11:36:29.923349    1534 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0524 11:36:29.926902    1534 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd

	I0524 11:36:29.928503    1534 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory

	I0524 11:36:29.928540    1534 kubeadm.go:404] StartCluster: {Name:addons-514000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/16501/minikube-v1.30.1-1684536668-16501-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684536746-16501@sha256:f5d93abf1d1cfb142a7cf0b58b24029595d621e5f943105b16c61199094d77de Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v

1.27.2 ClusterName:addons-514000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.105.2 Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 Mount

Options:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}

	I0524 11:36:29.928599    1534 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0524 11:36:29.935998    1534 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0524 11:36:29.939589    1534 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0524 11:36:29.942818    1534 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0524 11:36:29.945835    1534 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0524 11:36:29.945853    1534 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.27.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"

	I0524 11:36:29.967889    1534 kubeadm.go:322] [init] Using Kubernetes version: v1.27.2

	I0524 11:36:29.967941    1534 kubeadm.go:322] [preflight] Running pre-flight checks

	I0524 11:36:30.020294    1534 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster

	I0524 11:36:30.020350    1534 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I0524 11:36:30.020400    1534 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	I0524 11:36:30.076237    1534 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I0524 11:36:30.084415    1534 out.go:204]   - Generating certificates and keys ...

	I0524 11:36:30.084460    1534 kubeadm.go:322] [certs] Using existing ca certificate authority

	I0524 11:36:30.084494    1534 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk

	I0524 11:36:30.272940    1534 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key

	I0524 11:36:30.453046    1534 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key

	I0524 11:36:30.580586    1534 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key

	I0524 11:36:30.639773    1534 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key

	I0524 11:36:30.738497    1534 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key

	I0524 11:36:30.738567    1534 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [addons-514000 localhost] and IPs [192.168.105.2 127.0.0.1 ::1]

	I0524 11:36:30.858811    1534 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key

	I0524 11:36:30.858875    1534 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [addons-514000 localhost] and IPs [192.168.105.2 127.0.0.1 ::1]

	I0524 11:36:30.935967    1534 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key

	I0524 11:36:30.967281    1534 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key

	I0524 11:36:31.073416    1534 kubeadm.go:322] [certs] Generating "sa" key and public key

	I0524 11:36:31.073445    1534 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I0524 11:36:31.335469    1534 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file

	I0524 11:36:31.530915    1534 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I0524 11:36:31.573436    1534 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I0524 11:36:31.637219    1534 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I0524 11:36:31.645102    1534 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I0524 11:36:31.645531    1534 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I0524 11:36:31.645571    1534 kubeadm.go:322] [kubelet-start] Starting the kubelet

	I0524 11:36:31.737201    1534 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I0524 11:36:31.741345    1534 out.go:204]   - Booting up control plane ...

	I0524 11:36:31.741390    1534 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I0524 11:36:31.741439    1534 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I0524 11:36:31.741469    1534 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I0524 11:36:31.741512    1534 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I0524 11:36:31.741595    1534 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	I0524 11:36:35.739695    1534 kubeadm.go:322] [apiclient] All control plane components are healthy after 4.002246 seconds

	I0524 11:36:35.739796    1534 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I0524 11:36:35.750536    1534 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I0524 11:36:36.270805    1534 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs

	I0524 11:36:36.271028    1534 kubeadm.go:322] [mark-control-plane] Marking the node addons-514000 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I0524 11:36:36.776691    1534 kubeadm.go:322] [bootstrap-token] Using token: zlw52u.ca0agirmjwjpmd4f

	I0524 11:36:36.783931    1534 out.go:204]   - Configuring RBAC rules ...

	I0524 11:36:36.784005    1534 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I0524 11:36:36.785227    1534 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I0524 11:36:36.791945    1534 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I0524 11:36:36.793322    1534 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I0524 11:36:36.794557    1534 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I0524 11:36:36.795891    1534 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I0524 11:36:36.802617    1534 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I0524 11:36:36.956552    1534 kubeadm.go:322] [addons] Applied essential addon: CoreDNS

	I0524 11:36:37.187637    1534 kubeadm.go:322] [addons] Applied essential addon: kube-proxy

	I0524 11:36:37.187937    1534 kubeadm.go:322] 

	I0524 11:36:37.187967    1534 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!

	I0524 11:36:37.187973    1534 kubeadm.go:322] 

	I0524 11:36:37.188044    1534 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:

	I0524 11:36:37.188053    1534 kubeadm.go:322] 

	I0524 11:36:37.188069    1534 kubeadm.go:322]   mkdir -p $HOME/.kube

	I0524 11:36:37.188099    1534 kubeadm.go:322]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I0524 11:36:37.188128    1534 kubeadm.go:322]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I0524 11:36:37.188133    1534 kubeadm.go:322] 

	I0524 11:36:37.188155    1534 kubeadm.go:322] Alternatively, if you are the root user, you can run:

	I0524 11:36:37.188158    1534 kubeadm.go:322] 

	I0524 11:36:37.188189    1534 kubeadm.go:322]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I0524 11:36:37.188193    1534 kubeadm.go:322] 

	I0524 11:36:37.188219    1534 kubeadm.go:322] You should now deploy a pod network to the cluster.

	I0524 11:36:37.188277    1534 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I0524 11:36:37.188314    1534 kubeadm.go:322]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I0524 11:36:37.188322    1534 kubeadm.go:322] 

	I0524 11:36:37.188361    1534 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities

	I0524 11:36:37.188399    1534 kubeadm.go:322] and service account keys on each node and then running the following as root:

	I0524 11:36:37.188411    1534 kubeadm.go:322] 

	I0524 11:36:37.188464    1534 kubeadm.go:322]   kubeadm join control-plane.minikube.internal:8443 --token zlw52u.ca0agirmjwjpmd4f \

	I0524 11:36:37.188516    1534 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:31e7298e5fe39dd9013d3c0dfbef354d505381f39a7a09e3b4af334242438797 \

	I0524 11:36:37.188534    1534 kubeadm.go:322] 	--control-plane 

	I0524 11:36:37.188538    1534 kubeadm.go:322] 

	I0524 11:36:37.188580    1534 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:

	I0524 11:36:37.188584    1534 kubeadm.go:322] 

	I0524 11:36:37.188629    1534 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token zlw52u.ca0agirmjwjpmd4f \

	I0524 11:36:37.188681    1534 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:31e7298e5fe39dd9013d3c0dfbef354d505381f39a7a09e3b4af334242438797 

	I0524 11:36:37.188736    1534 kubeadm.go:322] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I0524 11:36:37.188819    1534 kubeadm.go:322] W0524 18:36:30.200947    1295 images.go:80] could not find officially supported version of etcd for Kubernetes v1.27.2, falling back to the nearest etcd version (3.5.7-0)

	I0524 11:36:37.188904    1534 kubeadm.go:322] W0524 18:36:31.916526    1295 images.go:80] could not find officially supported version of etcd for Kubernetes v1.27.2, falling back to the nearest etcd version (3.5.7-0)

	I0524 11:36:37.188909    1534 cni.go:84] Creating CNI manager for ""

	I0524 11:36:37.188916    1534 cni.go:157] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0524 11:36:37.195686    1534 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...

	I0524 11:36:37.199715    1534 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d

	I0524 11:36:37.203087    1534 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)

	I0524 11:36:37.208259    1534 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0524 11:36:37.208303    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:37.208333    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl label nodes minikube.k8s.io/version=v1.30.1 minikube.k8s.io/commit=d23ad66c17ded3bf1d7d6fb0fa0ee29881f9547e minikube.k8s.io/name=addons-514000 minikube.k8s.io/updated_at=2023_05_24T11_36_37_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:37.258566    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:37.271047    1534 ops.go:34] apiserver oom_adj: -16

	I0524 11:36:37.796169    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:38.296162    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:38.796257    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:39.295049    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:39.796244    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:40.296250    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:40.796162    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:41.296458    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:41.796245    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:42.296250    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:42.796323    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:43.296423    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:43.796432    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:44.296246    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:44.796149    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:45.296189    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:45.796183    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:46.296206    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:46.796370    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:47.296192    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:47.796245    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:48.296219    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:48.796135    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:49.296201    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:49.796192    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:50.296070    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:50.332878    1534 kubeadm.go:1076] duration metric: took 13.124695208s to wait for elevateKubeSystemPrivileges.

	I0524 11:36:50.332892    1534 kubeadm.go:406] StartCluster complete in 20.404490625s

	I0524 11:36:50.332916    1534 settings.go:142] acquiring lock: {Name:mke0e8586c5ffdfb76a30452ad9385e81e1593cb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:50.333079    1534 settings.go:150] Updating kubeconfig:  /Users/jenkins/minikube-integration/16573-1024/kubeconfig

	I0524 11:36:50.333301    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/kubeconfig: {Name:mkd6a5851332ae81ab607caaee690ec1266dd411 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:50.333499    1534 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.27.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0524 11:36:50.333541    1534 addons.go:496] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:true]

	I0524 11:36:50.333603    1534 addons.go:66] Setting ingress=true in profile "addons-514000"

	I0524 11:36:50.333609    1534 addons.go:66] Setting registry=true in profile "addons-514000"

	I0524 11:36:50.333611    1534 addons.go:228] Setting addon ingress=true in "addons-514000"

	I0524 11:36:50.333614    1534 addons.go:228] Setting addon registry=true in "addons-514000"

	I0524 11:36:50.333650    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.333646    1534 addons.go:66] Setting csi-hostpath-driver=true in profile "addons-514000"

	I0524 11:36:50.333656    1534 addons.go:66] Setting storage-provisioner=true in profile "addons-514000"

	I0524 11:36:50.333660    1534 addons.go:228] Setting addon storage-provisioner=true in "addons-514000"

	I0524 11:36:50.333671    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.333804    1534 addons.go:66] Setting metrics-server=true in profile "addons-514000"

	I0524 11:36:50.333879    1534 addons.go:228] Setting addon metrics-server=true in "addons-514000"

	I0524 11:36:50.333906    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.333926    1534 addons.go:228] Setting addon csi-hostpath-driver=true in "addons-514000"

	I0524 11:36:50.333947    1534 config.go:182] Loaded profile config "addons-514000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.27.2

	I0524 11:36:50.333682    1534 addons.go:66] Setting ingress-dns=true in profile "addons-514000"

	I0524 11:36:50.333976    1534 addons.go:228] Setting addon ingress-dns=true in "addons-514000"

	I0524 11:36:50.333995    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.334035    1534 addons.go:66] Setting gcp-auth=true in profile "addons-514000"

	I0524 11:36:50.333605    1534 addons.go:66] Setting volumesnapshots=true in profile "addons-514000"

	I0524 11:36:50.334092    1534 addons.go:228] Setting addon volumesnapshots=true in "addons-514000"

	I0524 11:36:50.334116    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.334159    1534 addons.go:66] Setting default-storageclass=true in profile "addons-514000"

	I0524 11:36:50.334172    1534 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-514000"

	I0524 11:36:50.333653    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.334095    1534 mustload.go:65] Loading cluster: addons-514000

	I0524 11:36:50.334706    1534 addons.go:66] Setting inspektor-gadget=true in profile "addons-514000"

	I0524 11:36:50.334713    1534 addons.go:228] Setting addon inspektor-gadget=true in "addons-514000"

	I0524 11:36:50.333694    1534 addons.go:66] Setting cloud-spanner=true in profile "addons-514000"

	I0524 11:36:50.334861    1534 addons.go:228] Setting addon cloud-spanner=true in "addons-514000"

	I0524 11:36:50.334877    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.334897    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.334942    1534 host.go:66] Checking if "addons-514000" exists ...

	W0524 11:36:50.335292    1534 host.go:54] host status for "addons-514000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor: connect: connection refused

	W0524 11:36:50.335303    1534 addons.go:274] "addons-514000" is not running, setting metrics-server=true and skipping enablement (err=<nil>)

	I0524 11:36:50.335306    1534 addons.go:464] Verifying addon metrics-server=true in "addons-514000"

	W0524 11:36:50.335329    1534 host.go:54] host status for "addons-514000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor: connect: connection refused

	W0524 11:36:50.335333    1534 addons.go:274] "addons-514000" is not running, setting ingress-dns=true and skipping enablement (err=<nil>)

	W0524 11:36:50.335353    1534 host.go:54] host status for "addons-514000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor: connect: connection refused

	W0524 11:36:50.335359    1534 addons.go:274] "addons-514000" is not running, setting registry=true and skipping enablement (err=<nil>)

	I0524 11:36:50.335362    1534 addons.go:464] Verifying addon registry=true in "addons-514000"

	W0524 11:36:50.335391    1534 host.go:54] host status for "addons-514000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor: connect: connection refused

	I0524 11:36:50.339535    1534 out.go:177] * Verifying registry addon...

	W0524 11:36:50.335411    1534 addons.go:274] "addons-514000" is not running, setting ingress=true and skipping enablement (err=<nil>)

	W0524 11:36:50.335412    1534 host.go:54] host status for "addons-514000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor: connect: connection refused

	W0524 11:36:50.335520    1534 host.go:54] host status for "addons-514000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor: connect: connection refused

	W0524 11:36:50.335588    1534 host.go:54] host status for "addons-514000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor: connect: connection refused

	I0524 11:36:50.335599    1534 config.go:182] Loaded profile config "addons-514000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.27.2

	W0524 11:36:50.335650    1534 host.go:54] host status for "addons-514000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor: connect: connection refused

	W0524 11:36:50.349556    1534 addons.go:274] "addons-514000" is not running, setting csi-hostpath-driver=true and skipping enablement (err=<nil>)

	W0524 11:36:50.349673    1534 addons.go:274] "addons-514000" is not running, setting cloud-spanner=true and skipping enablement (err=<nil>)

	I0524 11:36:50.349673    1534 addons.go:464] Verifying addon ingress=true in "addons-514000"

	W0524 11:36:50.349688    1534 addons_storage_classes.go:55] "addons-514000" is not running, writing default-storageclass=true to disk and skipping enablement

	W0524 11:36:50.349678    1534 addons.go:274] "addons-514000" is not running, setting inspektor-gadget=true and skipping enablement (err=<nil>)

	I0524 11:36:50.350008    1534 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...

	I0524 11:36:50.350257    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.353441    1534 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0524 11:36:50.357663    1534 addons.go:228] Setting addon default-storageclass=true in "addons-514000"

	I0524 11:36:50.360618    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.360641    1534 addons.go:420] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0524 11:36:50.360646    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0524 11:36:50.360653    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:50.365539    1534 out.go:177] * Verifying ingress addon...

	I0524 11:36:50.357776    1534 out.go:177]   - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0

	I0524 11:36:50.357776    1534 addons.go:464] Verifying addon csi-hostpath-driver=true in "addons-514000"

	I0524 11:36:50.361446    1534 addons.go:420] installing /etc/kubernetes/addons/storageclass.yaml

	I0524 11:36:50.364279    1534 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=registry

	I0524 11:36:50.381598    1534 out.go:177] * Verifying csi-hostpath-driver addon...

	I0524 11:36:50.369698    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0524 11:36:50.369727    1534 addons.go:420] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml

	I0524 11:36:50.375900    1534 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...

	I0524 11:36:50.387638    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)

	I0524 11:36:50.387638    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:50.387646    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:50.388147    1534 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...

	I0524 11:36:50.390627    1534 kapi.go:86] Found 0 Pods for label selector app.kubernetes.io/name=ingress-nginx

	I0524 11:36:50.391169    1534 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver

	I0524 11:36:50.400375    1534 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.27.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.105.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.27.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0524 11:36:50.433263    1534 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0524 11:36:50.499595    1534 addons.go:420] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml

	I0524 11:36:50.499607    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)

	I0524 11:36:50.511369    1534 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0524 11:36:50.545082    1534 addons.go:420] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml

	I0524 11:36:50.545093    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)

	I0524 11:36:50.571075    1534 addons.go:420] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml

	I0524 11:36:50.571085    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)

	I0524 11:36:50.614490    1534 addons.go:420] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml

	I0524 11:36:50.614502    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)

	I0524 11:36:50.628252    1534 addons.go:420] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0524 11:36:50.628261    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)

	I0524 11:36:50.647925    1534 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0524 11:36:50.858973    1534 kapi.go:248] "coredns" deployment in "kube-system" namespace and "addons-514000" context rescaled to 1 replicas

	I0524 11:36:50.859000    1534 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.105.2 Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0524 11:36:50.862644    1534 out.go:177] * Verifying Kubernetes components...

	I0524 11:36:50.870714    1534 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0524 11:36:51.015230    1534 start.go:916] {"host.minikube.internal": 192.168.105.1} host record injected into CoreDNS's ConfigMap

	W0524 11:36:51.239743    1534 addons.go:446] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I0524 11:36:51.239769    1534 retry.go:31] will retry after 300.967986ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I0524 11:36:51.240163    1534 node_ready.go:35] waiting up to 6m0s for node "addons-514000" to be "Ready" ...

	I0524 11:36:51.242031    1534 node_ready.go:49] node "addons-514000" has status "Ready":"True"

	I0524 11:36:51.242040    1534 node_ready.go:38] duration metric: took 1.869375ms waiting for node "addons-514000" to be "Ready" ...

	I0524 11:36:51.242043    1534 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0524 11:36:51.247820    1534 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5d78c9869d-dmkfx" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:51.542933    1534 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.2/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0524 11:36:53.257970    1534 pod_ready.go:92] pod "coredns-5d78c9869d-dmkfx" in "kube-system" namespace has status "Ready":"True"

	I0524 11:36:53.257986    1534 pod_ready.go:81] duration metric: took 2.01016425s waiting for pod "coredns-5d78c9869d-dmkfx" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.257991    1534 pod_ready.go:78] waiting up to 6m0s for pod "etcd-addons-514000" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.260855    1534 pod_ready.go:92] pod "etcd-addons-514000" in "kube-system" namespace has status "Ready":"True"

	I0524 11:36:53.260862    1534 pod_ready.go:81] duration metric: took 2.866833ms waiting for pod "etcd-addons-514000" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.260867    1534 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-addons-514000" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.263593    1534 pod_ready.go:92] pod "kube-apiserver-addons-514000" in "kube-system" namespace has status "Ready":"True"

	I0524 11:36:53.263598    1534 pod_ready.go:81] duration metric: took 2.728ms waiting for pod "kube-apiserver-addons-514000" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.263603    1534 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-addons-514000" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.266314    1534 pod_ready.go:92] pod "kube-controller-manager-addons-514000" in "kube-system" namespace has status "Ready":"True"

	I0524 11:36:53.266322    1534 pod_ready.go:81] duration metric: took 2.716417ms waiting for pod "kube-controller-manager-addons-514000" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.266326    1534 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-2gj6m" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.268820    1534 pod_ready.go:92] pod "kube-proxy-2gj6m" in "kube-system" namespace has status "Ready":"True"

	I0524 11:36:53.268826    1534 pod_ready.go:81] duration metric: took 2.496209ms waiting for pod "kube-proxy-2gj6m" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.268830    1534 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-addons-514000" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.659694    1534 pod_ready.go:92] pod "kube-scheduler-addons-514000" in "kube-system" namespace has status "Ready":"True"

	I0524 11:36:53.659709    1534 pod_ready.go:81] duration metric: took 390.87725ms waiting for pod "kube-scheduler-addons-514000" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.659719    1534 pod_ready.go:38] duration metric: took 2.417685875s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0524 11:36:53.659737    1534 api_server.go:52] waiting for apiserver process to appear ...

	I0524 11:36:53.659818    1534 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0524 11:36:54.012047    1534 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.2/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (2.469105375s)

	I0524 11:36:54.012061    1534 api_server.go:72] duration metric: took 3.153054583s to wait for apiserver process to appear ...

	I0524 11:36:54.012066    1534 api_server.go:88] waiting for apiserver healthz status ...

	I0524 11:36:54.012074    1534 api_server.go:253] Checking apiserver healthz at https://192.168.105.2:8443/healthz ...

	I0524 11:36:54.015086    1534 api_server.go:279] https://192.168.105.2:8443/healthz returned 200:

	ok

	I0524 11:36:54.015747    1534 api_server.go:141] control plane version: v1.27.2

	I0524 11:36:54.015755    1534 api_server.go:131] duration metric: took 3.685917ms to wait for apiserver health ...

	I0524 11:36:54.015758    1534 system_pods.go:43] waiting for kube-system pods to appear ...

	I0524 11:36:54.018844    1534 system_pods.go:59] 9 kube-system pods found

	I0524 11:36:54.018857    1534 system_pods.go:61] "coredns-5d78c9869d-dmkfx" [03f7079a-733f-488e-a6b1-65e0ca65cffe] Running

	I0524 11:36:54.018861    1534 system_pods.go:61] "etcd-addons-514000" [f53490df-9f65-472d-8c24-fedfb5ff0b40] Running

	I0524 11:36:54.018863    1534 system_pods.go:61] "kube-apiserver-addons-514000" [39ad1080-0c49-4108-8f04-7aded262c978] Running

	I0524 11:36:54.018865    1534 system_pods.go:61] "kube-controller-manager-addons-514000" [8aed5f2f-4439-495f-9454-34920caed37f] Running

	I0524 11:36:54.018868    1534 system_pods.go:61] "kube-proxy-2gj6m" [8d0787ef-32df-4a09-ad1d-48a69a40bb43] Running

	I0524 11:36:54.018870    1534 system_pods.go:61] "kube-scheduler-addons-514000" [98ce7db6-4f70-4fb1-992f-7cf2bf68fb43] Running

	I0524 11:36:54.018873    1534 system_pods.go:61] "snapshot-controller-75bbb956b9-j5jhp" [953964d7-20b0-4fa4-b1ca-f05e6adb94e3] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0524 11:36:54.018876    1534 system_pods.go:61] "snapshot-controller-75bbb956b9-txrxl" [07fe4bd3-7311-4ec4-938d-a195ed8535a8] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0524 11:36:54.018879    1534 system_pods.go:61] "storage-provisioner" [49765353-a5e1-4781-ab06-a554a575daa5] Running

	I0524 11:36:54.018881    1534 system_pods.go:74] duration metric: took 3.121167ms to wait for pod list to return data ...

	I0524 11:36:54.018883    1534 default_sa.go:34] waiting for default service account to be created ...

	I0524 11:36:54.057892    1534 default_sa.go:45] found service account: "default"

	I0524 11:36:54.057899    1534 default_sa.go:55] duration metric: took 39.013541ms for default service account to be created ...

	I0524 11:36:54.057902    1534 system_pods.go:116] waiting for k8s-apps to be running ...

	I0524 11:36:54.259995    1534 system_pods.go:86] 9 kube-system pods found

	I0524 11:36:54.260005    1534 system_pods.go:89] "coredns-5d78c9869d-dmkfx" [03f7079a-733f-488e-a6b1-65e0ca65cffe] Running

	I0524 11:36:54.260008    1534 system_pods.go:89] "etcd-addons-514000" [f53490df-9f65-472d-8c24-fedfb5ff0b40] Running

	I0524 11:36:54.260011    1534 system_pods.go:89] "kube-apiserver-addons-514000" [39ad1080-0c49-4108-8f04-7aded262c978] Running

	I0524 11:36:54.260014    1534 system_pods.go:89] "kube-controller-manager-addons-514000" [8aed5f2f-4439-495f-9454-34920caed37f] Running

	I0524 11:36:54.260016    1534 system_pods.go:89] "kube-proxy-2gj6m" [8d0787ef-32df-4a09-ad1d-48a69a40bb43] Running

	I0524 11:36:54.260019    1534 system_pods.go:89] "kube-scheduler-addons-514000" [98ce7db6-4f70-4fb1-992f-7cf2bf68fb43] Running

	I0524 11:36:54.260023    1534 system_pods.go:89] "snapshot-controller-75bbb956b9-j5jhp" [953964d7-20b0-4fa4-b1ca-f05e6adb94e3] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0524 11:36:54.260027    1534 system_pods.go:89] "snapshot-controller-75bbb956b9-txrxl" [07fe4bd3-7311-4ec4-938d-a195ed8535a8] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0524 11:36:54.260030    1534 system_pods.go:89] "storage-provisioner" [49765353-a5e1-4781-ab06-a554a575daa5] Running

	I0524 11:36:54.260033    1534 system_pods.go:126] duration metric: took 202.129584ms to wait for k8s-apps to be running ...

	I0524 11:36:54.260037    1534 system_svc.go:44] waiting for kubelet service to be running ....

	I0524 11:36:54.260088    1534 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0524 11:36:54.265390    1534 system_svc.go:56] duration metric: took 5.350666ms WaitForService to wait for kubelet.

	I0524 11:36:54.265399    1534 kubeadm.go:581] duration metric: took 3.406395625s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...

	I0524 11:36:54.265408    1534 node_conditions.go:102] verifying NodePressure condition ...

	I0524 11:36:54.458086    1534 node_conditions.go:122] node storage ephemeral capacity is 17784760Ki

	I0524 11:36:54.458097    1534 node_conditions.go:123] node cpu capacity is 2

	I0524 11:36:54.458103    1534 node_conditions.go:105] duration metric: took 192.694167ms to run NodePressure ...

	I0524 11:36:54.458107    1534 start.go:228] waiting for startup goroutines ...

	I0524 11:36:56.972492    1534 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)

	I0524 11:36:56.972559    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:57.029376    1534 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)

	I0524 11:36:57.038824    1534 addons.go:228] Setting addon gcp-auth=true in "addons-514000"

	I0524 11:36:57.038864    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:57.040182    1534 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json

	I0524 11:36:57.040196    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:57.078053    1534 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20230312-helm-chart-4.5.2-28-g66a760794

	I0524 11:36:57.082115    1534 out.go:177]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.0

	I0524 11:36:57.085015    1534 addons.go:420] installing /etc/kubernetes/addons/gcp-auth-ns.yaml

	I0524 11:36:57.085022    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)

	I0524 11:36:57.091862    1534 addons.go:420] installing /etc/kubernetes/addons/gcp-auth-service.yaml

	I0524 11:36:57.091873    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)

	I0524 11:36:57.099462    1534 addons.go:420] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I0524 11:36:57.099472    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5474 bytes)

	I0524 11:36:57.106631    1534 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.2/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I0524 11:36:57.550488    1534 addons.go:464] Verifying addon gcp-auth=true in "addons-514000"

	I0524 11:36:57.555392    1534 out.go:177] * Verifying gcp-auth addon...

	I0524 11:36:57.561721    1534 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...

	I0524 11:36:57.566760    1534 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth

	I0524 11:36:57.566769    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:36:58.070711    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:36:58.570942    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:36:59.076515    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:36:59.570540    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:00.070962    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:00.571104    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:01.071573    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:01.571018    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:02.072518    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:02.570869    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:03.071445    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:03.570661    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:04.070807    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:04.570832    1534 kapi.go:107] duration metric: took 7.009157292s to wait for kubernetes.io/minikube-addons=gcp-auth ...

	I0524 11:37:04.574809    1534 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-514000 cluster.

	I0524 11:37:04.579620    1534 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.

	I0524 11:37:04.583658    1534 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.

	I0524 11:42:50.357445    1534 kapi.go:107] duration metric: took 6m0.009773291s to wait for kubernetes.io/minikube-addons=registry ...

	W0524 11:42:50.357907    1534 out.go:239] ! Enabling 'registry' returned an error: running callbacks: [waiting for kubernetes.io/minikube-addons=registry pods: context deadline exceeded]

	I0524 11:42:50.387243    1534 kapi.go:107] duration metric: took 6m0.001495875s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...

	I0524 11:42:50.387315    1534 kapi.go:107] duration metric: took 6m0.013814333s to wait for app.kubernetes.io/name=ingress-nginx ...

	W0524 11:42:50.387474    1534 out.go:239] ! Enabling 'csi-hostpath-driver' returned an error: running callbacks: [waiting for kubernetes.io/minikube-addons=csi-hostpath-driver pods: context deadline exceeded]

	W0524 11:42:50.387474    1534 out.go:239] ! Enabling 'ingress' returned an error: running callbacks: [waiting for app.kubernetes.io/name=ingress-nginx pods: context deadline exceeded]

	I0524 11:42:50.395532    1534 out.go:177] * Enabled addons: metrics-server, ingress-dns, inspektor-gadget, cloud-spanner, storage-provisioner, default-storageclass, volumesnapshots, gcp-auth

	I0524 11:42:50.403494    1534 addons.go:499] enable addons completed in 6m0.072361709s: enabled=[metrics-server ingress-dns inspektor-gadget cloud-spanner storage-provisioner default-storageclass volumesnapshots gcp-auth]

	I0524 11:42:50.403556    1534 start.go:233] waiting for cluster config update ...

	I0524 11:42:50.403587    1534 start.go:242] writing updated cluster config ...

	I0524 11:42:50.408325    1534 ssh_runner.go:195] Run: rm -f paused

	I0524 11:42:50.568016    1534 start.go:568] kubectl: 1.25.9, cluster: 1.27.2 (minor skew: 2)

	I0524 11:42:50.572568    1534 out.go:177] 

	W0524 11:42:50.576443    1534 out.go:239] ! /usr/local/bin/kubectl is version 1.25.9, which may have incompatibilities with Kubernetes 1.27.2.

	I0524 11:42:50.580476    1534 out.go:177]   - Want kubectl v1.27.2? Try 'minikube kubectl -- get pods -A'

	I0524 11:42:50.587567    1534 out.go:177] * Done! kubectl is now configured to use "addons-514000" cluster and "default" namespace by default

	* 

	* ==> Docker <==

	* -- Journal begins at Wed 2023-05-24 18:36:19 UTC, ends at Wed 2023-05-24 19:04:43 UTC. --

	May 24 18:37:01 addons-514000 dockerd[922]: time="2023-05-24T18:37:01.516120296Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	May 24 18:37:01 addons-514000 dockerd[922]: time="2023-05-24T18:37:01.516129229Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	May 24 18:37:01 addons-514000 dockerd[916]: time="2023-05-24T18:37:01.568789730Z" level=info msg="ignoring event" container=1c671f6b3a5b5c85e0407b694ee5e6e8a1a70743c986a11000612952822acf1e module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 24 18:37:01 addons-514000 dockerd[922]: time="2023-05-24T18:37:01.569050551Z" level=info msg="shim disconnected" id=1c671f6b3a5b5c85e0407b694ee5e6e8a1a70743c986a11000612952822acf1e namespace=moby

	May 24 18:37:01 addons-514000 dockerd[922]: time="2023-05-24T18:37:01.569107330Z" level=warning msg="cleaning up after shim disconnected" id=1c671f6b3a5b5c85e0407b694ee5e6e8a1a70743c986a11000612952822acf1e namespace=moby

	May 24 18:37:01 addons-514000 dockerd[922]: time="2023-05-24T18:37:01.569117420Z" level=info msg="cleaning up dead shim" namespace=moby

	May 24 18:37:01 addons-514000 dockerd[922]: time="2023-05-24T18:37:01.607638824Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	May 24 18:37:01 addons-514000 dockerd[922]: time="2023-05-24T18:37:01.607702137Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	May 24 18:37:01 addons-514000 dockerd[922]: time="2023-05-24T18:37:01.607716942Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	May 24 18:37:01 addons-514000 dockerd[922]: time="2023-05-24T18:37:01.607727942Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	May 24 18:37:01 addons-514000 cri-dockerd[1138]: time="2023-05-24T18:37:01Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/f47df037d99569ad6cd8f4ef2c3926ab0aed2bb5b85f513c520fc0abc42c67f3/resolv.conf as [nameserver 10.96.0.10 search gcp-auth.svc.cluster.local svc.cluster.local cluster.local options ndots:5]"

	May 24 18:37:01 addons-514000 dockerd[916]: time="2023-05-24T18:37:01.953788187Z" level=warning msg="reference for unknown type: " digest="sha256:d730651bb6584f969d95d8279a754cf9d8d31b5055c43dbdb8d7363a8c6371cf" remote="gcr.io/k8s-minikube/gcp-auth-webhook@sha256:d730651bb6584f969d95d8279a754cf9d8d31b5055c43dbdb8d7363a8c6371cf"

	May 24 18:37:02 addons-514000 dockerd[922]: time="2023-05-24T18:37:02.557702813Z" level=info msg="shim disconnected" id=953c17ffdc8ac0b98e66b9d8887f99c9b0a49236e6fd43f2647edb75c5e82150 namespace=moby

	May 24 18:37:02 addons-514000 dockerd[922]: time="2023-05-24T18:37:02.557754555Z" level=warning msg="cleaning up after shim disconnected" id=953c17ffdc8ac0b98e66b9d8887f99c9b0a49236e6fd43f2647edb75c5e82150 namespace=moby

	May 24 18:37:02 addons-514000 dockerd[922]: time="2023-05-24T18:37:02.557759977Z" level=info msg="cleaning up dead shim" namespace=moby

	May 24 18:37:02 addons-514000 dockerd[916]: time="2023-05-24T18:37:02.558086156Z" level=info msg="ignoring event" container=953c17ffdc8ac0b98e66b9d8887f99c9b0a49236e6fd43f2647edb75c5e82150 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 24 18:37:03 addons-514000 dockerd[916]: time="2023-05-24T18:37:03.602683250Z" level=info msg="ignoring event" container=7c145b5b88ef04d8237d20d8374f3a2c4283c8c7c120b4d01e6d9eda3df3496d module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 24 18:37:03 addons-514000 dockerd[922]: time="2023-05-24T18:37:03.603089611Z" level=info msg="shim disconnected" id=7c145b5b88ef04d8237d20d8374f3a2c4283c8c7c120b4d01e6d9eda3df3496d namespace=moby

	May 24 18:37:03 addons-514000 dockerd[922]: time="2023-05-24T18:37:03.603147527Z" level=warning msg="cleaning up after shim disconnected" id=7c145b5b88ef04d8237d20d8374f3a2c4283c8c7c120b4d01e6d9eda3df3496d namespace=moby

	May 24 18:37:03 addons-514000 dockerd[922]: time="2023-05-24T18:37:03.603154445Z" level=info msg="cleaning up dead shim" namespace=moby

	May 24 18:37:03 addons-514000 cri-dockerd[1138]: time="2023-05-24T18:37:03Z" level=info msg="Stop pulling image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.0@sha256:d730651bb6584f969d95d8279a754cf9d8d31b5055c43dbdb8d7363a8c6371cf: Status: Downloaded newer image for gcr.io/k8s-minikube/gcp-auth-webhook@sha256:d730651bb6584f969d95d8279a754cf9d8d31b5055c43dbdb8d7363a8c6371cf"

	May 24 18:37:03 addons-514000 dockerd[922]: time="2023-05-24T18:37:03.856707697Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	May 24 18:37:03 addons-514000 dockerd[922]: time="2023-05-24T18:37:03.856808407Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	May 24 18:37:03 addons-514000 dockerd[922]: time="2023-05-24T18:37:03.856985177Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	May 24 18:37:03 addons-514000 dockerd[922]: time="2023-05-24T18:37:03.856997233Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	* 

	* ==> container status <==

	* CONTAINER           IMAGE                                                                                                                     CREATED             STATE               NAME                         ATTEMPT             POD ID

	d1ad6d2cd7d4d       gcr.io/k8s-minikube/gcp-auth-webhook@sha256:d730651bb6584f969d95d8279a754cf9d8d31b5055c43dbdb8d7363a8c6371cf              27 minutes ago      Running             gcp-auth                     0                   f47df037d9956

	2623eeac77855       registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280   27 minutes ago      Running             volume-snapshot-controller   0                   60ea5019d1f26

	61fdb94dca547       registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280   27 minutes ago      Running             volume-snapshot-controller   0                   1f82f1afb5ca6

	5e708965dbb0a       97e04611ad434                                                                                                             27 minutes ago      Running             coredns                      0                   eaf04536825bb

	c6d1bdca910b8       ba04bb24b9575                                                                                                             27 minutes ago      Running             storage-provisioner          0                   55be207be2898

	bf84d832ec967       29921a0845422                                                                                                             27 minutes ago      Running             kube-proxy                   0                   59d50204b0754

	046435c695b1e       305d7ed1dae28                                                                                                             28 minutes ago      Running             kube-scheduler               0                   cd9a002bb369c

	aa80b21f85087       2ee705380c3c5                                                                                                             28 minutes ago      Running             kube-controller-manager      0                   0ebf3f27cb768

	d5556d8565d49       24bc64e911039                                                                                                             28 minutes ago      Running             etcd                         0                   37fcc92ec98a7

	a485542b186e4       72c9df6be7f1b                                                                                                             28 minutes ago      Running             kube-apiserver               0                   383872bb10f81

	* 

	* ==> coredns [5e708965dbb0] <==

	* .:53

	[INFO] plugin/reload: Running configuration SHA512 = ea7a0d73d9d208f758b1f67640ef03c58089b9d9366cf3478df3bb369b210e39f213811b46224f8a04380814b6e0890ccd358f5b5e8c80bc22ac19c8601ee35b

	CoreDNS-1.10.1

	linux/arm64, go1.20, 055b2c3

	[INFO] 127.0.0.1:59819 - 54023 "HINFO IN 5089267470380203033.66065138292483152. udp 55 false 512" NXDOMAIN qr,rd,ra 130 0.424436073s

	[INFO] 10.244.0.7:57634 - 60032 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000112931s

	[INFO] 10.244.0.7:36916 - 20311 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000078547s

	[INFO] 10.244.0.7:53888 - 30613 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000056548s

	[INFO] 10.244.0.7:40805 - 41575 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000031112s

	[INFO] 10.244.0.7:39418 - 54110 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000031567s

	[INFO] 10.244.0.7:45485 - 20279 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000113676s

	[INFO] 10.244.0.7:49511 - 45953 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 534 0.000780781s

	[INFO] 10.244.0.7:49660 - 37020 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.00090552s

	* 

	* ==> describe nodes <==

	* Name:               addons-514000

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=arm64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=arm64

	                    kubernetes.io/hostname=addons-514000

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=d23ad66c17ded3bf1d7d6fb0fa0ee29881f9547e

	                    minikube.k8s.io/name=addons-514000

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2023_05_24T11_36_37_0700

	                    minikube.k8s.io/version=v1.30.1

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Wed, 24 May 2023 18:36:34 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  addons-514000

	  AcquireTime:     <unset>

	  RenewTime:       Wed, 24 May 2023 19:04:43 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Wed, 24 May 2023 19:02:41 +0000   Wed, 24 May 2023 18:36:33 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Wed, 24 May 2023 19:02:41 +0000   Wed, 24 May 2023 18:36:33 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Wed, 24 May 2023 19:02:41 +0000   Wed, 24 May 2023 18:36:33 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Wed, 24 May 2023 19:02:41 +0000   Wed, 24 May 2023 18:36:39 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.105.2

	  Hostname:    addons-514000

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17784760Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3905972Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17784760Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3905972Ki

	  pods:               110

	System Info:

	  Machine ID:                 cc66183cd0c646be999944d821185b81

	  System UUID:                cc66183cd0c646be999944d821185b81

	  Boot ID:                    2cd753bf-40ed-44ce-928e-d8bb002a6012

	  Kernel Version:             5.10.57

	  OS Image:                   Buildroot 2021.02.12

	  Operating System:           linux

	  Architecture:               arm64

	  Container Runtime Version:  docker://20.10.23

	  Kubelet Version:            v1.27.2

	  Kube-Proxy Version:         v1.27.2

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (10 in total)

	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---

	  gcp-auth                    gcp-auth-58478865f7-5429c                0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         27m

	  kube-system                 coredns-5d78c9869d-dmkfx                 100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (1%!)(MISSING)        170Mi (4%!)(MISSING)     27m

	  kube-system                 etcd-addons-514000                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (2%!)(MISSING)       0 (0%!)(MISSING)         28m

	  kube-system                 kube-apiserver-addons-514000             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         28m

	  kube-system                 kube-controller-manager-addons-514000    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         28m

	  kube-system                 kube-proxy-2gj6m                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         27m

	  kube-system                 kube-scheduler-addons-514000             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         28m

	  kube-system                 snapshot-controller-75bbb956b9-j5jhp     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         27m

	  kube-system                 snapshot-controller-75bbb956b9-txrxl     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         27m

	  kube-system                 storage-provisioner                      0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         27m

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%!)(MISSING)  0 (0%!)(MISSING)

	  memory             170Mi (4%!)(MISSING)  170Mi (4%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-32Mi     0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-64Ki     0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age   From             Message

	  ----    ------                   ----  ----             -------

	  Normal  Starting                 27m   kube-proxy       

	  Normal  Starting                 28m   kubelet          Starting kubelet.

	  Normal  NodeAllocatableEnforced  28m   kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  28m   kubelet          Node addons-514000 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    28m   kubelet          Node addons-514000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     28m   kubelet          Node addons-514000 status is now: NodeHasSufficientPID

	  Normal  NodeReady                28m   kubelet          Node addons-514000 status is now: NodeReady

	  Normal  RegisteredNode           27m   node-controller  Node addons-514000 event: Registered Node addons-514000 in Controller

	* 

	* ==> dmesg <==

	* [May24 18:36] ACPI: SRAT not present

	[  +0.000000] KASLR disabled due to lack of seed

	[  +0.727578] EINJ: EINJ table not found.

	[  +0.656332] systemd-fstab-generator[114]: Ignoring "noauto" for root device

	[  +0.043407] systemd[1]: systemd-journald.service: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.

	[  +0.000915] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)

	[  +3.905553] systemd-fstab-generator[471]: Ignoring "noauto" for root device

	[  +0.096232] systemd-fstab-generator[482]: Ignoring "noauto" for root device

	[  +2.874276] systemd-fstab-generator[684]: Ignoring "noauto" for root device

	[  +1.463827] systemd-fstab-generator[849]: Ignoring "noauto" for root device

	[  +0.166355] systemd-fstab-generator[885]: Ignoring "noauto" for root device

	[  +0.076432] systemd-fstab-generator[896]: Ignoring "noauto" for root device

	[  +0.091985] systemd-fstab-generator[909]: Ignoring "noauto" for root device

	[  +1.135416] kauditd_printk_skb: 53 callbacks suppressed

	[  +0.091978] systemd-fstab-generator[1057]: Ignoring "noauto" for root device

	[  +0.084182] systemd-fstab-generator[1068]: Ignoring "noauto" for root device

	[  +0.089221] systemd-fstab-generator[1079]: Ignoring "noauto" for root device

	[  +0.079548] systemd-fstab-generator[1090]: Ignoring "noauto" for root device

	[  +0.085105] systemd-fstab-generator[1131]: Ignoring "noauto" for root device

	[  +2.454751] systemd-fstab-generator[1385]: Ignoring "noauto" for root device

	[  +5.146027] systemd-fstab-generator[2260]: Ignoring "noauto" for root device

	[ +14.118818] kauditd_printk_skb: 41 callbacks suppressed

	[  +2.617169] TCP: eth0: Driver has suspect GRO implementation, TCP performance may be compromised.

	[  +3.922890] kauditd_printk_skb: 33 callbacks suppressed

	[May24 18:37] kauditd_printk_skb: 17 callbacks suppressed

	* 

	* ==> etcd [d5556d8565d4] <==

	* {"level":"info","ts":"2023-05-24T18:36:33.832Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"c46d288d2fcb0590 became leader at term 2"}

	{"level":"info","ts":"2023-05-24T18:36:33.832Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: c46d288d2fcb0590 elected leader c46d288d2fcb0590 at term 2"}

	{"level":"info","ts":"2023-05-24T18:36:33.834Z","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"c46d288d2fcb0590","local-member-attributes":"{Name:addons-514000 ClientURLs:[https://192.168.105.2:2379]}","request-path":"/0/members/c46d288d2fcb0590/attributes","cluster-id":"6e03e7863b4f9c54","publish-timeout":"7s"}

	{"level":"info","ts":"2023-05-24T18:36:33.834Z","caller":"embed/serve.go:100","msg":"ready to serve client requests"}

	{"level":"info","ts":"2023-05-24T18:36:33.835Z","caller":"embed/serve.go:198","msg":"serving client traffic securely","address":"192.168.105.2:2379"}

	{"level":"info","ts":"2023-05-24T18:36:33.834Z","caller":"etcdserver/server.go:2571","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}

	{"level":"info","ts":"2023-05-24T18:36:33.835Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}

	{"level":"info","ts":"2023-05-24T18:36:33.835Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}

	{"level":"info","ts":"2023-05-24T18:36:33.834Z","caller":"embed/serve.go:100","msg":"ready to serve client requests"}

	{"level":"info","ts":"2023-05-24T18:36:33.838Z","caller":"embed/serve.go:198","msg":"serving client traffic securely","address":"127.0.0.1:2379"}

	{"level":"info","ts":"2023-05-24T18:36:33.838Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"6e03e7863b4f9c54","local-member-id":"c46d288d2fcb0590","cluster-version":"3.5"}

	{"level":"info","ts":"2023-05-24T18:36:33.838Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}

	{"level":"info","ts":"2023-05-24T18:36:33.838Z","caller":"etcdserver/server.go:2595","msg":"cluster version is updated","cluster-version":"3.5"}

	{"level":"info","ts":"2023-05-24T18:46:33.876Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":846}

	{"level":"info","ts":"2023-05-24T18:46:33.881Z","caller":"mvcc/kvstore_compaction.go:66","msg":"finished scheduled compaction","compact-revision":846,"took":"3.400485ms","hash":3638416343}

	{"level":"info","ts":"2023-05-24T18:46:33.882Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":3638416343,"revision":846,"compact-revision":-1}

	{"level":"info","ts":"2023-05-24T18:51:33.887Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1145}

	{"level":"info","ts":"2023-05-24T18:51:33.890Z","caller":"mvcc/kvstore_compaction.go:66","msg":"finished scheduled compaction","compact-revision":1145,"took":"2.024563ms","hash":894933936}

	{"level":"info","ts":"2023-05-24T18:51:33.890Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":894933936,"revision":1145,"compact-revision":846}

	{"level":"info","ts":"2023-05-24T18:56:33.899Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1444}

	{"level":"info","ts":"2023-05-24T18:56:33.902Z","caller":"mvcc/kvstore_compaction.go:66","msg":"finished scheduled compaction","compact-revision":1444,"took":"1.805765ms","hash":2332186912}

	{"level":"info","ts":"2023-05-24T18:56:33.902Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":2332186912,"revision":1444,"compact-revision":1145}

	{"level":"info","ts":"2023-05-24T19:01:33.910Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1744}

	{"level":"info","ts":"2023-05-24T19:01:33.913Z","caller":"mvcc/kvstore_compaction.go:66","msg":"finished scheduled compaction","compact-revision":1744,"took":"1.711146ms","hash":1851239145}

	{"level":"info","ts":"2023-05-24T19:01:33.913Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":1851239145,"revision":1744,"compact-revision":1444}

	* 

	* ==> gcp-auth [d1ad6d2cd7d4] <==

	* 2023/05/24 18:37:03 GCP Auth Webhook started!

	* 

	* ==> kernel <==

	*  19:04:43 up 28 min,  0 users,  load average: 0.19, 0.47, 0.48

	Linux addons-514000 5.10.57 #1 SMP PREEMPT Sat May 20 00:35:14 UTC 2023 aarch64 GNU/Linux

	PRETTY_NAME="Buildroot 2021.02.12"

	* 

	* ==> kube-apiserver [a485542b186e] <==

	* I0524 18:36:57.610279       1 controller.go:624] quota admission added evaluator for: jobs.batch

	I0524 18:41:34.543984       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 18:41:34.544093       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 18:46:34.544191       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 18:46:34.544366       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 18:46:34.554262       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 18:46:34.554305       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 18:46:34.559325       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 18:46:34.559355       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 18:51:34.542946       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 18:51:34.543557       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 18:51:34.550014       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 18:51:34.550133       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 18:51:34.556769       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 18:51:34.556848       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 18:56:34.536214       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 18:56:34.536373       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 18:56:34.548003       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 18:56:34.548106       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 19:01:34.537192       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 19:01:34.537290       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 19:01:34.537554       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 19:01:34.537601       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 19:01:34.538264       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 19:01:34.538305       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	* 

	* ==> kube-controller-manager [aa80b21f8508] <==

	* I0524 18:37:01.505510       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-create

	I0524 18:37:01.519013       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch

	I0524 18:37:02.495937       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch

	I0524 18:37:02.582819       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-create

	I0524 18:37:03.506916       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-create

	I0524 18:37:03.513803       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch

	I0524 18:37:03.593747       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-create

	I0524 18:37:03.596306       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-create

	I0524 18:37:03.598360       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-create

	I0524 18:37:03.598521       1 event.go:307] "Event occurred" object="gcp-auth/gcp-auth-certs-create" fieldPath="" kind="Job" apiVersion="batch/v1" type="Normal" reason="Completed" message="Job completed"

	I0524 18:37:03.685792       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch

	I0524 18:37:04.524940       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch

	I0524 18:37:04.535090       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch

	I0524 18:37:04.540969       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch

	I0524 18:37:04.541239       1 event.go:307] "Event occurred" object="gcp-auth/gcp-auth-certs-patch" fieldPath="" kind="Job" apiVersion="batch/v1" type="Normal" reason="Completed" message="Job completed"

	I0524 18:37:04.555353       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch

	I0524 18:37:20.560907       1 resource_quota_monitor.go:223] "QuotaMonitor created object count evaluator" resource="volumesnapshots.snapshot.storage.k8s.io"

	I0524 18:37:20.561333       1 shared_informer.go:311] Waiting for caches to sync for resource quota

	I0524 18:37:20.662721       1 shared_informer.go:318] Caches are synced for resource quota

	I0524 18:37:20.895710       1 shared_informer.go:311] Waiting for caches to sync for garbage collector

	I0524 18:37:20.999329       1 shared_informer.go:318] Caches are synced for garbage collector

	I0524 18:37:33.024397       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-create

	I0524 18:37:33.041354       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-create

	I0524 18:37:34.012720       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch

	I0524 18:37:34.026381       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch

	* 

	* ==> kube-proxy [bf84d832ec96] <==

	* I0524 18:36:51.096070       1 node.go:141] Successfully retrieved node IP: 192.168.105.2

	I0524 18:36:51.096254       1 server_others.go:110] "Detected node IP" address="192.168.105.2"

	I0524 18:36:51.096305       1 server_others.go:551] "Using iptables proxy"

	I0524 18:36:51.129985       1 server_others.go:176] "kube-proxy running in single-stack mode: secondary ipFamily is not supported" ipFamily=IPv6

	I0524 18:36:51.130045       1 server_others.go:190] "Using iptables Proxier"

	I0524 18:36:51.130091       1 proxier.go:253] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"

	I0524 18:36:51.130875       1 server.go:657] "Version info" version="v1.27.2"

	I0524 18:36:51.130883       1 server.go:659] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0524 18:36:51.134580       1 config.go:188] "Starting service config controller"

	I0524 18:36:51.134608       1 shared_informer.go:311] Waiting for caches to sync for service config

	I0524 18:36:51.134627       1 config.go:97] "Starting endpoint slice config controller"

	I0524 18:36:51.134630       1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config

	I0524 18:36:51.134949       1 config.go:315] "Starting node config controller"

	I0524 18:36:51.134952       1 shared_informer.go:311] Waiting for caches to sync for node config

	I0524 18:36:51.240491       1 shared_informer.go:318] Caches are synced for node config

	I0524 18:36:51.240513       1 shared_informer.go:318] Caches are synced for service config

	I0524 18:36:51.240529       1 shared_informer.go:318] Caches are synced for endpoint slice config

	* 

	* ==> kube-scheduler [046435c695b1] <==

	* W0524 18:36:34.551296       1 reflector.go:533] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0524 18:36:34.551335       1 reflector.go:148] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	W0524 18:36:34.555158       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E0524 18:36:34.555224       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	W0524 18:36:34.555257       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0524 18:36:34.555277       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	W0524 18:36:34.555318       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E0524 18:36:34.555338       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	W0524 18:36:34.555364       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0524 18:36:34.555398       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	W0524 18:36:34.555416       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0524 18:36:34.555434       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	W0524 18:36:35.414754       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0524 18:36:35.414831       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	W0524 18:36:35.419590       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0524 18:36:35.419621       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	W0524 18:36:35.431658       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E0524 18:36:35.431697       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	W0524 18:36:35.542100       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0524 18:36:35.542130       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	W0524 18:36:35.557940       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0524 18:36:35.558018       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	W0524 18:36:35.599004       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0524 18:36:35.599089       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	I0524 18:36:36.142741       1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	* 

	* ==> kubelet <==

	* -- Journal begins at Wed 2023-05-24 18:36:19 UTC, ends at Wed 2023-05-24 19:04:43 UTC. --

	May 24 18:59:37 addons-514000 kubelet[2266]: E0524 18:59:37.219146    2266 iptables.go:575] "Could not set up iptables canary" err=<

	May 24 18:59:37 addons-514000 kubelet[2266]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	May 24 18:59:37 addons-514000 kubelet[2266]:         Perhaps ip6tables or your kernel needs to be upgraded.

	May 24 18:59:37 addons-514000 kubelet[2266]:  > table=nat chain=KUBE-KUBELET-CANARY

	May 24 19:00:37 addons-514000 kubelet[2266]: E0524 19:00:37.312409    2266 iptables.go:575] "Could not set up iptables canary" err=<

	May 24 19:00:37 addons-514000 kubelet[2266]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	May 24 19:00:37 addons-514000 kubelet[2266]:         Perhaps ip6tables or your kernel needs to be upgraded.

	May 24 19:00:37 addons-514000 kubelet[2266]:  > table=nat chain=KUBE-KUBELET-CANARY

	May 24 19:01:37 addons-514000 kubelet[2266]: E0524 19:01:37.211178    2266 iptables.go:575] "Could not set up iptables canary" err=<

	May 24 19:01:37 addons-514000 kubelet[2266]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	May 24 19:01:37 addons-514000 kubelet[2266]:         Perhaps ip6tables or your kernel needs to be upgraded.

	May 24 19:01:37 addons-514000 kubelet[2266]:  > table=nat chain=KUBE-KUBELET-CANARY

	May 24 19:01:37 addons-514000 kubelet[2266]: W0524 19:01:37.216820    2266 machine.go:65] Cannot read vendor id correctly, set empty.

	May 24 19:02:37 addons-514000 kubelet[2266]: E0524 19:02:37.212957    2266 iptables.go:575] "Could not set up iptables canary" err=<

	May 24 19:02:37 addons-514000 kubelet[2266]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	May 24 19:02:37 addons-514000 kubelet[2266]:         Perhaps ip6tables or your kernel needs to be upgraded.

	May 24 19:02:37 addons-514000 kubelet[2266]:  > table=nat chain=KUBE-KUBELET-CANARY

	May 24 19:03:37 addons-514000 kubelet[2266]: E0524 19:03:37.209339    2266 iptables.go:575] "Could not set up iptables canary" err=<

	May 24 19:03:37 addons-514000 kubelet[2266]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	May 24 19:03:37 addons-514000 kubelet[2266]:         Perhaps ip6tables or your kernel needs to be upgraded.

	May 24 19:03:37 addons-514000 kubelet[2266]:  > table=nat chain=KUBE-KUBELET-CANARY

	May 24 19:04:37 addons-514000 kubelet[2266]: E0524 19:04:37.208780    2266 iptables.go:575] "Could not set up iptables canary" err=<

	May 24 19:04:37 addons-514000 kubelet[2266]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	May 24 19:04:37 addons-514000 kubelet[2266]:         Perhaps ip6tables or your kernel needs to be upgraded.

	May 24 19:04:37 addons-514000 kubelet[2266]:  > table=nat chain=KUBE-KUBELET-CANARY

	* 

	* ==> storage-provisioner [c6d1bdca910b] <==

	* I0524 18:36:52.162540       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0524 18:36:52.179095       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0524 18:36:52.179236       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I0524 18:36:52.184538       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0524 18:36:52.185437       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-514000_06403223-0fe7-4b51-9128-30a4ab7aa15a!

	I0524 18:36:52.187871       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"6d6698b6-9eb5-4aee-aab5-f9c270917482", APIVersion:"v1", ResourceVersion:"417", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-514000_06403223-0fe7-4b51-9128-30a4ab7aa15a became leader

	I0524 18:36:52.285999       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-514000_06403223-0fe7-4b51-9128-30a4ab7aa15a!

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.APIServer}} -p addons-514000 -n addons-514000

helpers_test.go:261: (dbg) Run:  kubectl --context addons-514000 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:285: <<< TestAddons/parallel/InspektorGadget FAILED: end of post-mortem logs <<<

helpers_test.go:286: ---------------------/post-mortem---------------------------------

--- FAIL: TestAddons/parallel/InspektorGadget (480.89s)

=== RUN   TestAddons/parallel/MetricsServer

=== PAUSE TestAddons/parallel/MetricsServer

=== CONT  TestAddons/parallel/MetricsServer

addons_test.go:381: failed waiting for metrics-server deployment to stabilize: timed out waiting for the condition

addons_test.go:383: metrics-server stabilized in 6m0.00230875s

addons_test.go:385: (dbg) TestAddons/parallel/MetricsServer: waiting 6m0s for pods matching "k8s-app=metrics-server" in namespace "kube-system" ...

addons_test.go:385: ***** TestAddons/parallel/MetricsServer: pod "k8s-app=metrics-server" failed to start within 6m0s: context deadline exceeded ****

addons_test.go:385: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.APIServer}} -p addons-514000 -n addons-514000

addons_test.go:385: TestAddons/parallel/MetricsServer: showing logs for failed pods as of 2023-05-24 12:06:51.555224 -0700 PDT m=+1868.407768001

addons_test.go:386: failed waiting for k8s-app=metrics-server pod: k8s-app=metrics-server within 6m0s: context deadline exceeded

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p addons-514000 -n addons-514000

helpers_test.go:244: <<< TestAddons/parallel/MetricsServer FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestAddons/parallel/MetricsServer]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-darwin-arm64 -p addons-514000 logs -n 25

helpers_test.go:252: TestAddons/parallel/MetricsServer logs: 

-- stdout --

	* 

	* ==> Audit <==

	* |---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|

	| Command |              Args              |       Profile        |  User   | Version |     Start Time      |      End Time       |

	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|

	| start   | -o=json --download-only        | download-only-108000 | jenkins | v1.30.1 | 24 May 23 11:35 PDT |                     |

	|         | -p download-only-108000        |                      |         |         |                     |                     |

	|         | --force --alsologtostderr      |                      |         |         |                     |                     |

	|         | --kubernetes-version=v1.16.0   |                      |         |         |                     |                     |

	|         | --container-runtime=docker     |                      |         |         |                     |                     |

	|         | --driver=qemu2                 |                      |         |         |                     |                     |

	| start   | -o=json --download-only        | download-only-108000 | jenkins | v1.30.1 | 24 May 23 11:35 PDT |                     |

	|         | -p download-only-108000        |                      |         |         |                     |                     |

	|         | --force --alsologtostderr      |                      |         |         |                     |                     |

	|         | --kubernetes-version=v1.27.2   |                      |         |         |                     |                     |

	|         | --container-runtime=docker     |                      |         |         |                     |                     |

	|         | --driver=qemu2                 |                      |         |         |                     |                     |

	| delete  | --all                          | minikube             | jenkins | v1.30.1 | 24 May 23 11:36 PDT | 24 May 23 11:36 PDT |

	| delete  | -p download-only-108000        | download-only-108000 | jenkins | v1.30.1 | 24 May 23 11:36 PDT | 24 May 23 11:36 PDT |

	| delete  | -p download-only-108000        | download-only-108000 | jenkins | v1.30.1 | 24 May 23 11:36 PDT | 24 May 23 11:36 PDT |

	| start   | --download-only -p             | binary-mirror-689000 | jenkins | v1.30.1 | 24 May 23 11:36 PDT |                     |

	|         | binary-mirror-689000           |                      |         |         |                     |                     |

	|         | --alsologtostderr              |                      |         |         |                     |                     |

	|         | --binary-mirror                |                      |         |         |                     |                     |

	|         | http://127.0.0.1:49309         |                      |         |         |                     |                     |

	|         | --driver=qemu2                 |                      |         |         |                     |                     |

	| delete  | -p binary-mirror-689000        | binary-mirror-689000 | jenkins | v1.30.1 | 24 May 23 11:36 PDT | 24 May 23 11:36 PDT |

	| start   | -p addons-514000               | addons-514000        | jenkins | v1.30.1 | 24 May 23 11:36 PDT | 24 May 23 11:42 PDT |

	|         | --wait=true --memory=4000      |                      |         |         |                     |                     |

	|         | --alsologtostderr              |                      |         |         |                     |                     |

	|         | --addons=registry              |                      |         |         |                     |                     |

	|         | --addons=metrics-server        |                      |         |         |                     |                     |

	|         | --addons=volumesnapshots       |                      |         |         |                     |                     |

	|         | --addons=csi-hostpath-driver   |                      |         |         |                     |                     |

	|         | --addons=gcp-auth              |                      |         |         |                     |                     |

	|         | --addons=cloud-spanner         |                      |         |         |                     |                     |

	|         | --addons=inspektor-gadget      |                      |         |         |                     |                     |

	|         | --driver=qemu2                 |                      |         |         |                     |                     |

	|         | --addons=ingress               |                      |         |         |                     |                     |

	|         | --addons=ingress-dns           |                      |         |         |                     |                     |

	| addons  | disable cloud-spanner -p       | addons-514000        | jenkins | v1.30.1 | 24 May 23 11:54 PDT |                     |

	|         | addons-514000                  |                      |         |         |                     |                     |

	| addons  | enable headlamp                | addons-514000        | jenkins | v1.30.1 | 24 May 23 12:04 PDT | 24 May 23 12:04 PDT |

	|         | -p addons-514000               |                      |         |         |                     |                     |

	|         | --alsologtostderr -v=1         |                      |         |         |                     |                     |

	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|

	* 

	* ==> Last Start <==

	* Log file created at: 2023/05/24 11:36:07

	Running on machine: MacOS-M1-Agent-1

	Binary: Built with gc go1.20.4 for darwin/arm64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0524 11:36:07.002339    1534 out.go:296] Setting OutFile to fd 1 ...

	I0524 11:36:07.002453    1534 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0524 11:36:07.002456    1534 out.go:309] Setting ErrFile to fd 2...

	I0524 11:36:07.002459    1534 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0524 11:36:07.002536    1534 root.go:336] Updating PATH: /Users/jenkins/minikube-integration/16573-1024/.minikube/bin

	I0524 11:36:07.003586    1534 out.go:303] Setting JSON to false

	I0524 11:36:07.018861    1534 start.go:125] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":338,"bootTime":1684953029,"procs":422,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"13.3.1","kernelVersion":"22.4.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}

	W0524 11:36:07.018925    1534 start.go:133] gopshost.Virtualization returned error: not implemented yet

	I0524 11:36:07.027769    1534 out.go:177] * [addons-514000] minikube v1.30.1 on Darwin 13.3.1 (arm64)

	I0524 11:36:07.031820    1534 out.go:177]   - MINIKUBE_LOCATION=16573

	I0524 11:36:07.031893    1534 notify.go:220] Checking for updates...

	I0524 11:36:07.038648    1534 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/16573-1024/kubeconfig

	I0524 11:36:07.041871    1534 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0524 11:36:07.045796    1534 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0524 11:36:07.047102    1534 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/16573-1024/.minikube

	I0524 11:36:07.049751    1534 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0524 11:36:07.052962    1534 driver.go:375] Setting default libvirt URI to qemu:///system

	I0524 11:36:07.056656    1534 out.go:177] * Using the qemu2 driver based on user configuration

	I0524 11:36:07.063768    1534 start.go:295] selected driver: qemu2

	I0524 11:36:07.063774    1534 start.go:870] validating driver "qemu2" against <nil>

	I0524 11:36:07.063780    1534 start.go:881] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0524 11:36:07.066216    1534 start_flags.go:305] no existing cluster config was found, will generate one from the flags 

	I0524 11:36:07.068844    1534 out.go:177] * Automatically selected the socket_vmnet network

	I0524 11:36:07.072801    1534 start_flags.go:915] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0524 11:36:07.072817    1534 cni.go:84] Creating CNI manager for ""

	I0524 11:36:07.072825    1534 cni.go:157] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0524 11:36:07.072829    1534 start_flags.go:314] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0524 11:36:07.072834    1534 start_flags.go:319] config:

	{Name:addons-514000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684536746-16501@sha256:f5d93abf1d1cfb142a7cf0b58b24029595d621e5f943105b16c61199094d77de Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.2 ClusterName:addons-514000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CR

ISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}

	I0524 11:36:07.072903    1534 iso.go:125] acquiring lock: {Name:mk78431aa792d64459e9d8bd2fb1ce84dc420421 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0524 11:36:07.080756    1534 out.go:177] * Starting control plane node addons-514000 in cluster addons-514000

	I0524 11:36:07.084763    1534 preload.go:132] Checking if preload exists for k8s version v1.27.2 and runtime docker

	I0524 11:36:07.084787    1534 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/16573-1024/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.2-docker-overlay2-arm64.tar.lz4

	I0524 11:36:07.084798    1534 cache.go:57] Caching tarball of preloaded images

	I0524 11:36:07.084855    1534 preload.go:174] Found /Users/jenkins/minikube-integration/16573-1024/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0524 11:36:07.084860    1534 cache.go:60] Finished verifying existence of preloaded tar for  v1.27.2 on docker

	I0524 11:36:07.085026    1534 profile.go:148] Saving config to /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/config.json ...

	I0524 11:36:07.085039    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/config.json: {Name:mk030e94b16168c63405a9b01e247098a953bb00 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:07.085215    1534 cache.go:195] Successfully downloaded all kic artifacts

	I0524 11:36:07.085252    1534 start.go:364] acquiring machines lock for addons-514000: {Name:mkb37a68e9ac84a7c17b3cbe42c3966e2ec65b65 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0524 11:36:07.085315    1534 start.go:368] acquired machines lock for "addons-514000" in 57.708µs

	I0524 11:36:07.085327    1534 start.go:93] Provisioning new machine with config: &{Name:addons-514000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/16501/minikube-v1.30.1-1684536668-16501-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684536746-16501@sha256:f5d93abf1d1cfb142a7cf0b58b24029595d621e5f943105b16c61199094d77de Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi

g:{KubernetesVersion:v1.27.2 ClusterName:addons-514000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262

144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:} &{Name: IP: Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0524 11:36:07.085355    1534 start.go:125] createHost starting for "" (driver="qemu2")

	I0524 11:36:07.093778    1534 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	I0524 11:36:07.463575    1534 start.go:159] libmachine.API.Create for "addons-514000" (driver="qemu2")

	I0524 11:36:07.463635    1534 client.go:168] LocalClient.Create starting

	I0524 11:36:07.463808    1534 main.go:141] libmachine: Creating CA: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca.pem

	I0524 11:36:07.521208    1534 main.go:141] libmachine: Creating client certificate: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/cert.pem

	I0524 11:36:07.678481    1534 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/16573-1024/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/16573-1024/.minikube/cache/iso/arm64/minikube-v1.30.1-1684536668-16501-arm64.iso...

	I0524 11:36:08.060894    1534 main.go:141] libmachine: Creating SSH key...

	I0524 11:36:08.147520    1534 main.go:141] libmachine: Creating Disk image...

	I0524 11:36:08.147526    1534 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0524 11:36:08.147754    1534 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/disk.qcow2.raw /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/disk.qcow2

	I0524 11:36:08.231403    1534 main.go:141] libmachine: STDOUT: 

	I0524 11:36:08.231426    1534 main.go:141] libmachine: STDERR: 

	I0524 11:36:08.231485    1534 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/disk.qcow2 +20000M

	I0524 11:36:08.238737    1534 main.go:141] libmachine: STDOUT: Image resized.

	I0524 11:36:08.238750    1534 main.go:141] libmachine: STDERR: 

	I0524 11:36:08.238766    1534 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/disk.qcow2.raw and /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/disk.qcow2

	I0524 11:36:08.238773    1534 main.go:141] libmachine: Starting QEMU VM...

	I0524 11:36:08.238817    1534 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt -cpu host -drive file=/opt/homebrew/Cellar/qemu/7.2.0/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 4000 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/qemu.pid -device virtio-net-pci,netdev=net0,mac=0a:73:48:f5:f9:b3 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/disk.qcow2

	I0524 11:36:08.309201    1534 main.go:141] libmachine: STDOUT: 

	I0524 11:36:08.309237    1534 main.go:141] libmachine: STDERR: 

	I0524 11:36:08.309242    1534 main.go:141] libmachine: Attempt 0

	I0524 11:36:08.309258    1534 main.go:141] libmachine: Searching for a:73:48:f5:f9:b3 in /var/db/dhcpd_leases ...

	I0524 11:36:10.311441    1534 main.go:141] libmachine: Attempt 1

	I0524 11:36:10.311529    1534 main.go:141] libmachine: Searching for a:73:48:f5:f9:b3 in /var/db/dhcpd_leases ...

	I0524 11:36:12.313222    1534 main.go:141] libmachine: Attempt 2

	I0524 11:36:12.313245    1534 main.go:141] libmachine: Searching for a:73:48:f5:f9:b3 in /var/db/dhcpd_leases ...

	I0524 11:36:14.315294    1534 main.go:141] libmachine: Attempt 3

	I0524 11:36:14.315307    1534 main.go:141] libmachine: Searching for a:73:48:f5:f9:b3 in /var/db/dhcpd_leases ...

	I0524 11:36:16.317343    1534 main.go:141] libmachine: Attempt 4

	I0524 11:36:16.317356    1534 main.go:141] libmachine: Searching for a:73:48:f5:f9:b3 in /var/db/dhcpd_leases ...

	I0524 11:36:18.319398    1534 main.go:141] libmachine: Attempt 5

	I0524 11:36:18.319426    1534 main.go:141] libmachine: Searching for a:73:48:f5:f9:b3 in /var/db/dhcpd_leases ...

	I0524 11:36:20.321607    1534 main.go:141] libmachine: Attempt 6

	I0524 11:36:20.321690    1534 main.go:141] libmachine: Searching for a:73:48:f5:f9:b3 in /var/db/dhcpd_leases ...

	I0524 11:36:20.321979    1534 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I0524 11:36:20.322073    1534 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:a:73:48:f5:f9:b3 ID:1,a:73:48:f5:f9:b3 Lease:0x646faaa3}

	I0524 11:36:20.322118    1534 main.go:141] libmachine: Found match: a:73:48:f5:f9:b3

	I0524 11:36:20.322159    1534 main.go:141] libmachine: IP: 192.168.105.2

	I0524 11:36:20.322182    1534 main.go:141] libmachine: Waiting for VM to start (ssh -p 22 docker@192.168.105.2)...

	I0524 11:36:22.345943    1534 machine.go:88] provisioning docker machine ...

	I0524 11:36:22.346010    1534 buildroot.go:166] provisioning hostname "addons-514000"

	I0524 11:36:22.346753    1534 main.go:141] libmachine: Using SSH client type: native

	I0524 11:36:22.347771    1534 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100e286d0] 0x100e2b130 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0524 11:36:22.347789    1534 main.go:141] libmachine: About to run SSH command:

	sudo hostname addons-514000 && echo "addons-514000" | sudo tee /etc/hostname

	I0524 11:36:22.440700    1534 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-514000

	I0524 11:36:22.440862    1534 main.go:141] libmachine: Using SSH client type: native

	I0524 11:36:22.441350    1534 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100e286d0] 0x100e2b130 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0524 11:36:22.441366    1534 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\saddons-514000' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-514000/g' /etc/hosts;

				else 

					echo '127.0.1.1 addons-514000' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0524 11:36:22.513129    1534 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0524 11:36:22.513148    1534 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/16573-1024/.minikube CaCertPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/16573-1024/.minikube}

	I0524 11:36:22.513166    1534 buildroot.go:174] setting up certificates

	I0524 11:36:22.513196    1534 provision.go:83] configureAuth start

	I0524 11:36:22.513202    1534 provision.go:138] copyHostCerts

	I0524 11:36:22.513384    1534 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.pem (1078 bytes)

	I0524 11:36:22.513907    1534 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/16573-1024/.minikube/cert.pem (1123 bytes)

	I0524 11:36:22.514185    1534 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/16573-1024/.minikube/key.pem (1675 bytes)

	I0524 11:36:22.514351    1534 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca-key.pem org=jenkins.addons-514000 san=[192.168.105.2 192.168.105.2 localhost 127.0.0.1 minikube addons-514000]

	I0524 11:36:22.615592    1534 provision.go:172] copyRemoteCerts

	I0524 11:36:22.615660    1534 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0524 11:36:22.615678    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:22.647614    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0524 11:36:22.654906    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/server.pem --> /etc/docker/server.pem (1216 bytes)

	I0524 11:36:22.661956    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0524 11:36:22.668901    1534 provision.go:86] duration metric: configureAuth took 155.700959ms

	I0524 11:36:22.668909    1534 buildroot.go:189] setting minikube options for container-runtime

	I0524 11:36:22.669263    1534 config.go:182] Loaded profile config "addons-514000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.27.2

	I0524 11:36:22.669315    1534 main.go:141] libmachine: Using SSH client type: native

	I0524 11:36:22.669538    1534 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100e286d0] 0x100e2b130 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0524 11:36:22.669543    1534 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0524 11:36:22.728343    1534 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I0524 11:36:22.728351    1534 buildroot.go:70] root file system type: tmpfs

	I0524 11:36:22.728414    1534 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I0524 11:36:22.728455    1534 main.go:141] libmachine: Using SSH client type: native

	I0524 11:36:22.728711    1534 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100e286d0] 0x100e2b130 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0524 11:36:22.728749    1534 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0524 11:36:22.797892    1534 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0524 11:36:22.797940    1534 main.go:141] libmachine: Using SSH client type: native

	I0524 11:36:22.798220    1534 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100e286d0] 0x100e2b130 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0524 11:36:22.798231    1534 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0524 11:36:23.149053    1534 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory

	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.

	I0524 11:36:23.149067    1534 machine.go:91] provisioned docker machine in 803.097167ms

	I0524 11:36:23.149073    1534 client.go:171] LocalClient.Create took 15.685539208s

	I0524 11:36:23.149079    1534 start.go:167] duration metric: libmachine.API.Create for "addons-514000" took 15.685619292s

	I0524 11:36:23.149084    1534 start.go:300] post-start starting for "addons-514000" (driver="qemu2")

	I0524 11:36:23.149087    1534 start.go:328] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0524 11:36:23.149151    1534 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0524 11:36:23.149161    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:23.182740    1534 ssh_runner.go:195] Run: cat /etc/os-release

	I0524 11:36:23.184182    1534 info.go:137] Remote host: Buildroot 2021.02.12

	I0524 11:36:23.184191    1534 filesync.go:126] Scanning /Users/jenkins/minikube-integration/16573-1024/.minikube/addons for local assets ...

	I0524 11:36:23.184263    1534 filesync.go:126] Scanning /Users/jenkins/minikube-integration/16573-1024/.minikube/files for local assets ...

	I0524 11:36:23.184291    1534 start.go:303] post-start completed in 35.204125ms

	I0524 11:36:23.184667    1534 profile.go:148] Saving config to /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/config.json ...

	I0524 11:36:23.184838    1534 start.go:128] duration metric: createHost completed in 16.099587584s

	I0524 11:36:23.184860    1534 main.go:141] libmachine: Using SSH client type: native

	I0524 11:36:23.185079    1534 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100e286d0] 0x100e2b130 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0524 11:36:23.185084    1534 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0524 11:36:23.240206    1534 main.go:141] libmachine: SSH cmd err, output: <nil>: 1684953383.421013085

	I0524 11:36:23.240212    1534 fix.go:207] guest clock: 1684953383.421013085

	I0524 11:36:23.240216    1534 fix.go:220] Guest: 2023-05-24 11:36:23.421013085 -0700 PDT Remote: 2023-05-24 11:36:23.184841 -0700 PDT m=+16.200821626 (delta=236.172085ms)

	I0524 11:36:23.240228    1534 fix.go:191] guest clock delta is within tolerance: 236.172085ms

	I0524 11:36:23.240231    1534 start.go:83] releasing machines lock for "addons-514000", held for 16.155020041s

	I0524 11:36:23.240534    1534 ssh_runner.go:195] Run: cat /version.json

	I0524 11:36:23.240542    1534 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0524 11:36:23.240552    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:23.240589    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:23.271294    1534 ssh_runner.go:195] Run: systemctl --version

	I0524 11:36:23.356274    1534 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0524 11:36:23.358206    1534 cni.go:208] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0524 11:36:23.358253    1534 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0524 11:36:23.363251    1534 cni.go:261] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0524 11:36:23.363272    1534 preload.go:132] Checking if preload exists for k8s version v1.27.2 and runtime docker

	I0524 11:36:23.363358    1534 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0524 11:36:23.374219    1534 docker.go:633] Got preloaded images: 

	I0524 11:36:23.374227    1534 docker.go:639] registry.k8s.io/kube-apiserver:v1.27.2 wasn't preloaded

	I0524 11:36:23.374272    1534 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I0524 11:36:23.377135    1534 ssh_runner.go:195] Run: which lz4

	I0524 11:36:23.378475    1534 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4

	I0524 11:36:23.379822    1534 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I0524 11:36:23.379833    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.2-docker-overlay2-arm64.tar.lz4 --> /preloaded.tar.lz4 (343635669 bytes)

	I0524 11:36:24.715030    1534 docker.go:597] Took 1.336609 seconds to copy over tarball

	I0524 11:36:24.715105    1534 ssh_runner.go:195] Run: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4

	I0524 11:36:25.802869    1534 ssh_runner.go:235] Completed: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4: (1.087750334s)

	I0524 11:36:25.802885    1534 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I0524 11:36:25.818539    1534 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I0524 11:36:25.821398    1534 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2629 bytes)

	I0524 11:36:25.826757    1534 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0524 11:36:25.912573    1534 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0524 11:36:27.259007    1534 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.346426625s)

	I0524 11:36:27.259050    1534 start.go:481] detecting cgroup driver to use...

	I0524 11:36:27.259161    1534 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0524 11:36:27.264502    1534 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"

	I0524 11:36:27.267902    1534 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I0524 11:36:27.271357    1534 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...

	I0524 11:36:27.271387    1534 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I0524 11:36:27.274823    1534 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0524 11:36:27.278019    1534 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I0524 11:36:27.280856    1534 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0524 11:36:27.283904    1534 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0524 11:36:27.287473    1534 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I0524 11:36:27.291108    1534 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0524 11:36:27.294288    1534 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0524 11:36:27.297250    1534 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0524 11:36:27.376117    1534 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I0524 11:36:27.384917    1534 start.go:481] detecting cgroup driver to use...

	I0524 11:36:27.384994    1534 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0524 11:36:27.390435    1534 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0524 11:36:27.395426    1534 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0524 11:36:27.402483    1534 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0524 11:36:27.406870    1534 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0524 11:36:27.411215    1534 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I0524 11:36:27.451530    1534 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0524 11:36:27.456795    1534 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0524 11:36:27.461922    1534 ssh_runner.go:195] Run: which cri-dockerd

	I0524 11:36:27.463049    1534 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I0524 11:36:27.465876    1534 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)

	I0524 11:36:27.470660    1534 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I0524 11:36:27.538638    1534 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I0524 11:36:27.616092    1534 docker.go:532] configuring docker to use "cgroupfs" as cgroup driver...

	I0524 11:36:27.616109    1534 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (144 bytes)

	I0524 11:36:27.621459    1534 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0524 11:36:27.708405    1534 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0524 11:36:28.851963    1534 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.143548708s)

	I0524 11:36:28.852015    1534 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I0524 11:36:28.939002    1534 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I0524 11:36:29.020013    1534 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I0524 11:36:29.108812    1534 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0524 11:36:29.187424    1534 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I0524 11:36:29.194801    1534 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0524 11:36:29.274472    1534 ssh_runner.go:195] Run: sudo systemctl restart cri-docker

	I0524 11:36:29.298400    1534 start.go:528] Will wait 60s for socket path /var/run/cri-dockerd.sock

	I0524 11:36:29.298499    1534 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0524 11:36:29.300633    1534 start.go:549] Will wait 60s for crictl version

	I0524 11:36:29.300681    1534 ssh_runner.go:195] Run: which crictl

	I0524 11:36:29.302069    1534 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0524 11:36:29.320125    1534 start.go:565] Version:  0.1.0

	RuntimeName:  docker

	RuntimeVersion:  20.10.23

	RuntimeApiVersion:  v1alpha2

	I0524 11:36:29.320196    1534 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0524 11:36:29.329425    1534 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0524 11:36:29.346012    1534 out.go:204] * Preparing Kubernetes v1.27.2 on Docker 20.10.23 ...

	I0524 11:36:29.346159    1534 ssh_runner.go:195] Run: grep 192.168.105.1	host.minikube.internal$ /etc/hosts

	I0524 11:36:29.347609    1534 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.105.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0524 11:36:29.351578    1534 preload.go:132] Checking if preload exists for k8s version v1.27.2 and runtime docker

	I0524 11:36:29.351619    1534 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0524 11:36:29.359168    1534 docker.go:633] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.27.2

	registry.k8s.io/kube-controller-manager:v1.27.2

	registry.k8s.io/kube-scheduler:v1.27.2

	registry.k8s.io/kube-proxy:v1.27.2

	registry.k8s.io/coredns/coredns:v1.10.1

	registry.k8s.io/etcd:3.5.7-0

	registry.k8s.io/pause:3.9

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I0524 11:36:29.359177    1534 docker.go:563] Images already preloaded, skipping extraction

	I0524 11:36:29.359234    1534 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0524 11:36:29.366578    1534 docker.go:633] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.27.2

	registry.k8s.io/kube-scheduler:v1.27.2

	registry.k8s.io/kube-controller-manager:v1.27.2

	registry.k8s.io/kube-proxy:v1.27.2

	registry.k8s.io/coredns/coredns:v1.10.1

	registry.k8s.io/etcd:3.5.7-0

	registry.k8s.io/pause:3.9

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I0524 11:36:29.366587    1534 cache_images.go:84] Images are preloaded, skipping loading

	I0524 11:36:29.366634    1534 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I0524 11:36:29.376722    1534 cni.go:84] Creating CNI manager for ""

	I0524 11:36:29.376734    1534 cni.go:157] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0524 11:36:29.376743    1534 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I0524 11:36:29.376755    1534 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.105.2 APIServerPort:8443 KubernetesVersion:v1.27.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-514000 NodeName:addons-514000 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.105.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.105.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/ku

bernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I0524 11:36:29.376831    1534 kubeadm.go:181] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.105.2

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/cri-dockerd.sock

	  name: "addons-514000"

	  kubeletExtraArgs:

	    node-ip: 192.168.105.2

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.105.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.27.2

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0524 11:36:29.376873    1534 kubeadm.go:971] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.27.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/cri-dockerd.sock --hostname-override=addons-514000 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.105.2

	[Install]

	 config:

	{KubernetesVersion:v1.27.2 ClusterName:addons-514000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I0524 11:36:29.376934    1534 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.27.2

	I0524 11:36:29.379950    1534 binaries.go:44] Found k8s binaries, skipping transfer

	I0524 11:36:29.379980    1534 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0524 11:36:29.383262    1534 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (375 bytes)

	I0524 11:36:29.388298    1534 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0524 11:36:29.393370    1534 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2099 bytes)

	I0524 11:36:29.398040    1534 ssh_runner.go:195] Run: grep 192.168.105.2	control-plane.minikube.internal$ /etc/hosts

	I0524 11:36:29.399441    1534 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.105.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0524 11:36:29.403560    1534 certs.go:56] Setting up /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000 for IP: 192.168.105.2

	I0524 11:36:29.403576    1534 certs.go:190] acquiring lock for shared ca certs: {Name:mk53f82f750243d1079819acfe50ecbc2a56595a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.403733    1534 certs.go:204] generating minikubeCA CA: /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.key

	I0524 11:36:29.494908    1534 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.crt ...

	I0524 11:36:29.494916    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.crt: {Name:mkde13471093958a457d9307a0c213d7ba461177 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.495144    1534 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.key ...

	I0524 11:36:29.495147    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.key: {Name:mk5b2a6f100829fa25412e4c96a6b4d9b186c9d1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.495264    1534 certs.go:204] generating proxyClientCA CA: /Users/jenkins/minikube-integration/16573-1024/.minikube/proxy-client-ca.key

	I0524 11:36:29.601357    1534 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/16573-1024/.minikube/proxy-client-ca.crt ...

	I0524 11:36:29.601364    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/proxy-client-ca.crt: {Name:mkc3f94501092c9c51cfa6d329a0a2c4cec184ab Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.601593    1534 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/16573-1024/.minikube/proxy-client-ca.key ...

	I0524 11:36:29.601596    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/proxy-client-ca.key: {Name:mk7acf18000a82a656fee32bbd454a3c129dabde Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.601733    1534 certs.go:319] generating minikube-user signed cert: /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/client.key

	I0524 11:36:29.601741    1534 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/client.crt with IP's: []

	I0524 11:36:29.653842    1534 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/client.crt ...

	I0524 11:36:29.653845    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/client.crt: {Name:mk3856cd37d1f07be2cc9902b19f9498b880112f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.654036    1534 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/client.key ...

	I0524 11:36:29.654040    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/client.key: {Name:mkbc8808085e1496dcb2b3e03156e443b7b7994b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.654176    1534 certs.go:319] generating minikube signed cert: /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.key.96055969

	I0524 11:36:29.654188    1534 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.crt.96055969 with IP's: [192.168.105.2 10.96.0.1 127.0.0.1 10.0.0.1]

	I0524 11:36:29.724674    1534 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.crt.96055969 ...

	I0524 11:36:29.724678    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.crt.96055969: {Name:mk424188d0f28cb0aa520452bb8ec4583a153ec6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.724815    1534 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.key.96055969 ...

	I0524 11:36:29.724818    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.key.96055969: {Name:mk98c3231c62717b32e2418cabd759d6ad5645ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.724926    1534 certs.go:337] copying /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.crt.96055969 -> /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.crt

	I0524 11:36:29.725147    1534 certs.go:341] copying /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.key.96055969 -> /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.key

	I0524 11:36:29.725241    1534 certs.go:319] generating aggregator signed cert: /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/proxy-client.key

	I0524 11:36:29.725256    1534 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/proxy-client.crt with IP's: []

	I0524 11:36:29.842949    1534 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/proxy-client.crt ...

	I0524 11:36:29.842953    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/proxy-client.crt: {Name:mk581c30062675e68aafc25cb79bfc8a62fd3e41 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.843105    1534 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/proxy-client.key ...

	I0524 11:36:29.843110    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/proxy-client.key: {Name:mk019f6bac347a368012a36cea939860ce210025 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.843389    1534 certs.go:437] found cert: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca-key.pem (1675 bytes)

	I0524 11:36:29.843593    1534 certs.go:437] found cert: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca.pem (1078 bytes)

	I0524 11:36:29.843619    1534 certs.go:437] found cert: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/cert.pem (1123 bytes)

	I0524 11:36:29.843756    1534 certs.go:437] found cert: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/key.pem (1675 bytes)

	I0524 11:36:29.844302    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I0524 11:36:29.851879    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0524 11:36:29.859249    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0524 11:36:29.866847    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I0524 11:36:29.873646    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0524 11:36:29.880415    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0524 11:36:29.887466    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0524 11:36:29.894575    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0524 11:36:29.901581    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0524 11:36:29.908027    1534 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0524 11:36:29.914140    1534 ssh_runner.go:195] Run: openssl version

	I0524 11:36:29.916182    1534 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0524 11:36:29.919659    1534 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0524 11:36:29.921372    1534 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 May 24 18:36 /usr/share/ca-certificates/minikubeCA.pem

	I0524 11:36:29.921394    1534 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0524 11:36:29.923349    1534 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0524 11:36:29.926902    1534 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd

	I0524 11:36:29.928503    1534 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory

	I0524 11:36:29.928540    1534 kubeadm.go:404] StartCluster: {Name:addons-514000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/16501/minikube-v1.30.1-1684536668-16501-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684536746-16501@sha256:f5d93abf1d1cfb142a7cf0b58b24029595d621e5f943105b16c61199094d77de Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v

1.27.2 ClusterName:addons-514000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.105.2 Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 Mount

Options:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}

	I0524 11:36:29.928599    1534 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0524 11:36:29.935998    1534 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0524 11:36:29.939589    1534 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0524 11:36:29.942818    1534 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0524 11:36:29.945835    1534 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0524 11:36:29.945853    1534 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.27.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"

	I0524 11:36:29.967889    1534 kubeadm.go:322] [init] Using Kubernetes version: v1.27.2

	I0524 11:36:29.967941    1534 kubeadm.go:322] [preflight] Running pre-flight checks

	I0524 11:36:30.020294    1534 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster

	I0524 11:36:30.020350    1534 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I0524 11:36:30.020400    1534 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	I0524 11:36:30.076237    1534 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I0524 11:36:30.084415    1534 out.go:204]   - Generating certificates and keys ...

	I0524 11:36:30.084460    1534 kubeadm.go:322] [certs] Using existing ca certificate authority

	I0524 11:36:30.084494    1534 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk

	I0524 11:36:30.272940    1534 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key

	I0524 11:36:30.453046    1534 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key

	I0524 11:36:30.580586    1534 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key

	I0524 11:36:30.639773    1534 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key

	I0524 11:36:30.738497    1534 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key

	I0524 11:36:30.738567    1534 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [addons-514000 localhost] and IPs [192.168.105.2 127.0.0.1 ::1]

	I0524 11:36:30.858811    1534 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key

	I0524 11:36:30.858875    1534 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [addons-514000 localhost] and IPs [192.168.105.2 127.0.0.1 ::1]

	I0524 11:36:30.935967    1534 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key

	I0524 11:36:30.967281    1534 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key

	I0524 11:36:31.073416    1534 kubeadm.go:322] [certs] Generating "sa" key and public key

	I0524 11:36:31.073445    1534 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I0524 11:36:31.335469    1534 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file

	I0524 11:36:31.530915    1534 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I0524 11:36:31.573436    1534 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I0524 11:36:31.637219    1534 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I0524 11:36:31.645102    1534 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I0524 11:36:31.645531    1534 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I0524 11:36:31.645571    1534 kubeadm.go:322] [kubelet-start] Starting the kubelet

	I0524 11:36:31.737201    1534 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I0524 11:36:31.741345    1534 out.go:204]   - Booting up control plane ...

	I0524 11:36:31.741390    1534 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I0524 11:36:31.741439    1534 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I0524 11:36:31.741469    1534 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I0524 11:36:31.741512    1534 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I0524 11:36:31.741595    1534 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	I0524 11:36:35.739695    1534 kubeadm.go:322] [apiclient] All control plane components are healthy after 4.002246 seconds

	I0524 11:36:35.739796    1534 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I0524 11:36:35.750536    1534 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I0524 11:36:36.270805    1534 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs

	I0524 11:36:36.271028    1534 kubeadm.go:322] [mark-control-plane] Marking the node addons-514000 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I0524 11:36:36.776691    1534 kubeadm.go:322] [bootstrap-token] Using token: zlw52u.ca0agirmjwjpmd4f

	I0524 11:36:36.783931    1534 out.go:204]   - Configuring RBAC rules ...

	I0524 11:36:36.784005    1534 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I0524 11:36:36.785227    1534 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I0524 11:36:36.791945    1534 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I0524 11:36:36.793322    1534 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I0524 11:36:36.794557    1534 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I0524 11:36:36.795891    1534 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I0524 11:36:36.802617    1534 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I0524 11:36:36.956552    1534 kubeadm.go:322] [addons] Applied essential addon: CoreDNS

	I0524 11:36:37.187637    1534 kubeadm.go:322] [addons] Applied essential addon: kube-proxy

	I0524 11:36:37.187937    1534 kubeadm.go:322] 

	I0524 11:36:37.187967    1534 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!

	I0524 11:36:37.187973    1534 kubeadm.go:322] 

	I0524 11:36:37.188044    1534 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:

	I0524 11:36:37.188053    1534 kubeadm.go:322] 

	I0524 11:36:37.188069    1534 kubeadm.go:322]   mkdir -p $HOME/.kube

	I0524 11:36:37.188099    1534 kubeadm.go:322]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I0524 11:36:37.188128    1534 kubeadm.go:322]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I0524 11:36:37.188133    1534 kubeadm.go:322] 

	I0524 11:36:37.188155    1534 kubeadm.go:322] Alternatively, if you are the root user, you can run:

	I0524 11:36:37.188158    1534 kubeadm.go:322] 

	I0524 11:36:37.188189    1534 kubeadm.go:322]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I0524 11:36:37.188193    1534 kubeadm.go:322] 

	I0524 11:36:37.188219    1534 kubeadm.go:322] You should now deploy a pod network to the cluster.

	I0524 11:36:37.188277    1534 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I0524 11:36:37.188314    1534 kubeadm.go:322]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I0524 11:36:37.188322    1534 kubeadm.go:322] 

	I0524 11:36:37.188361    1534 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities

	I0524 11:36:37.188399    1534 kubeadm.go:322] and service account keys on each node and then running the following as root:

	I0524 11:36:37.188411    1534 kubeadm.go:322] 

	I0524 11:36:37.188464    1534 kubeadm.go:322]   kubeadm join control-plane.minikube.internal:8443 --token zlw52u.ca0agirmjwjpmd4f \

	I0524 11:36:37.188516    1534 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:31e7298e5fe39dd9013d3c0dfbef354d505381f39a7a09e3b4af334242438797 \

	I0524 11:36:37.188534    1534 kubeadm.go:322] 	--control-plane 

	I0524 11:36:37.188538    1534 kubeadm.go:322] 

	I0524 11:36:37.188580    1534 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:

	I0524 11:36:37.188584    1534 kubeadm.go:322] 

	I0524 11:36:37.188629    1534 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token zlw52u.ca0agirmjwjpmd4f \

	I0524 11:36:37.188681    1534 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:31e7298e5fe39dd9013d3c0dfbef354d505381f39a7a09e3b4af334242438797 

	I0524 11:36:37.188736    1534 kubeadm.go:322] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I0524 11:36:37.188819    1534 kubeadm.go:322] W0524 18:36:30.200947    1295 images.go:80] could not find officially supported version of etcd for Kubernetes v1.27.2, falling back to the nearest etcd version (3.5.7-0)

	I0524 11:36:37.188904    1534 kubeadm.go:322] W0524 18:36:31.916526    1295 images.go:80] could not find officially supported version of etcd for Kubernetes v1.27.2, falling back to the nearest etcd version (3.5.7-0)

	I0524 11:36:37.188909    1534 cni.go:84] Creating CNI manager for ""

	I0524 11:36:37.188916    1534 cni.go:157] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0524 11:36:37.195686    1534 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...

	I0524 11:36:37.199715    1534 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d

	I0524 11:36:37.203087    1534 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)

	I0524 11:36:37.208259    1534 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0524 11:36:37.208303    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:37.208333    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl label nodes minikube.k8s.io/version=v1.30.1 minikube.k8s.io/commit=d23ad66c17ded3bf1d7d6fb0fa0ee29881f9547e minikube.k8s.io/name=addons-514000 minikube.k8s.io/updated_at=2023_05_24T11_36_37_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:37.258566    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:37.271047    1534 ops.go:34] apiserver oom_adj: -16

	I0524 11:36:37.796169    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:38.296162    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:38.796257    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:39.295049    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:39.796244    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:40.296250    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:40.796162    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:41.296458    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:41.796245    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:42.296250    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:42.796323    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:43.296423    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:43.796432    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:44.296246    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:44.796149    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:45.296189    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:45.796183    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:46.296206    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:46.796370    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:47.296192    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:47.796245    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:48.296219    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:48.796135    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:49.296201    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:49.796192    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:50.296070    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:50.332878    1534 kubeadm.go:1076] duration metric: took 13.124695208s to wait for elevateKubeSystemPrivileges.

	I0524 11:36:50.332892    1534 kubeadm.go:406] StartCluster complete in 20.404490625s

	I0524 11:36:50.332916    1534 settings.go:142] acquiring lock: {Name:mke0e8586c5ffdfb76a30452ad9385e81e1593cb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:50.333079    1534 settings.go:150] Updating kubeconfig:  /Users/jenkins/minikube-integration/16573-1024/kubeconfig

	I0524 11:36:50.333301    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/kubeconfig: {Name:mkd6a5851332ae81ab607caaee690ec1266dd411 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:50.333499    1534 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.27.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0524 11:36:50.333541    1534 addons.go:496] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:true]

	I0524 11:36:50.333603    1534 addons.go:66] Setting ingress=true in profile "addons-514000"

	I0524 11:36:50.333609    1534 addons.go:66] Setting registry=true in profile "addons-514000"

	I0524 11:36:50.333611    1534 addons.go:228] Setting addon ingress=true in "addons-514000"

	I0524 11:36:50.333614    1534 addons.go:228] Setting addon registry=true in "addons-514000"

	I0524 11:36:50.333650    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.333646    1534 addons.go:66] Setting csi-hostpath-driver=true in profile "addons-514000"

	I0524 11:36:50.333656    1534 addons.go:66] Setting storage-provisioner=true in profile "addons-514000"

	I0524 11:36:50.333660    1534 addons.go:228] Setting addon storage-provisioner=true in "addons-514000"

	I0524 11:36:50.333671    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.333804    1534 addons.go:66] Setting metrics-server=true in profile "addons-514000"

	I0524 11:36:50.333879    1534 addons.go:228] Setting addon metrics-server=true in "addons-514000"

	I0524 11:36:50.333906    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.333926    1534 addons.go:228] Setting addon csi-hostpath-driver=true in "addons-514000"

	I0524 11:36:50.333947    1534 config.go:182] Loaded profile config "addons-514000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.27.2

	I0524 11:36:50.333682    1534 addons.go:66] Setting ingress-dns=true in profile "addons-514000"

	I0524 11:36:50.333976    1534 addons.go:228] Setting addon ingress-dns=true in "addons-514000"

	I0524 11:36:50.333995    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.334035    1534 addons.go:66] Setting gcp-auth=true in profile "addons-514000"

	I0524 11:36:50.333605    1534 addons.go:66] Setting volumesnapshots=true in profile "addons-514000"

	I0524 11:36:50.334092    1534 addons.go:228] Setting addon volumesnapshots=true in "addons-514000"

	I0524 11:36:50.334116    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.334159    1534 addons.go:66] Setting default-storageclass=true in profile "addons-514000"

	I0524 11:36:50.334172    1534 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-514000"

	I0524 11:36:50.333653    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.334095    1534 mustload.go:65] Loading cluster: addons-514000

	I0524 11:36:50.334706    1534 addons.go:66] Setting inspektor-gadget=true in profile "addons-514000"

	I0524 11:36:50.334713    1534 addons.go:228] Setting addon inspektor-gadget=true in "addons-514000"

	I0524 11:36:50.333694    1534 addons.go:66] Setting cloud-spanner=true in profile "addons-514000"

	I0524 11:36:50.334861    1534 addons.go:228] Setting addon cloud-spanner=true in "addons-514000"

	I0524 11:36:50.334877    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.334897    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.334942    1534 host.go:66] Checking if "addons-514000" exists ...

	W0524 11:36:50.335292    1534 host.go:54] host status for "addons-514000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor: connect: connection refused

	W0524 11:36:50.335303    1534 addons.go:274] "addons-514000" is not running, setting metrics-server=true and skipping enablement (err=<nil>)

	I0524 11:36:50.335306    1534 addons.go:464] Verifying addon metrics-server=true in "addons-514000"

	W0524 11:36:50.335329    1534 host.go:54] host status for "addons-514000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor: connect: connection refused

	W0524 11:36:50.335333    1534 addons.go:274] "addons-514000" is not running, setting ingress-dns=true and skipping enablement (err=<nil>)

	W0524 11:36:50.335353    1534 host.go:54] host status for "addons-514000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor: connect: connection refused

	W0524 11:36:50.335359    1534 addons.go:274] "addons-514000" is not running, setting registry=true and skipping enablement (err=<nil>)

	I0524 11:36:50.335362    1534 addons.go:464] Verifying addon registry=true in "addons-514000"

	W0524 11:36:50.335391    1534 host.go:54] host status for "addons-514000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor: connect: connection refused

	I0524 11:36:50.339535    1534 out.go:177] * Verifying registry addon...

	W0524 11:36:50.335411    1534 addons.go:274] "addons-514000" is not running, setting ingress=true and skipping enablement (err=<nil>)

	W0524 11:36:50.335412    1534 host.go:54] host status for "addons-514000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor: connect: connection refused

	W0524 11:36:50.335520    1534 host.go:54] host status for "addons-514000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor: connect: connection refused

	W0524 11:36:50.335588    1534 host.go:54] host status for "addons-514000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor: connect: connection refused

	I0524 11:36:50.335599    1534 config.go:182] Loaded profile config "addons-514000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.27.2

	W0524 11:36:50.335650    1534 host.go:54] host status for "addons-514000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor: connect: connection refused

	W0524 11:36:50.349556    1534 addons.go:274] "addons-514000" is not running, setting csi-hostpath-driver=true and skipping enablement (err=<nil>)

	W0524 11:36:50.349673    1534 addons.go:274] "addons-514000" is not running, setting cloud-spanner=true and skipping enablement (err=<nil>)

	I0524 11:36:50.349673    1534 addons.go:464] Verifying addon ingress=true in "addons-514000"

	W0524 11:36:50.349688    1534 addons_storage_classes.go:55] "addons-514000" is not running, writing default-storageclass=true to disk and skipping enablement

	W0524 11:36:50.349678    1534 addons.go:274] "addons-514000" is not running, setting inspektor-gadget=true and skipping enablement (err=<nil>)

	I0524 11:36:50.350008    1534 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...

	I0524 11:36:50.350257    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.353441    1534 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0524 11:36:50.357663    1534 addons.go:228] Setting addon default-storageclass=true in "addons-514000"

	I0524 11:36:50.360618    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.360641    1534 addons.go:420] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0524 11:36:50.360646    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0524 11:36:50.360653    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:50.365539    1534 out.go:177] * Verifying ingress addon...

	I0524 11:36:50.357776    1534 out.go:177]   - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0

	I0524 11:36:50.357776    1534 addons.go:464] Verifying addon csi-hostpath-driver=true in "addons-514000"

	I0524 11:36:50.361446    1534 addons.go:420] installing /etc/kubernetes/addons/storageclass.yaml

	I0524 11:36:50.364279    1534 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=registry

	I0524 11:36:50.381598    1534 out.go:177] * Verifying csi-hostpath-driver addon...

	I0524 11:36:50.369698    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0524 11:36:50.369727    1534 addons.go:420] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml

	I0524 11:36:50.375900    1534 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...

	I0524 11:36:50.387638    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)

	I0524 11:36:50.387638    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:50.387646    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:50.388147    1534 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...

	I0524 11:36:50.390627    1534 kapi.go:86] Found 0 Pods for label selector app.kubernetes.io/name=ingress-nginx

	I0524 11:36:50.391169    1534 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver

	I0524 11:36:50.400375    1534 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.27.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.105.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.27.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0524 11:36:50.433263    1534 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0524 11:36:50.499595    1534 addons.go:420] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml

	I0524 11:36:50.499607    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)

	I0524 11:36:50.511369    1534 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0524 11:36:50.545082    1534 addons.go:420] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml

	I0524 11:36:50.545093    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)

	I0524 11:36:50.571075    1534 addons.go:420] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml

	I0524 11:36:50.571085    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)

	I0524 11:36:50.614490    1534 addons.go:420] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml

	I0524 11:36:50.614502    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)

	I0524 11:36:50.628252    1534 addons.go:420] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0524 11:36:50.628261    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)

	I0524 11:36:50.647925    1534 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0524 11:36:50.858973    1534 kapi.go:248] "coredns" deployment in "kube-system" namespace and "addons-514000" context rescaled to 1 replicas

	I0524 11:36:50.859000    1534 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.105.2 Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0524 11:36:50.862644    1534 out.go:177] * Verifying Kubernetes components...

	I0524 11:36:50.870714    1534 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0524 11:36:51.015230    1534 start.go:916] {"host.minikube.internal": 192.168.105.1} host record injected into CoreDNS's ConfigMap

	W0524 11:36:51.239743    1534 addons.go:446] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I0524 11:36:51.239769    1534 retry.go:31] will retry after 300.967986ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I0524 11:36:51.240163    1534 node_ready.go:35] waiting up to 6m0s for node "addons-514000" to be "Ready" ...

	I0524 11:36:51.242031    1534 node_ready.go:49] node "addons-514000" has status "Ready":"True"

	I0524 11:36:51.242040    1534 node_ready.go:38] duration metric: took 1.869375ms waiting for node "addons-514000" to be "Ready" ...

	I0524 11:36:51.242043    1534 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0524 11:36:51.247820    1534 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5d78c9869d-dmkfx" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:51.542933    1534 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.2/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0524 11:36:53.257970    1534 pod_ready.go:92] pod "coredns-5d78c9869d-dmkfx" in "kube-system" namespace has status "Ready":"True"

	I0524 11:36:53.257986    1534 pod_ready.go:81] duration metric: took 2.01016425s waiting for pod "coredns-5d78c9869d-dmkfx" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.257991    1534 pod_ready.go:78] waiting up to 6m0s for pod "etcd-addons-514000" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.260855    1534 pod_ready.go:92] pod "etcd-addons-514000" in "kube-system" namespace has status "Ready":"True"

	I0524 11:36:53.260862    1534 pod_ready.go:81] duration metric: took 2.866833ms waiting for pod "etcd-addons-514000" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.260867    1534 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-addons-514000" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.263593    1534 pod_ready.go:92] pod "kube-apiserver-addons-514000" in "kube-system" namespace has status "Ready":"True"

	I0524 11:36:53.263598    1534 pod_ready.go:81] duration metric: took 2.728ms waiting for pod "kube-apiserver-addons-514000" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.263603    1534 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-addons-514000" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.266314    1534 pod_ready.go:92] pod "kube-controller-manager-addons-514000" in "kube-system" namespace has status "Ready":"True"

	I0524 11:36:53.266322    1534 pod_ready.go:81] duration metric: took 2.716417ms waiting for pod "kube-controller-manager-addons-514000" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.266326    1534 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-2gj6m" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.268820    1534 pod_ready.go:92] pod "kube-proxy-2gj6m" in "kube-system" namespace has status "Ready":"True"

	I0524 11:36:53.268826    1534 pod_ready.go:81] duration metric: took 2.496209ms waiting for pod "kube-proxy-2gj6m" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.268830    1534 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-addons-514000" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.659694    1534 pod_ready.go:92] pod "kube-scheduler-addons-514000" in "kube-system" namespace has status "Ready":"True"

	I0524 11:36:53.659709    1534 pod_ready.go:81] duration metric: took 390.87725ms waiting for pod "kube-scheduler-addons-514000" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.659719    1534 pod_ready.go:38] duration metric: took 2.417685875s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0524 11:36:53.659737    1534 api_server.go:52] waiting for apiserver process to appear ...

	I0524 11:36:53.659818    1534 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0524 11:36:54.012047    1534 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.2/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (2.469105375s)

	I0524 11:36:54.012061    1534 api_server.go:72] duration metric: took 3.153054583s to wait for apiserver process to appear ...

	I0524 11:36:54.012066    1534 api_server.go:88] waiting for apiserver healthz status ...

	I0524 11:36:54.012074    1534 api_server.go:253] Checking apiserver healthz at https://192.168.105.2:8443/healthz ...

	I0524 11:36:54.015086    1534 api_server.go:279] https://192.168.105.2:8443/healthz returned 200:

	ok

	I0524 11:36:54.015747    1534 api_server.go:141] control plane version: v1.27.2

	I0524 11:36:54.015755    1534 api_server.go:131] duration metric: took 3.685917ms to wait for apiserver health ...

	I0524 11:36:54.015758    1534 system_pods.go:43] waiting for kube-system pods to appear ...

	I0524 11:36:54.018844    1534 system_pods.go:59] 9 kube-system pods found

	I0524 11:36:54.018857    1534 system_pods.go:61] "coredns-5d78c9869d-dmkfx" [03f7079a-733f-488e-a6b1-65e0ca65cffe] Running

	I0524 11:36:54.018861    1534 system_pods.go:61] "etcd-addons-514000" [f53490df-9f65-472d-8c24-fedfb5ff0b40] Running

	I0524 11:36:54.018863    1534 system_pods.go:61] "kube-apiserver-addons-514000" [39ad1080-0c49-4108-8f04-7aded262c978] Running

	I0524 11:36:54.018865    1534 system_pods.go:61] "kube-controller-manager-addons-514000" [8aed5f2f-4439-495f-9454-34920caed37f] Running

	I0524 11:36:54.018868    1534 system_pods.go:61] "kube-proxy-2gj6m" [8d0787ef-32df-4a09-ad1d-48a69a40bb43] Running

	I0524 11:36:54.018870    1534 system_pods.go:61] "kube-scheduler-addons-514000" [98ce7db6-4f70-4fb1-992f-7cf2bf68fb43] Running

	I0524 11:36:54.018873    1534 system_pods.go:61] "snapshot-controller-75bbb956b9-j5jhp" [953964d7-20b0-4fa4-b1ca-f05e6adb94e3] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0524 11:36:54.018876    1534 system_pods.go:61] "snapshot-controller-75bbb956b9-txrxl" [07fe4bd3-7311-4ec4-938d-a195ed8535a8] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0524 11:36:54.018879    1534 system_pods.go:61] "storage-provisioner" [49765353-a5e1-4781-ab06-a554a575daa5] Running

	I0524 11:36:54.018881    1534 system_pods.go:74] duration metric: took 3.121167ms to wait for pod list to return data ...

	I0524 11:36:54.018883    1534 default_sa.go:34] waiting for default service account to be created ...

	I0524 11:36:54.057892    1534 default_sa.go:45] found service account: "default"

	I0524 11:36:54.057899    1534 default_sa.go:55] duration metric: took 39.013541ms for default service account to be created ...

	I0524 11:36:54.057902    1534 system_pods.go:116] waiting for k8s-apps to be running ...

	I0524 11:36:54.259995    1534 system_pods.go:86] 9 kube-system pods found

	I0524 11:36:54.260005    1534 system_pods.go:89] "coredns-5d78c9869d-dmkfx" [03f7079a-733f-488e-a6b1-65e0ca65cffe] Running

	I0524 11:36:54.260008    1534 system_pods.go:89] "etcd-addons-514000" [f53490df-9f65-472d-8c24-fedfb5ff0b40] Running

	I0524 11:36:54.260011    1534 system_pods.go:89] "kube-apiserver-addons-514000" [39ad1080-0c49-4108-8f04-7aded262c978] Running

	I0524 11:36:54.260014    1534 system_pods.go:89] "kube-controller-manager-addons-514000" [8aed5f2f-4439-495f-9454-34920caed37f] Running

	I0524 11:36:54.260016    1534 system_pods.go:89] "kube-proxy-2gj6m" [8d0787ef-32df-4a09-ad1d-48a69a40bb43] Running

	I0524 11:36:54.260019    1534 system_pods.go:89] "kube-scheduler-addons-514000" [98ce7db6-4f70-4fb1-992f-7cf2bf68fb43] Running

	I0524 11:36:54.260023    1534 system_pods.go:89] "snapshot-controller-75bbb956b9-j5jhp" [953964d7-20b0-4fa4-b1ca-f05e6adb94e3] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0524 11:36:54.260027    1534 system_pods.go:89] "snapshot-controller-75bbb956b9-txrxl" [07fe4bd3-7311-4ec4-938d-a195ed8535a8] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0524 11:36:54.260030    1534 system_pods.go:89] "storage-provisioner" [49765353-a5e1-4781-ab06-a554a575daa5] Running

	I0524 11:36:54.260033    1534 system_pods.go:126] duration metric: took 202.129584ms to wait for k8s-apps to be running ...

	I0524 11:36:54.260037    1534 system_svc.go:44] waiting for kubelet service to be running ....

	I0524 11:36:54.260088    1534 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0524 11:36:54.265390    1534 system_svc.go:56] duration metric: took 5.350666ms WaitForService to wait for kubelet.

	I0524 11:36:54.265399    1534 kubeadm.go:581] duration metric: took 3.406395625s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...

	I0524 11:36:54.265408    1534 node_conditions.go:102] verifying NodePressure condition ...

	I0524 11:36:54.458086    1534 node_conditions.go:122] node storage ephemeral capacity is 17784760Ki

	I0524 11:36:54.458097    1534 node_conditions.go:123] node cpu capacity is 2

	I0524 11:36:54.458103    1534 node_conditions.go:105] duration metric: took 192.694167ms to run NodePressure ...

	I0524 11:36:54.458107    1534 start.go:228] waiting for startup goroutines ...

	I0524 11:36:56.972492    1534 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)

	I0524 11:36:56.972559    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:57.029376    1534 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)

	I0524 11:36:57.038824    1534 addons.go:228] Setting addon gcp-auth=true in "addons-514000"

	I0524 11:36:57.038864    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:57.040182    1534 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json

	I0524 11:36:57.040196    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:57.078053    1534 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20230312-helm-chart-4.5.2-28-g66a760794

	I0524 11:36:57.082115    1534 out.go:177]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.0

	I0524 11:36:57.085015    1534 addons.go:420] installing /etc/kubernetes/addons/gcp-auth-ns.yaml

	I0524 11:36:57.085022    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)

	I0524 11:36:57.091862    1534 addons.go:420] installing /etc/kubernetes/addons/gcp-auth-service.yaml

	I0524 11:36:57.091873    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)

	I0524 11:36:57.099462    1534 addons.go:420] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I0524 11:36:57.099472    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5474 bytes)

	I0524 11:36:57.106631    1534 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.2/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I0524 11:36:57.550488    1534 addons.go:464] Verifying addon gcp-auth=true in "addons-514000"

	I0524 11:36:57.555392    1534 out.go:177] * Verifying gcp-auth addon...

	I0524 11:36:57.561721    1534 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...

	I0524 11:36:57.566760    1534 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth

	I0524 11:36:57.566769    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:36:58.070711    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:36:58.570942    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:36:59.076515    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:36:59.570540    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:00.070962    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:00.571104    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:01.071573    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:01.571018    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:02.072518    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:02.570869    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:03.071445    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:03.570661    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:04.070807    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:04.570832    1534 kapi.go:107] duration metric: took 7.009157292s to wait for kubernetes.io/minikube-addons=gcp-auth ...

	I0524 11:37:04.574809    1534 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-514000 cluster.

	I0524 11:37:04.579620    1534 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.

	I0524 11:37:04.583658    1534 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.

	I0524 11:42:50.357445    1534 kapi.go:107] duration metric: took 6m0.009773291s to wait for kubernetes.io/minikube-addons=registry ...

	W0524 11:42:50.357907    1534 out.go:239] ! Enabling 'registry' returned an error: running callbacks: [waiting for kubernetes.io/minikube-addons=registry pods: context deadline exceeded]

	I0524 11:42:50.387243    1534 kapi.go:107] duration metric: took 6m0.001495875s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...

	I0524 11:42:50.387315    1534 kapi.go:107] duration metric: took 6m0.013814333s to wait for app.kubernetes.io/name=ingress-nginx ...

	W0524 11:42:50.387474    1534 out.go:239] ! Enabling 'csi-hostpath-driver' returned an error: running callbacks: [waiting for kubernetes.io/minikube-addons=csi-hostpath-driver pods: context deadline exceeded]

	W0524 11:42:50.387474    1534 out.go:239] ! Enabling 'ingress' returned an error: running callbacks: [waiting for app.kubernetes.io/name=ingress-nginx pods: context deadline exceeded]

	I0524 11:42:50.395532    1534 out.go:177] * Enabled addons: metrics-server, ingress-dns, inspektor-gadget, cloud-spanner, storage-provisioner, default-storageclass, volumesnapshots, gcp-auth

	I0524 11:42:50.403494    1534 addons.go:499] enable addons completed in 6m0.072361709s: enabled=[metrics-server ingress-dns inspektor-gadget cloud-spanner storage-provisioner default-storageclass volumesnapshots gcp-auth]

	I0524 11:42:50.403556    1534 start.go:233] waiting for cluster config update ...

	I0524 11:42:50.403587    1534 start.go:242] writing updated cluster config ...

	I0524 11:42:50.408325    1534 ssh_runner.go:195] Run: rm -f paused

	I0524 11:42:50.568016    1534 start.go:568] kubectl: 1.25.9, cluster: 1.27.2 (minor skew: 2)

	I0524 11:42:50.572568    1534 out.go:177] 

	W0524 11:42:50.576443    1534 out.go:239] ! /usr/local/bin/kubectl is version 1.25.9, which may have incompatibilities with Kubernetes 1.27.2.

	I0524 11:42:50.580476    1534 out.go:177]   - Want kubectl v1.27.2? Try 'minikube kubectl -- get pods -A'

	I0524 11:42:50.587567    1534 out.go:177] * Done! kubectl is now configured to use "addons-514000" cluster and "default" namespace by default

	* 

	* ==> Docker <==

	* -- Journal begins at Wed 2023-05-24 18:36:19 UTC, ends at Wed 2023-05-24 19:06:51 UTC. --

	May 24 18:37:01 addons-514000 dockerd[916]: time="2023-05-24T18:37:01.953788187Z" level=warning msg="reference for unknown type: " digest="sha256:d730651bb6584f969d95d8279a754cf9d8d31b5055c43dbdb8d7363a8c6371cf" remote="gcr.io/k8s-minikube/gcp-auth-webhook@sha256:d730651bb6584f969d95d8279a754cf9d8d31b5055c43dbdb8d7363a8c6371cf"

	May 24 18:37:02 addons-514000 dockerd[922]: time="2023-05-24T18:37:02.557702813Z" level=info msg="shim disconnected" id=953c17ffdc8ac0b98e66b9d8887f99c9b0a49236e6fd43f2647edb75c5e82150 namespace=moby

	May 24 18:37:02 addons-514000 dockerd[922]: time="2023-05-24T18:37:02.557754555Z" level=warning msg="cleaning up after shim disconnected" id=953c17ffdc8ac0b98e66b9d8887f99c9b0a49236e6fd43f2647edb75c5e82150 namespace=moby

	May 24 18:37:02 addons-514000 dockerd[922]: time="2023-05-24T18:37:02.557759977Z" level=info msg="cleaning up dead shim" namespace=moby

	May 24 18:37:02 addons-514000 dockerd[916]: time="2023-05-24T18:37:02.558086156Z" level=info msg="ignoring event" container=953c17ffdc8ac0b98e66b9d8887f99c9b0a49236e6fd43f2647edb75c5e82150 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 24 18:37:03 addons-514000 dockerd[916]: time="2023-05-24T18:37:03.602683250Z" level=info msg="ignoring event" container=7c145b5b88ef04d8237d20d8374f3a2c4283c8c7c120b4d01e6d9eda3df3496d module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 24 18:37:03 addons-514000 dockerd[922]: time="2023-05-24T18:37:03.603089611Z" level=info msg="shim disconnected" id=7c145b5b88ef04d8237d20d8374f3a2c4283c8c7c120b4d01e6d9eda3df3496d namespace=moby

	May 24 18:37:03 addons-514000 dockerd[922]: time="2023-05-24T18:37:03.603147527Z" level=warning msg="cleaning up after shim disconnected" id=7c145b5b88ef04d8237d20d8374f3a2c4283c8c7c120b4d01e6d9eda3df3496d namespace=moby

	May 24 18:37:03 addons-514000 dockerd[922]: time="2023-05-24T18:37:03.603154445Z" level=info msg="cleaning up dead shim" namespace=moby

	May 24 18:37:03 addons-514000 cri-dockerd[1138]: time="2023-05-24T18:37:03Z" level=info msg="Stop pulling image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.0@sha256:d730651bb6584f969d95d8279a754cf9d8d31b5055c43dbdb8d7363a8c6371cf: Status: Downloaded newer image for gcr.io/k8s-minikube/gcp-auth-webhook@sha256:d730651bb6584f969d95d8279a754cf9d8d31b5055c43dbdb8d7363a8c6371cf"

	May 24 18:37:03 addons-514000 dockerd[922]: time="2023-05-24T18:37:03.856707697Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	May 24 18:37:03 addons-514000 dockerd[922]: time="2023-05-24T18:37:03.856808407Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	May 24 18:37:03 addons-514000 dockerd[922]: time="2023-05-24T18:37:03.856985177Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	May 24 18:37:03 addons-514000 dockerd[922]: time="2023-05-24T18:37:03.856997233Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	May 24 19:04:45 addons-514000 dockerd[922]: time="2023-05-24T19:04:45.202234365Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	May 24 19:04:45 addons-514000 dockerd[922]: time="2023-05-24T19:04:45.202265406Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	May 24 19:04:45 addons-514000 dockerd[922]: time="2023-05-24T19:04:45.202273323Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	May 24 19:04:45 addons-514000 dockerd[922]: time="2023-05-24T19:04:45.202278489Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	May 24 19:04:45 addons-514000 cri-dockerd[1138]: time="2023-05-24T19:04:45Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/324faf77934c8dd14cc1dcdd99d834dde8eed7155b1727c2ec6265fcc5463aac/resolv.conf as [nameserver 10.96.0.10 search headlamp.svc.cluster.local svc.cluster.local cluster.local options ndots:5]"

	May 24 19:04:45 addons-514000 dockerd[916]: time="2023-05-24T19:04:45.605001003Z" level=warning msg="reference for unknown type: " digest="sha256:9c33d03e6032adc2ae0920bbda10f82aa223d796f99cfb9509608cd389a157be" remote="ghcr.io/headlamp-k8s/headlamp@sha256:9c33d03e6032adc2ae0920bbda10f82aa223d796f99cfb9509608cd389a157be"

	May 24 19:04:49 addons-514000 cri-dockerd[1138]: time="2023-05-24T19:04:49Z" level=info msg="Stop pulling image ghcr.io/headlamp-k8s/headlamp:v0.17.1@sha256:9c33d03e6032adc2ae0920bbda10f82aa223d796f99cfb9509608cd389a157be: Status: Downloaded newer image for ghcr.io/headlamp-k8s/headlamp@sha256:9c33d03e6032adc2ae0920bbda10f82aa223d796f99cfb9509608cd389a157be"

	May 24 19:04:49 addons-514000 dockerd[922]: time="2023-05-24T19:04:49.985023040Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	May 24 19:04:49 addons-514000 dockerd[922]: time="2023-05-24T19:04:49.985362786Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	May 24 19:04:49 addons-514000 dockerd[922]: time="2023-05-24T19:04:49.985376786Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	May 24 19:04:49 addons-514000 dockerd[922]: time="2023-05-24T19:04:49.985381869Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	* 

	* ==> container status <==

	* CONTAINER           IMAGE                                                                                                                     CREATED             STATE               NAME                         ATTEMPT             POD ID

	372016bac2d66       ghcr.io/headlamp-k8s/headlamp@sha256:9c33d03e6032adc2ae0920bbda10f82aa223d796f99cfb9509608cd389a157be                     2 minutes ago       Running             headlamp                     0                   324faf77934c8

	d1ad6d2cd7d4d       gcr.io/k8s-minikube/gcp-auth-webhook@sha256:d730651bb6584f969d95d8279a754cf9d8d31b5055c43dbdb8d7363a8c6371cf              29 minutes ago      Running             gcp-auth                     0                   f47df037d9956

	2623eeac77855       registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280   29 minutes ago      Running             volume-snapshot-controller   0                   60ea5019d1f26

	61fdb94dca547       registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280   29 minutes ago      Running             volume-snapshot-controller   0                   1f82f1afb5ca6

	5e708965dbb0a       97e04611ad434                                                                                                             29 minutes ago      Running             coredns                      0                   eaf04536825bb

	c6d1bdca910b8       ba04bb24b9575                                                                                                             29 minutes ago      Running             storage-provisioner          0                   55be207be2898

	bf84d832ec967       29921a0845422                                                                                                             30 minutes ago      Running             kube-proxy                   0                   59d50204b0754

	046435c695b1e       305d7ed1dae28                                                                                                             30 minutes ago      Running             kube-scheduler               0                   cd9a002bb369c

	aa80b21f85087       2ee705380c3c5                                                                                                             30 minutes ago      Running             kube-controller-manager      0                   0ebf3f27cb768

	d5556d8565d49       24bc64e911039                                                                                                             30 minutes ago      Running             etcd                         0                   37fcc92ec98a7

	a485542b186e4       72c9df6be7f1b                                                                                                             30 minutes ago      Running             kube-apiserver               0                   383872bb10f81

	* 

	* ==> coredns [5e708965dbb0] <==

	* .:53

	[INFO] plugin/reload: Running configuration SHA512 = ea7a0d73d9d208f758b1f67640ef03c58089b9d9366cf3478df3bb369b210e39f213811b46224f8a04380814b6e0890ccd358f5b5e8c80bc22ac19c8601ee35b

	CoreDNS-1.10.1

	linux/arm64, go1.20, 055b2c3

	[INFO] 127.0.0.1:59819 - 54023 "HINFO IN 5089267470380203033.66065138292483152. udp 55 false 512" NXDOMAIN qr,rd,ra 130 0.424436073s

	[INFO] 10.244.0.7:57634 - 60032 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000112931s

	[INFO] 10.244.0.7:36916 - 20311 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000078547s

	[INFO] 10.244.0.7:53888 - 30613 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000056548s

	[INFO] 10.244.0.7:40805 - 41575 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000031112s

	[INFO] 10.244.0.7:39418 - 54110 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000031567s

	[INFO] 10.244.0.7:45485 - 20279 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000113676s

	[INFO] 10.244.0.7:49511 - 45953 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 534 0.000780781s

	[INFO] 10.244.0.7:49660 - 37020 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.00090552s

	* 

	* ==> describe nodes <==

	* Name:               addons-514000

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=arm64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=arm64

	                    kubernetes.io/hostname=addons-514000

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=d23ad66c17ded3bf1d7d6fb0fa0ee29881f9547e

	                    minikube.k8s.io/name=addons-514000

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2023_05_24T11_36_37_0700

	                    minikube.k8s.io/version=v1.30.1

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Wed, 24 May 2023 18:36:34 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  addons-514000

	  AcquireTime:     <unset>

	  RenewTime:       Wed, 24 May 2023 19:06:45 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Wed, 24 May 2023 19:05:14 +0000   Wed, 24 May 2023 18:36:33 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Wed, 24 May 2023 19:05:14 +0000   Wed, 24 May 2023 18:36:33 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Wed, 24 May 2023 19:05:14 +0000   Wed, 24 May 2023 18:36:33 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Wed, 24 May 2023 19:05:14 +0000   Wed, 24 May 2023 18:36:39 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.105.2

	  Hostname:    addons-514000

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17784760Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3905972Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17784760Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3905972Ki

	  pods:               110

	System Info:

	  Machine ID:                 cc66183cd0c646be999944d821185b81

	  System UUID:                cc66183cd0c646be999944d821185b81

	  Boot ID:                    2cd753bf-40ed-44ce-928e-d8bb002a6012

	  Kernel Version:             5.10.57

	  OS Image:                   Buildroot 2021.02.12

	  Operating System:           linux

	  Architecture:               arm64

	  Container Runtime Version:  docker://20.10.23

	  Kubelet Version:            v1.27.2

	  Kube-Proxy Version:         v1.27.2

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (11 in total)

	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---

	  gcp-auth                    gcp-auth-58478865f7-5429c                0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         29m

	  headlamp                    headlamp-6b5756787-kf2ww                 0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m7s

	  kube-system                 coredns-5d78c9869d-dmkfx                 100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (1%!)(MISSING)        170Mi (4%!)(MISSING)     30m

	  kube-system                 etcd-addons-514000                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (2%!)(MISSING)       0 (0%!)(MISSING)         30m

	  kube-system                 kube-apiserver-addons-514000             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         30m

	  kube-system                 kube-controller-manager-addons-514000    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         30m

	  kube-system                 kube-proxy-2gj6m                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         30m

	  kube-system                 kube-scheduler-addons-514000             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         30m

	  kube-system                 snapshot-controller-75bbb956b9-j5jhp     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         30m

	  kube-system                 snapshot-controller-75bbb956b9-txrxl     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         30m

	  kube-system                 storage-provisioner                      0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         30m

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%!)(MISSING)  0 (0%!)(MISSING)

	  memory             170Mi (4%!)(MISSING)  170Mi (4%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-32Mi     0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-64Ki     0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age   From             Message

	  ----    ------                   ----  ----             -------

	  Normal  Starting                 30m   kube-proxy       

	  Normal  Starting                 30m   kubelet          Starting kubelet.

	  Normal  NodeAllocatableEnforced  30m   kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  30m   kubelet          Node addons-514000 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    30m   kubelet          Node addons-514000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     30m   kubelet          Node addons-514000 status is now: NodeHasSufficientPID

	  Normal  NodeReady                30m   kubelet          Node addons-514000 status is now: NodeReady

	  Normal  RegisteredNode           30m   node-controller  Node addons-514000 event: Registered Node addons-514000 in Controller

	* 

	* ==> dmesg <==

	* [May24 18:36] ACPI: SRAT not present

	[  +0.000000] KASLR disabled due to lack of seed

	[  +0.727578] EINJ: EINJ table not found.

	[  +0.656332] systemd-fstab-generator[114]: Ignoring "noauto" for root device

	[  +0.043407] systemd[1]: systemd-journald.service: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.

	[  +0.000915] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)

	[  +3.905553] systemd-fstab-generator[471]: Ignoring "noauto" for root device

	[  +0.096232] systemd-fstab-generator[482]: Ignoring "noauto" for root device

	[  +2.874276] systemd-fstab-generator[684]: Ignoring "noauto" for root device

	[  +1.463827] systemd-fstab-generator[849]: Ignoring "noauto" for root device

	[  +0.166355] systemd-fstab-generator[885]: Ignoring "noauto" for root device

	[  +0.076432] systemd-fstab-generator[896]: Ignoring "noauto" for root device

	[  +0.091985] systemd-fstab-generator[909]: Ignoring "noauto" for root device

	[  +1.135416] kauditd_printk_skb: 53 callbacks suppressed

	[  +0.091978] systemd-fstab-generator[1057]: Ignoring "noauto" for root device

	[  +0.084182] systemd-fstab-generator[1068]: Ignoring "noauto" for root device

	[  +0.089221] systemd-fstab-generator[1079]: Ignoring "noauto" for root device

	[  +0.079548] systemd-fstab-generator[1090]: Ignoring "noauto" for root device

	[  +0.085105] systemd-fstab-generator[1131]: Ignoring "noauto" for root device

	[  +2.454751] systemd-fstab-generator[1385]: Ignoring "noauto" for root device

	[  +5.146027] systemd-fstab-generator[2260]: Ignoring "noauto" for root device

	[ +14.118818] kauditd_printk_skb: 41 callbacks suppressed

	[  +2.617169] TCP: eth0: Driver has suspect GRO implementation, TCP performance may be compromised.

	[  +3.922890] kauditd_printk_skb: 33 callbacks suppressed

	[May24 18:37] kauditd_printk_skb: 17 callbacks suppressed

	* 

	* ==> etcd [d5556d8565d4] <==

	* {"level":"info","ts":"2023-05-24T18:36:33.834Z","caller":"embed/serve.go:100","msg":"ready to serve client requests"}

	{"level":"info","ts":"2023-05-24T18:36:33.835Z","caller":"embed/serve.go:198","msg":"serving client traffic securely","address":"192.168.105.2:2379"}

	{"level":"info","ts":"2023-05-24T18:36:33.834Z","caller":"etcdserver/server.go:2571","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}

	{"level":"info","ts":"2023-05-24T18:36:33.835Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}

	{"level":"info","ts":"2023-05-24T18:36:33.835Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}

	{"level":"info","ts":"2023-05-24T18:36:33.834Z","caller":"embed/serve.go:100","msg":"ready to serve client requests"}

	{"level":"info","ts":"2023-05-24T18:36:33.838Z","caller":"embed/serve.go:198","msg":"serving client traffic securely","address":"127.0.0.1:2379"}

	{"level":"info","ts":"2023-05-24T18:36:33.838Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"6e03e7863b4f9c54","local-member-id":"c46d288d2fcb0590","cluster-version":"3.5"}

	{"level":"info","ts":"2023-05-24T18:36:33.838Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}

	{"level":"info","ts":"2023-05-24T18:36:33.838Z","caller":"etcdserver/server.go:2595","msg":"cluster version is updated","cluster-version":"3.5"}

	{"level":"info","ts":"2023-05-24T18:46:33.876Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":846}

	{"level":"info","ts":"2023-05-24T18:46:33.881Z","caller":"mvcc/kvstore_compaction.go:66","msg":"finished scheduled compaction","compact-revision":846,"took":"3.400485ms","hash":3638416343}

	{"level":"info","ts":"2023-05-24T18:46:33.882Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":3638416343,"revision":846,"compact-revision":-1}

	{"level":"info","ts":"2023-05-24T18:51:33.887Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1145}

	{"level":"info","ts":"2023-05-24T18:51:33.890Z","caller":"mvcc/kvstore_compaction.go:66","msg":"finished scheduled compaction","compact-revision":1145,"took":"2.024563ms","hash":894933936}

	{"level":"info","ts":"2023-05-24T18:51:33.890Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":894933936,"revision":1145,"compact-revision":846}

	{"level":"info","ts":"2023-05-24T18:56:33.899Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1444}

	{"level":"info","ts":"2023-05-24T18:56:33.902Z","caller":"mvcc/kvstore_compaction.go:66","msg":"finished scheduled compaction","compact-revision":1444,"took":"1.805765ms","hash":2332186912}

	{"level":"info","ts":"2023-05-24T18:56:33.902Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":2332186912,"revision":1444,"compact-revision":1145}

	{"level":"info","ts":"2023-05-24T19:01:33.910Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1744}

	{"level":"info","ts":"2023-05-24T19:01:33.913Z","caller":"mvcc/kvstore_compaction.go:66","msg":"finished scheduled compaction","compact-revision":1744,"took":"1.711146ms","hash":1851239145}

	{"level":"info","ts":"2023-05-24T19:01:33.913Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":1851239145,"revision":1744,"compact-revision":1444}

	{"level":"info","ts":"2023-05-24T19:06:33.919Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":2043}

	{"level":"info","ts":"2023-05-24T19:06:33.922Z","caller":"mvcc/kvstore_compaction.go:66","msg":"finished scheduled compaction","compact-revision":2043,"took":"1.631648ms","hash":614110781}

	{"level":"info","ts":"2023-05-24T19:06:33.922Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":614110781,"revision":2043,"compact-revision":1744}

	* 

	* ==> gcp-auth [d1ad6d2cd7d4] <==

	* 2023/05/24 18:37:03 GCP Auth Webhook started!

	2023/05/24 19:04:44 Ready to marshal response ...

	2023/05/24 19:04:44 Ready to write response ...

	2023/05/24 19:04:44 Ready to marshal response ...

	2023/05/24 19:04:44 Ready to write response ...

	2023/05/24 19:04:44 Ready to marshal response ...

	2023/05/24 19:04:44 Ready to write response ...

	* 

	* ==> kernel <==

	*  19:06:52 up 30 min,  0 users,  load average: 0.69, 0.56, 0.51

	Linux addons-514000 5.10.57 #1 SMP PREEMPT Sat May 20 00:35:14 UTC 2023 aarch64 GNU/Linux

	PRETTY_NAME="Buildroot 2021.02.12"

	* 

	* ==> kube-apiserver [a485542b186e] <==

	* I0524 18:46:34.559325       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 18:46:34.559355       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 18:51:34.542946       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 18:51:34.543557       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 18:51:34.550014       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 18:51:34.550133       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 18:51:34.556769       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 18:51:34.556848       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 18:56:34.536214       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 18:56:34.536373       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 18:56:34.548003       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 18:56:34.548106       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 19:01:34.537192       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 19:01:34.537290       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 19:01:34.537554       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 19:01:34.537601       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 19:01:34.538264       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 19:01:34.538305       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 19:04:44.806679       1 alloc.go:330] "allocated clusterIPs" service="headlamp/headlamp" clusterIPs=map[IPv4:10.102.182.222]

	I0524 19:06:34.546285       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 19:06:34.546419       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 19:06:34.553782       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 19:06:34.554165       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 19:06:34.557667       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 19:06:34.557813       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	* 

	* ==> kube-controller-manager [aa80b21f8508] <==

	* I0524 18:37:02.495937       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch

	I0524 18:37:02.582819       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-create

	I0524 18:37:03.506916       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-create

	I0524 18:37:03.513803       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch

	I0524 18:37:03.593747       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-create

	I0524 18:37:03.596306       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-create

	I0524 18:37:03.598360       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-create

	I0524 18:37:03.598521       1 event.go:307] "Event occurred" object="gcp-auth/gcp-auth-certs-create" fieldPath="" kind="Job" apiVersion="batch/v1" type="Normal" reason="Completed" message="Job completed"

	I0524 18:37:03.685792       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch

	I0524 18:37:04.524940       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch

	I0524 18:37:04.535090       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch

	I0524 18:37:04.540969       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch

	I0524 18:37:04.541239       1 event.go:307] "Event occurred" object="gcp-auth/gcp-auth-certs-patch" fieldPath="" kind="Job" apiVersion="batch/v1" type="Normal" reason="Completed" message="Job completed"

	I0524 18:37:04.555353       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch

	I0524 18:37:20.560907       1 resource_quota_monitor.go:223] "QuotaMonitor created object count evaluator" resource="volumesnapshots.snapshot.storage.k8s.io"

	I0524 18:37:20.561333       1 shared_informer.go:311] Waiting for caches to sync for resource quota

	I0524 18:37:20.662721       1 shared_informer.go:318] Caches are synced for resource quota

	I0524 18:37:20.895710       1 shared_informer.go:311] Waiting for caches to sync for garbage collector

	I0524 18:37:20.999329       1 shared_informer.go:318] Caches are synced for garbage collector

	I0524 18:37:33.024397       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-create

	I0524 18:37:33.041354       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-create

	I0524 18:37:34.012720       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch

	I0524 18:37:34.026381       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch

	I0524 19:04:44.816553       1 event.go:307] "Event occurred" object="headlamp/headlamp" fieldPath="" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set headlamp-6b5756787 to 1"

	I0524 19:04:44.834671       1 event.go:307] "Event occurred" object="headlamp/headlamp-6b5756787" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: headlamp-6b5756787-kf2ww"

	* 

	* ==> kube-proxy [bf84d832ec96] <==

	* I0524 18:36:51.096070       1 node.go:141] Successfully retrieved node IP: 192.168.105.2

	I0524 18:36:51.096254       1 server_others.go:110] "Detected node IP" address="192.168.105.2"

	I0524 18:36:51.096305       1 server_others.go:551] "Using iptables proxy"

	I0524 18:36:51.129985       1 server_others.go:176] "kube-proxy running in single-stack mode: secondary ipFamily is not supported" ipFamily=IPv6

	I0524 18:36:51.130045       1 server_others.go:190] "Using iptables Proxier"

	I0524 18:36:51.130091       1 proxier.go:253] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"

	I0524 18:36:51.130875       1 server.go:657] "Version info" version="v1.27.2"

	I0524 18:36:51.130883       1 server.go:659] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0524 18:36:51.134580       1 config.go:188] "Starting service config controller"

	I0524 18:36:51.134608       1 shared_informer.go:311] Waiting for caches to sync for service config

	I0524 18:36:51.134627       1 config.go:97] "Starting endpoint slice config controller"

	I0524 18:36:51.134630       1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config

	I0524 18:36:51.134949       1 config.go:315] "Starting node config controller"

	I0524 18:36:51.134952       1 shared_informer.go:311] Waiting for caches to sync for node config

	I0524 18:36:51.240491       1 shared_informer.go:318] Caches are synced for node config

	I0524 18:36:51.240513       1 shared_informer.go:318] Caches are synced for service config

	I0524 18:36:51.240529       1 shared_informer.go:318] Caches are synced for endpoint slice config

	* 

	* ==> kube-scheduler [046435c695b1] <==

	* W0524 18:36:34.551296       1 reflector.go:533] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0524 18:36:34.551335       1 reflector.go:148] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	W0524 18:36:34.555158       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E0524 18:36:34.555224       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	W0524 18:36:34.555257       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0524 18:36:34.555277       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	W0524 18:36:34.555318       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E0524 18:36:34.555338       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	W0524 18:36:34.555364       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0524 18:36:34.555398       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	W0524 18:36:34.555416       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0524 18:36:34.555434       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	W0524 18:36:35.414754       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0524 18:36:35.414831       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	W0524 18:36:35.419590       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0524 18:36:35.419621       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	W0524 18:36:35.431658       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E0524 18:36:35.431697       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	W0524 18:36:35.542100       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0524 18:36:35.542130       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	W0524 18:36:35.557940       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0524 18:36:35.558018       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	W0524 18:36:35.599004       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0524 18:36:35.599089       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	I0524 18:36:36.142741       1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	* 

	* ==> kubelet <==

	* -- Journal begins at Wed 2023-05-24 18:36:19 UTC, ends at Wed 2023-05-24 19:06:52 UTC. --

	May 24 19:03:37 addons-514000 kubelet[2266]: E0524 19:03:37.209339    2266 iptables.go:575] "Could not set up iptables canary" err=<

	May 24 19:03:37 addons-514000 kubelet[2266]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	May 24 19:03:37 addons-514000 kubelet[2266]:         Perhaps ip6tables or your kernel needs to be upgraded.

	May 24 19:03:37 addons-514000 kubelet[2266]:  > table=nat chain=KUBE-KUBELET-CANARY

	May 24 19:04:37 addons-514000 kubelet[2266]: E0524 19:04:37.208780    2266 iptables.go:575] "Could not set up iptables canary" err=<

	May 24 19:04:37 addons-514000 kubelet[2266]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	May 24 19:04:37 addons-514000 kubelet[2266]:         Perhaps ip6tables or your kernel needs to be upgraded.

	May 24 19:04:37 addons-514000 kubelet[2266]:  > table=nat chain=KUBE-KUBELET-CANARY

	May 24 19:04:44 addons-514000 kubelet[2266]: I0524 19:04:44.840065    2266 topology_manager.go:212] "Topology Admit Handler"

	May 24 19:04:44 addons-514000 kubelet[2266]: E0524 19:04:44.840102    2266 cpu_manager.go:395] "RemoveStaleState: removing container" podUID="a8924bcf-105a-490c-8dee-b1e6ac2ae9dc" containerName="create"

	May 24 19:04:44 addons-514000 kubelet[2266]: E0524 19:04:44.840107    2266 cpu_manager.go:395] "RemoveStaleState: removing container" podUID="4aa56f7c-19bb-453a-b200-e0f9135925dc" containerName="patch"

	May 24 19:04:44 addons-514000 kubelet[2266]: I0524 19:04:44.840120    2266 memory_manager.go:346] "RemoveStaleState removing state" podUID="a8924bcf-105a-490c-8dee-b1e6ac2ae9dc" containerName="create"

	May 24 19:04:44 addons-514000 kubelet[2266]: I0524 19:04:44.840123    2266 memory_manager.go:346] "RemoveStaleState removing state" podUID="4aa56f7c-19bb-453a-b200-e0f9135925dc" containerName="patch"

	May 24 19:04:44 addons-514000 kubelet[2266]: I0524 19:04:44.974513    2266 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd4pl\" (UniqueName: \"kubernetes.io/projected/490c364a-3e83-4de2-89de-8ca7ba0dde32-kube-api-access-kd4pl\") pod \"headlamp-6b5756787-kf2ww\" (UID: \"490c364a-3e83-4de2-89de-8ca7ba0dde32\") " pod="headlamp/headlamp-6b5756787-kf2ww"

	May 24 19:04:44 addons-514000 kubelet[2266]: I0524 19:04:44.974596    2266 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/490c364a-3e83-4de2-89de-8ca7ba0dde32-gcp-creds\") pod \"headlamp-6b5756787-kf2ww\" (UID: \"490c364a-3e83-4de2-89de-8ca7ba0dde32\") " pod="headlamp/headlamp-6b5756787-kf2ww"

	May 24 19:04:50 addons-514000 kubelet[2266]: I0524 19:04:50.872583    2266 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="headlamp/headlamp-6b5756787-kf2ww" podStartSLOduration=2.349694023 podCreationTimestamp="2023-05-24 19:04:44 +0000 UTC" firstStartedPulling="2023-05-24 19:04:45.370369124 +0000 UTC m=+1688.251162991" lastFinishedPulling="2023-05-24 19:04:49.893214539 +0000 UTC m=+1692.774008406" observedRunningTime="2023-05-24 19:04:50.858786302 +0000 UTC m=+1693.739580212" watchObservedRunningTime="2023-05-24 19:04:50.872539438 +0000 UTC m=+1693.753333348"

	May 24 19:05:37 addons-514000 kubelet[2266]: E0524 19:05:37.312943    2266 iptables.go:575] "Could not set up iptables canary" err=<

	May 24 19:05:37 addons-514000 kubelet[2266]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	May 24 19:05:37 addons-514000 kubelet[2266]:         Perhaps ip6tables or your kernel needs to be upgraded.

	May 24 19:05:37 addons-514000 kubelet[2266]:  > table=nat chain=KUBE-KUBELET-CANARY

	May 24 19:06:37 addons-514000 kubelet[2266]: E0524 19:06:37.211882    2266 iptables.go:575] "Could not set up iptables canary" err=<

	May 24 19:06:37 addons-514000 kubelet[2266]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	May 24 19:06:37 addons-514000 kubelet[2266]:         Perhaps ip6tables or your kernel needs to be upgraded.

	May 24 19:06:37 addons-514000 kubelet[2266]:  > table=nat chain=KUBE-KUBELET-CANARY

	May 24 19:06:37 addons-514000 kubelet[2266]: W0524 19:06:37.219278    2266 machine.go:65] Cannot read vendor id correctly, set empty.

	* 

	* ==> storage-provisioner [c6d1bdca910b] <==

	* I0524 18:36:52.162540       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0524 18:36:52.179095       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0524 18:36:52.179236       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I0524 18:36:52.184538       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0524 18:36:52.185437       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-514000_06403223-0fe7-4b51-9128-30a4ab7aa15a!

	I0524 18:36:52.187871       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"6d6698b6-9eb5-4aee-aab5-f9c270917482", APIVersion:"v1", ResourceVersion:"417", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-514000_06403223-0fe7-4b51-9128-30a4ab7aa15a became leader

	I0524 18:36:52.285999       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-514000_06403223-0fe7-4b51-9128-30a4ab7aa15a!

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.APIServer}} -p addons-514000 -n addons-514000

helpers_test.go:261: (dbg) Run:  kubectl --context addons-514000 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:285: <<< TestAddons/parallel/MetricsServer FAILED: end of post-mortem logs <<<

helpers_test.go:286: ---------------------/post-mortem---------------------------------

--- FAIL: TestAddons/parallel/MetricsServer (721.01s)

=== RUN   TestAddons/parallel/CSI

=== PAUSE TestAddons/parallel/CSI

=== CONT  TestAddons/parallel/CSI

addons_test.go:535: failed waiting for csi-hostpath-driver pods to stabilize: context deadline exceeded

addons_test.go:537: csi-hostpath-driver pods stabilized in 6m0.002617875s

addons_test.go:540: (dbg) Run:  kubectl --context addons-514000 create -f testdata/csi-hostpath-driver/pvc.yaml

addons_test.go:545: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc" in namespace "default" ...

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-514000 get pvc hpvc -o jsonpath={.status.phase} -n default

addons_test.go:546: failed waiting for PVC hpvc: context deadline exceeded

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.Host}} -p addons-514000 -n addons-514000

helpers_test.go:244: <<< TestAddons/parallel/CSI FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestAddons/parallel/CSI]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-darwin-arm64 -p addons-514000 logs -n 25

helpers_test.go:252: TestAddons/parallel/CSI logs: 

-- stdout --

	* 

	* ==> Audit <==

	* |---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|

	| Command |              Args              |       Profile        |  User   | Version |     Start Time      |      End Time       |

	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|

	| start   | -o=json --download-only        | download-only-108000 | jenkins | v1.30.1 | 24 May 23 11:35 PDT |                     |

	|         | -p download-only-108000        |                      |         |         |                     |                     |

	|         | --force --alsologtostderr      |                      |         |         |                     |                     |

	|         | --kubernetes-version=v1.16.0   |                      |         |         |                     |                     |

	|         | --container-runtime=docker     |                      |         |         |                     |                     |

	|         | --driver=qemu2                 |                      |         |         |                     |                     |

	| start   | -o=json --download-only        | download-only-108000 | jenkins | v1.30.1 | 24 May 23 11:35 PDT |                     |

	|         | -p download-only-108000        |                      |         |         |                     |                     |

	|         | --force --alsologtostderr      |                      |         |         |                     |                     |

	|         | --kubernetes-version=v1.27.2   |                      |         |         |                     |                     |

	|         | --container-runtime=docker     |                      |         |         |                     |                     |

	|         | --driver=qemu2                 |                      |         |         |                     |                     |

	| delete  | --all                          | minikube             | jenkins | v1.30.1 | 24 May 23 11:36 PDT | 24 May 23 11:36 PDT |

	| delete  | -p download-only-108000        | download-only-108000 | jenkins | v1.30.1 | 24 May 23 11:36 PDT | 24 May 23 11:36 PDT |

	| delete  | -p download-only-108000        | download-only-108000 | jenkins | v1.30.1 | 24 May 23 11:36 PDT | 24 May 23 11:36 PDT |

	| start   | --download-only -p             | binary-mirror-689000 | jenkins | v1.30.1 | 24 May 23 11:36 PDT |                     |

	|         | binary-mirror-689000           |                      |         |         |                     |                     |

	|         | --alsologtostderr              |                      |         |         |                     |                     |

	|         | --binary-mirror                |                      |         |         |                     |                     |

	|         | http://127.0.0.1:49309         |                      |         |         |                     |                     |

	|         | --driver=qemu2                 |                      |         |         |                     |                     |

	| delete  | -p binary-mirror-689000        | binary-mirror-689000 | jenkins | v1.30.1 | 24 May 23 11:36 PDT | 24 May 23 11:36 PDT |

	| start   | -p addons-514000               | addons-514000        | jenkins | v1.30.1 | 24 May 23 11:36 PDT | 24 May 23 11:42 PDT |

	|         | --wait=true --memory=4000      |                      |         |         |                     |                     |

	|         | --alsologtostderr              |                      |         |         |                     |                     |

	|         | --addons=registry              |                      |         |         |                     |                     |

	|         | --addons=metrics-server        |                      |         |         |                     |                     |

	|         | --addons=volumesnapshots       |                      |         |         |                     |                     |

	|         | --addons=csi-hostpath-driver   |                      |         |         |                     |                     |

	|         | --addons=gcp-auth              |                      |         |         |                     |                     |

	|         | --addons=cloud-spanner         |                      |         |         |                     |                     |

	|         | --addons=inspektor-gadget      |                      |         |         |                     |                     |

	|         | --driver=qemu2                 |                      |         |         |                     |                     |

	|         | --addons=ingress               |                      |         |         |                     |                     |

	|         | --addons=ingress-dns           |                      |         |         |                     |                     |

	| addons  | disable cloud-spanner -p       | addons-514000        | jenkins | v1.30.1 | 24 May 23 11:54 PDT |                     |

	|         | addons-514000                  |                      |         |         |                     |                     |

	| addons  | enable headlamp                | addons-514000        | jenkins | v1.30.1 | 24 May 23 12:04 PDT | 24 May 23 12:04 PDT |

	|         | -p addons-514000               |                      |         |         |                     |                     |

	|         | --alsologtostderr -v=1         |                      |         |         |                     |                     |

	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|

	* 

	* ==> Last Start <==

	* Log file created at: 2023/05/24 11:36:07

	Running on machine: MacOS-M1-Agent-1

	Binary: Built with gc go1.20.4 for darwin/arm64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0524 11:36:07.002339    1534 out.go:296] Setting OutFile to fd 1 ...

	I0524 11:36:07.002453    1534 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0524 11:36:07.002456    1534 out.go:309] Setting ErrFile to fd 2...

	I0524 11:36:07.002459    1534 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0524 11:36:07.002536    1534 root.go:336] Updating PATH: /Users/jenkins/minikube-integration/16573-1024/.minikube/bin

	I0524 11:36:07.003586    1534 out.go:303] Setting JSON to false

	I0524 11:36:07.018861    1534 start.go:125] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":338,"bootTime":1684953029,"procs":422,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"13.3.1","kernelVersion":"22.4.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}

	W0524 11:36:07.018925    1534 start.go:133] gopshost.Virtualization returned error: not implemented yet

	I0524 11:36:07.027769    1534 out.go:177] * [addons-514000] minikube v1.30.1 on Darwin 13.3.1 (arm64)

	I0524 11:36:07.031820    1534 out.go:177]   - MINIKUBE_LOCATION=16573

	I0524 11:36:07.031893    1534 notify.go:220] Checking for updates...

	I0524 11:36:07.038648    1534 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/16573-1024/kubeconfig

	I0524 11:36:07.041871    1534 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-arm64

	I0524 11:36:07.045796    1534 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0524 11:36:07.047102    1534 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/16573-1024/.minikube

	I0524 11:36:07.049751    1534 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0524 11:36:07.052962    1534 driver.go:375] Setting default libvirt URI to qemu:///system

	I0524 11:36:07.056656    1534 out.go:177] * Using the qemu2 driver based on user configuration

	I0524 11:36:07.063768    1534 start.go:295] selected driver: qemu2

	I0524 11:36:07.063774    1534 start.go:870] validating driver "qemu2" against <nil>

	I0524 11:36:07.063780    1534 start.go:881] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0524 11:36:07.066216    1534 start_flags.go:305] no existing cluster config was found, will generate one from the flags 

	I0524 11:36:07.068844    1534 out.go:177] * Automatically selected the socket_vmnet network

	I0524 11:36:07.072801    1534 start_flags.go:915] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0524 11:36:07.072817    1534 cni.go:84] Creating CNI manager for ""

	I0524 11:36:07.072825    1534 cni.go:157] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0524 11:36:07.072829    1534 start_flags.go:314] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0524 11:36:07.072834    1534 start_flags.go:319] config:

	{Name:addons-514000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684536746-16501@sha256:f5d93abf1d1cfb142a7cf0b58b24029595d621e5f943105b16c61199094d77de Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.2 ClusterName:addons-514000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CR

ISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}

	I0524 11:36:07.072903    1534 iso.go:125] acquiring lock: {Name:mk78431aa792d64459e9d8bd2fb1ce84dc420421 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0524 11:36:07.080756    1534 out.go:177] * Starting control plane node addons-514000 in cluster addons-514000

	I0524 11:36:07.084763    1534 preload.go:132] Checking if preload exists for k8s version v1.27.2 and runtime docker

	I0524 11:36:07.084787    1534 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/16573-1024/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.2-docker-overlay2-arm64.tar.lz4

	I0524 11:36:07.084798    1534 cache.go:57] Caching tarball of preloaded images

	I0524 11:36:07.084855    1534 preload.go:174] Found /Users/jenkins/minikube-integration/16573-1024/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.2-docker-overlay2-arm64.tar.lz4 in cache, skipping download

	I0524 11:36:07.084860    1534 cache.go:60] Finished verifying existence of preloaded tar for  v1.27.2 on docker

	I0524 11:36:07.085026    1534 profile.go:148] Saving config to /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/config.json ...

	I0524 11:36:07.085039    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/config.json: {Name:mk030e94b16168c63405a9b01e247098a953bb00 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:07.085215    1534 cache.go:195] Successfully downloaded all kic artifacts

	I0524 11:36:07.085252    1534 start.go:364] acquiring machines lock for addons-514000: {Name:mkb37a68e9ac84a7c17b3cbe42c3966e2ec65b65 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0524 11:36:07.085315    1534 start.go:368] acquired machines lock for "addons-514000" in 57.708µs

	I0524 11:36:07.085327    1534 start.go:93] Provisioning new machine with config: &{Name:addons-514000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/16501/minikube-v1.30.1-1684536668-16501-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684536746-16501@sha256:f5d93abf1d1cfb142a7cf0b58b24029595d621e5f943105b16c61199094d77de Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi

g:{KubernetesVersion:v1.27.2 ClusterName:addons-514000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262

144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:} &{Name: IP: Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0524 11:36:07.085355    1534 start.go:125] createHost starting for "" (driver="qemu2")

	I0524 11:36:07.093778    1534 out.go:204] * Creating qemu2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	I0524 11:36:07.463575    1534 start.go:159] libmachine.API.Create for "addons-514000" (driver="qemu2")

	I0524 11:36:07.463635    1534 client.go:168] LocalClient.Create starting

	I0524 11:36:07.463808    1534 main.go:141] libmachine: Creating CA: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca.pem

	I0524 11:36:07.521208    1534 main.go:141] libmachine: Creating client certificate: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/cert.pem

	I0524 11:36:07.678481    1534 main.go:141] libmachine: Downloading /Users/jenkins/minikube-integration/16573-1024/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/16573-1024/.minikube/cache/iso/arm64/minikube-v1.30.1-1684536668-16501-arm64.iso...

	I0524 11:36:08.060894    1534 main.go:141] libmachine: Creating SSH key...

	I0524 11:36:08.147520    1534 main.go:141] libmachine: Creating Disk image...

	I0524 11:36:08.147526    1534 main.go:141] libmachine: Creating 20000 MB hard disk image...

	I0524 11:36:08.147754    1534 main.go:141] libmachine: executing: qemu-img convert -f raw -O qcow2 /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/disk.qcow2.raw /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/disk.qcow2

	I0524 11:36:08.231403    1534 main.go:141] libmachine: STDOUT: 

	I0524 11:36:08.231426    1534 main.go:141] libmachine: STDERR: 

	I0524 11:36:08.231485    1534 main.go:141] libmachine: executing: qemu-img resize /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/disk.qcow2 +20000M

	I0524 11:36:08.238737    1534 main.go:141] libmachine: STDOUT: Image resized.

	I0524 11:36:08.238750    1534 main.go:141] libmachine: STDERR: 

	I0524 11:36:08.238766    1534 main.go:141] libmachine: DONE writing to /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/disk.qcow2.raw and /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/disk.qcow2

	I0524 11:36:08.238773    1534 main.go:141] libmachine: Starting QEMU VM...

	I0524 11:36:08.238817    1534 main.go:141] libmachine: executing: /opt/socket_vmnet/bin/socket_vmnet_client /var/run/socket_vmnet qemu-system-aarch64 -M virt -cpu host -drive file=/opt/homebrew/Cellar/qemu/7.2.0/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 4000 -smp 2 -boot d -cdrom /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/boot2docker.iso -qmp unix:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor,server,nowait -pidfile /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/qemu.pid -device virtio-net-pci,netdev=net0,mac=0a:73:48:f5:f9:b3 -netdev socket,id=net0,fd=3 -daemonize /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/disk.qcow2

	I0524 11:36:08.309201    1534 main.go:141] libmachine: STDOUT: 

	I0524 11:36:08.309237    1534 main.go:141] libmachine: STDERR: 

	I0524 11:36:08.309242    1534 main.go:141] libmachine: Attempt 0

	I0524 11:36:08.309258    1534 main.go:141] libmachine: Searching for a:73:48:f5:f9:b3 in /var/db/dhcpd_leases ...

	I0524 11:36:10.311441    1534 main.go:141] libmachine: Attempt 1

	I0524 11:36:10.311529    1534 main.go:141] libmachine: Searching for a:73:48:f5:f9:b3 in /var/db/dhcpd_leases ...

	I0524 11:36:12.313222    1534 main.go:141] libmachine: Attempt 2

	I0524 11:36:12.313245    1534 main.go:141] libmachine: Searching for a:73:48:f5:f9:b3 in /var/db/dhcpd_leases ...

	I0524 11:36:14.315294    1534 main.go:141] libmachine: Attempt 3

	I0524 11:36:14.315307    1534 main.go:141] libmachine: Searching for a:73:48:f5:f9:b3 in /var/db/dhcpd_leases ...

	I0524 11:36:16.317343    1534 main.go:141] libmachine: Attempt 4

	I0524 11:36:16.317356    1534 main.go:141] libmachine: Searching for a:73:48:f5:f9:b3 in /var/db/dhcpd_leases ...

	I0524 11:36:18.319398    1534 main.go:141] libmachine: Attempt 5

	I0524 11:36:18.319426    1534 main.go:141] libmachine: Searching for a:73:48:f5:f9:b3 in /var/db/dhcpd_leases ...

	I0524 11:36:20.321607    1534 main.go:141] libmachine: Attempt 6

	I0524 11:36:20.321690    1534 main.go:141] libmachine: Searching for a:73:48:f5:f9:b3 in /var/db/dhcpd_leases ...

	I0524 11:36:20.321979    1534 main.go:141] libmachine: Found 1 entries in /var/db/dhcpd_leases!

	I0524 11:36:20.322073    1534 main.go:141] libmachine: dhcp entry: {Name:minikube IPAddress:192.168.105.2 HWAddress:a:73:48:f5:f9:b3 ID:1,a:73:48:f5:f9:b3 Lease:0x646faaa3}

	I0524 11:36:20.322118    1534 main.go:141] libmachine: Found match: a:73:48:f5:f9:b3

	I0524 11:36:20.322159    1534 main.go:141] libmachine: IP: 192.168.105.2

	I0524 11:36:20.322182    1534 main.go:141] libmachine: Waiting for VM to start (ssh -p 22 docker@192.168.105.2)...

	I0524 11:36:22.345943    1534 machine.go:88] provisioning docker machine ...

	I0524 11:36:22.346010    1534 buildroot.go:166] provisioning hostname "addons-514000"

	I0524 11:36:22.346753    1534 main.go:141] libmachine: Using SSH client type: native

	I0524 11:36:22.347771    1534 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100e286d0] 0x100e2b130 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0524 11:36:22.347789    1534 main.go:141] libmachine: About to run SSH command:

	sudo hostname addons-514000 && echo "addons-514000" | sudo tee /etc/hostname

	I0524 11:36:22.440700    1534 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-514000

	I0524 11:36:22.440862    1534 main.go:141] libmachine: Using SSH client type: native

	I0524 11:36:22.441350    1534 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100e286d0] 0x100e2b130 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0524 11:36:22.441366    1534 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\saddons-514000' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-514000/g' /etc/hosts;

				else 

					echo '127.0.1.1 addons-514000' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0524 11:36:22.513129    1534 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0524 11:36:22.513148    1534 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/16573-1024/.minikube CaCertPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/16573-1024/.minikube}

	I0524 11:36:22.513166    1534 buildroot.go:174] setting up certificates

	I0524 11:36:22.513196    1534 provision.go:83] configureAuth start

	I0524 11:36:22.513202    1534 provision.go:138] copyHostCerts

	I0524 11:36:22.513384    1534 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.pem (1078 bytes)

	I0524 11:36:22.513907    1534 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/16573-1024/.minikube/cert.pem (1123 bytes)

	I0524 11:36:22.514185    1534 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/16573-1024/.minikube/key.pem (1675 bytes)

	I0524 11:36:22.514351    1534 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca-key.pem org=jenkins.addons-514000 san=[192.168.105.2 192.168.105.2 localhost 127.0.0.1 minikube addons-514000]

	I0524 11:36:22.615592    1534 provision.go:172] copyRemoteCerts

	I0524 11:36:22.615660    1534 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0524 11:36:22.615678    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:22.647614    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0524 11:36:22.654906    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/server.pem --> /etc/docker/server.pem (1216 bytes)

	I0524 11:36:22.661956    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0524 11:36:22.668901    1534 provision.go:86] duration metric: configureAuth took 155.700959ms

	I0524 11:36:22.668909    1534 buildroot.go:189] setting minikube options for container-runtime

	I0524 11:36:22.669263    1534 config.go:182] Loaded profile config "addons-514000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.27.2

	I0524 11:36:22.669315    1534 main.go:141] libmachine: Using SSH client type: native

	I0524 11:36:22.669538    1534 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100e286d0] 0x100e2b130 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0524 11:36:22.669543    1534 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0524 11:36:22.728343    1534 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I0524 11:36:22.728351    1534 buildroot.go:70] root file system type: tmpfs

	I0524 11:36:22.728414    1534 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I0524 11:36:22.728455    1534 main.go:141] libmachine: Using SSH client type: native

	I0524 11:36:22.728711    1534 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100e286d0] 0x100e2b130 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0524 11:36:22.728749    1534 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0524 11:36:22.797892    1534 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0524 11:36:22.797940    1534 main.go:141] libmachine: Using SSH client type: native

	I0524 11:36:22.798220    1534 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100e286d0] 0x100e2b130 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0524 11:36:22.798231    1534 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0524 11:36:23.149053    1534 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory

	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.

	I0524 11:36:23.149067    1534 machine.go:91] provisioned docker machine in 803.097167ms

	I0524 11:36:23.149073    1534 client.go:171] LocalClient.Create took 15.685539208s

	I0524 11:36:23.149079    1534 start.go:167] duration metric: libmachine.API.Create for "addons-514000" took 15.685619292s

	I0524 11:36:23.149084    1534 start.go:300] post-start starting for "addons-514000" (driver="qemu2")

	I0524 11:36:23.149087    1534 start.go:328] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0524 11:36:23.149151    1534 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0524 11:36:23.149161    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:23.182740    1534 ssh_runner.go:195] Run: cat /etc/os-release

	I0524 11:36:23.184182    1534 info.go:137] Remote host: Buildroot 2021.02.12

	I0524 11:36:23.184191    1534 filesync.go:126] Scanning /Users/jenkins/minikube-integration/16573-1024/.minikube/addons for local assets ...

	I0524 11:36:23.184263    1534 filesync.go:126] Scanning /Users/jenkins/minikube-integration/16573-1024/.minikube/files for local assets ...

	I0524 11:36:23.184291    1534 start.go:303] post-start completed in 35.204125ms

	I0524 11:36:23.184667    1534 profile.go:148] Saving config to /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/config.json ...

	I0524 11:36:23.184838    1534 start.go:128] duration metric: createHost completed in 16.099587584s

	I0524 11:36:23.184860    1534 main.go:141] libmachine: Using SSH client type: native

	I0524 11:36:23.185079    1534 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100e286d0] 0x100e2b130 <nil>  [] 0s} 192.168.105.2 22 <nil> <nil>}

	I0524 11:36:23.185084    1534 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0524 11:36:23.240206    1534 main.go:141] libmachine: SSH cmd err, output: <nil>: 1684953383.421013085

	I0524 11:36:23.240212    1534 fix.go:207] guest clock: 1684953383.421013085

	I0524 11:36:23.240216    1534 fix.go:220] Guest: 2023-05-24 11:36:23.421013085 -0700 PDT Remote: 2023-05-24 11:36:23.184841 -0700 PDT m=+16.200821626 (delta=236.172085ms)

	I0524 11:36:23.240228    1534 fix.go:191] guest clock delta is within tolerance: 236.172085ms

	I0524 11:36:23.240231    1534 start.go:83] releasing machines lock for "addons-514000", held for 16.155020041s

	I0524 11:36:23.240534    1534 ssh_runner.go:195] Run: cat /version.json

	I0524 11:36:23.240542    1534 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0524 11:36:23.240552    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:23.240589    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:23.271294    1534 ssh_runner.go:195] Run: systemctl --version

	I0524 11:36:23.356274    1534 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0524 11:36:23.358206    1534 cni.go:208] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0524 11:36:23.358253    1534 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0524 11:36:23.363251    1534 cni.go:261] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0524 11:36:23.363272    1534 preload.go:132] Checking if preload exists for k8s version v1.27.2 and runtime docker

	I0524 11:36:23.363358    1534 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0524 11:36:23.374219    1534 docker.go:633] Got preloaded images: 

	I0524 11:36:23.374227    1534 docker.go:639] registry.k8s.io/kube-apiserver:v1.27.2 wasn't preloaded

	I0524 11:36:23.374272    1534 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I0524 11:36:23.377135    1534 ssh_runner.go:195] Run: which lz4

	I0524 11:36:23.378475    1534 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4

	I0524 11:36:23.379822    1534 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I0524 11:36:23.379833    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.2-docker-overlay2-arm64.tar.lz4 --> /preloaded.tar.lz4 (343635669 bytes)

	I0524 11:36:24.715030    1534 docker.go:597] Took 1.336609 seconds to copy over tarball

	I0524 11:36:24.715105    1534 ssh_runner.go:195] Run: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4

	I0524 11:36:25.802869    1534 ssh_runner.go:235] Completed: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4: (1.087750334s)

	I0524 11:36:25.802885    1534 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I0524 11:36:25.818539    1534 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json

	I0524 11:36:25.821398    1534 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2629 bytes)

	I0524 11:36:25.826757    1534 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0524 11:36:25.912573    1534 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0524 11:36:27.259007    1534 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.346426625s)

	I0524 11:36:27.259050    1534 start.go:481] detecting cgroup driver to use...

	I0524 11:36:27.259161    1534 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0524 11:36:27.264502    1534 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"

	I0524 11:36:27.267902    1534 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I0524 11:36:27.271357    1534 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...

	I0524 11:36:27.271387    1534 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I0524 11:36:27.274823    1534 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0524 11:36:27.278019    1534 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I0524 11:36:27.280856    1534 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0524 11:36:27.283904    1534 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0524 11:36:27.287473    1534 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I0524 11:36:27.291108    1534 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0524 11:36:27.294288    1534 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0524 11:36:27.297250    1534 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0524 11:36:27.376117    1534 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I0524 11:36:27.384917    1534 start.go:481] detecting cgroup driver to use...

	I0524 11:36:27.384994    1534 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0524 11:36:27.390435    1534 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0524 11:36:27.395426    1534 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0524 11:36:27.402483    1534 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0524 11:36:27.406870    1534 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0524 11:36:27.411215    1534 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I0524 11:36:27.451530    1534 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0524 11:36:27.456795    1534 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0524 11:36:27.461922    1534 ssh_runner.go:195] Run: which cri-dockerd

	I0524 11:36:27.463049    1534 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I0524 11:36:27.465876    1534 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)

	I0524 11:36:27.470660    1534 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I0524 11:36:27.538638    1534 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I0524 11:36:27.616092    1534 docker.go:532] configuring docker to use "cgroupfs" as cgroup driver...

	I0524 11:36:27.616109    1534 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (144 bytes)

	I0524 11:36:27.621459    1534 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0524 11:36:27.708405    1534 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0524 11:36:28.851963    1534 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.143548708s)

	I0524 11:36:28.852015    1534 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I0524 11:36:28.939002    1534 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I0524 11:36:29.020013    1534 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I0524 11:36:29.108812    1534 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0524 11:36:29.187424    1534 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I0524 11:36:29.194801    1534 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0524 11:36:29.274472    1534 ssh_runner.go:195] Run: sudo systemctl restart cri-docker

	I0524 11:36:29.298400    1534 start.go:528] Will wait 60s for socket path /var/run/cri-dockerd.sock

	I0524 11:36:29.298499    1534 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0524 11:36:29.300633    1534 start.go:549] Will wait 60s for crictl version

	I0524 11:36:29.300681    1534 ssh_runner.go:195] Run: which crictl

	I0524 11:36:29.302069    1534 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0524 11:36:29.320125    1534 start.go:565] Version:  0.1.0

	RuntimeName:  docker

	RuntimeVersion:  20.10.23

	RuntimeApiVersion:  v1alpha2

	I0524 11:36:29.320196    1534 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0524 11:36:29.329425    1534 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0524 11:36:29.346012    1534 out.go:204] * Preparing Kubernetes v1.27.2 on Docker 20.10.23 ...

	I0524 11:36:29.346159    1534 ssh_runner.go:195] Run: grep 192.168.105.1	host.minikube.internal$ /etc/hosts

	I0524 11:36:29.347609    1534 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.105.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0524 11:36:29.351578    1534 preload.go:132] Checking if preload exists for k8s version v1.27.2 and runtime docker

	I0524 11:36:29.351619    1534 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0524 11:36:29.359168    1534 docker.go:633] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.27.2

	registry.k8s.io/kube-controller-manager:v1.27.2

	registry.k8s.io/kube-scheduler:v1.27.2

	registry.k8s.io/kube-proxy:v1.27.2

	registry.k8s.io/coredns/coredns:v1.10.1

	registry.k8s.io/etcd:3.5.7-0

	registry.k8s.io/pause:3.9

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I0524 11:36:29.359177    1534 docker.go:563] Images already preloaded, skipping extraction

	I0524 11:36:29.359234    1534 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0524 11:36:29.366578    1534 docker.go:633] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.27.2

	registry.k8s.io/kube-scheduler:v1.27.2

	registry.k8s.io/kube-controller-manager:v1.27.2

	registry.k8s.io/kube-proxy:v1.27.2

	registry.k8s.io/coredns/coredns:v1.10.1

	registry.k8s.io/etcd:3.5.7-0

	registry.k8s.io/pause:3.9

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I0524 11:36:29.366587    1534 cache_images.go:84] Images are preloaded, skipping loading

	I0524 11:36:29.366634    1534 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I0524 11:36:29.376722    1534 cni.go:84] Creating CNI manager for ""

	I0524 11:36:29.376734    1534 cni.go:157] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0524 11:36:29.376743    1534 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I0524 11:36:29.376755    1534 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.105.2 APIServerPort:8443 KubernetesVersion:v1.27.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-514000 NodeName:addons-514000 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.105.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.105.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/ku

bernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I0524 11:36:29.376831    1534 kubeadm.go:181] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.105.2

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/cri-dockerd.sock

	  name: "addons-514000"

	  kubeletExtraArgs:

	    node-ip: 192.168.105.2

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.105.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.27.2

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0524 11:36:29.376873    1534 kubeadm.go:971] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.27.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/cri-dockerd.sock --hostname-override=addons-514000 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.105.2

	[Install]

	 config:

	{KubernetesVersion:v1.27.2 ClusterName:addons-514000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I0524 11:36:29.376934    1534 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.27.2

	I0524 11:36:29.379950    1534 binaries.go:44] Found k8s binaries, skipping transfer

	I0524 11:36:29.379980    1534 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0524 11:36:29.383262    1534 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (375 bytes)

	I0524 11:36:29.388298    1534 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0524 11:36:29.393370    1534 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2099 bytes)

	I0524 11:36:29.398040    1534 ssh_runner.go:195] Run: grep 192.168.105.2	control-plane.minikube.internal$ /etc/hosts

	I0524 11:36:29.399441    1534 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.105.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0524 11:36:29.403560    1534 certs.go:56] Setting up /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000 for IP: 192.168.105.2

	I0524 11:36:29.403576    1534 certs.go:190] acquiring lock for shared ca certs: {Name:mk53f82f750243d1079819acfe50ecbc2a56595a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.403733    1534 certs.go:204] generating minikubeCA CA: /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.key

	I0524 11:36:29.494908    1534 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.crt ...

	I0524 11:36:29.494916    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.crt: {Name:mkde13471093958a457d9307a0c213d7ba461177 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.495144    1534 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.key ...

	I0524 11:36:29.495147    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.key: {Name:mk5b2a6f100829fa25412e4c96a6b4d9b186c9d1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.495264    1534 certs.go:204] generating proxyClientCA CA: /Users/jenkins/minikube-integration/16573-1024/.minikube/proxy-client-ca.key

	I0524 11:36:29.601357    1534 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/16573-1024/.minikube/proxy-client-ca.crt ...

	I0524 11:36:29.601364    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/proxy-client-ca.crt: {Name:mkc3f94501092c9c51cfa6d329a0a2c4cec184ab Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.601593    1534 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/16573-1024/.minikube/proxy-client-ca.key ...

	I0524 11:36:29.601596    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/proxy-client-ca.key: {Name:mk7acf18000a82a656fee32bbd454a3c129dabde Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.601733    1534 certs.go:319] generating minikube-user signed cert: /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/client.key

	I0524 11:36:29.601741    1534 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/client.crt with IP's: []

	I0524 11:36:29.653842    1534 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/client.crt ...

	I0524 11:36:29.653845    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/client.crt: {Name:mk3856cd37d1f07be2cc9902b19f9498b880112f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.654036    1534 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/client.key ...

	I0524 11:36:29.654040    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/client.key: {Name:mkbc8808085e1496dcb2b3e03156e443b7b7994b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.654176    1534 certs.go:319] generating minikube signed cert: /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.key.96055969

	I0524 11:36:29.654188    1534 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.crt.96055969 with IP's: [192.168.105.2 10.96.0.1 127.0.0.1 10.0.0.1]

	I0524 11:36:29.724674    1534 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.crt.96055969 ...

	I0524 11:36:29.724678    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.crt.96055969: {Name:mk424188d0f28cb0aa520452bb8ec4583a153ec6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.724815    1534 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.key.96055969 ...

	I0524 11:36:29.724818    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.key.96055969: {Name:mk98c3231c62717b32e2418cabd759d6ad5645ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.724926    1534 certs.go:337] copying /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.crt.96055969 -> /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.crt

	I0524 11:36:29.725147    1534 certs.go:341] copying /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.key.96055969 -> /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.key

	I0524 11:36:29.725241    1534 certs.go:319] generating aggregator signed cert: /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/proxy-client.key

	I0524 11:36:29.725256    1534 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/proxy-client.crt with IP's: []

	I0524 11:36:29.842949    1534 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/proxy-client.crt ...

	I0524 11:36:29.842953    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/proxy-client.crt: {Name:mk581c30062675e68aafc25cb79bfc8a62fd3e41 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.843105    1534 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/proxy-client.key ...

	I0524 11:36:29.843110    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/proxy-client.key: {Name:mk019f6bac347a368012a36cea939860ce210025 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:29.843389    1534 certs.go:437] found cert: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca-key.pem (1675 bytes)

	I0524 11:36:29.843593    1534 certs.go:437] found cert: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/ca.pem (1078 bytes)

	I0524 11:36:29.843619    1534 certs.go:437] found cert: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/cert.pem (1123 bytes)

	I0524 11:36:29.843756    1534 certs.go:437] found cert: /Users/jenkins/minikube-integration/16573-1024/.minikube/certs/Users/jenkins/minikube-integration/16573-1024/.minikube/certs/key.pem (1675 bytes)

	I0524 11:36:29.844302    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I0524 11:36:29.851879    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0524 11:36:29.859249    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0524 11:36:29.866847    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/profiles/addons-514000/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I0524 11:36:29.873646    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0524 11:36:29.880415    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0524 11:36:29.887466    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0524 11:36:29.894575    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0524 11:36:29.901581    1534 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/16573-1024/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0524 11:36:29.908027    1534 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0524 11:36:29.914140    1534 ssh_runner.go:195] Run: openssl version

	I0524 11:36:29.916182    1534 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0524 11:36:29.919659    1534 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0524 11:36:29.921372    1534 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 May 24 18:36 /usr/share/ca-certificates/minikubeCA.pem

	I0524 11:36:29.921394    1534 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0524 11:36:29.923349    1534 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0524 11:36:29.926902    1534 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd

	I0524 11:36:29.928503    1534 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory

	I0524 11:36:29.928540    1534 kubeadm.go:404] StartCluster: {Name:addons-514000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/16501/minikube-v1.30.1-1684536668-16501-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.39-1684536746-16501@sha256:f5d93abf1d1cfb142a7cf0b58b24029595d621e5f943105b16c61199094d77de Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v

1.27.2 ClusterName:addons-514000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.105.2 Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 Mount

Options:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}

	I0524 11:36:29.928599    1534 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0524 11:36:29.935998    1534 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0524 11:36:29.939589    1534 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0524 11:36:29.942818    1534 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0524 11:36:29.945835    1534 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0524 11:36:29.945853    1534 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.27.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"

	I0524 11:36:29.967889    1534 kubeadm.go:322] [init] Using Kubernetes version: v1.27.2

	I0524 11:36:29.967941    1534 kubeadm.go:322] [preflight] Running pre-flight checks

	I0524 11:36:30.020294    1534 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster

	I0524 11:36:30.020350    1534 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I0524 11:36:30.020400    1534 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	I0524 11:36:30.076237    1534 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I0524 11:36:30.084415    1534 out.go:204]   - Generating certificates and keys ...

	I0524 11:36:30.084460    1534 kubeadm.go:322] [certs] Using existing ca certificate authority

	I0524 11:36:30.084494    1534 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk

	I0524 11:36:30.272940    1534 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key

	I0524 11:36:30.453046    1534 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key

	I0524 11:36:30.580586    1534 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key

	I0524 11:36:30.639773    1534 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key

	I0524 11:36:30.738497    1534 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key

	I0524 11:36:30.738567    1534 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [addons-514000 localhost] and IPs [192.168.105.2 127.0.0.1 ::1]

	I0524 11:36:30.858811    1534 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key

	I0524 11:36:30.858875    1534 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [addons-514000 localhost] and IPs [192.168.105.2 127.0.0.1 ::1]

	I0524 11:36:30.935967    1534 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key

	I0524 11:36:30.967281    1534 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key

	I0524 11:36:31.073416    1534 kubeadm.go:322] [certs] Generating "sa" key and public key

	I0524 11:36:31.073445    1534 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I0524 11:36:31.335469    1534 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file

	I0524 11:36:31.530915    1534 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I0524 11:36:31.573436    1534 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I0524 11:36:31.637219    1534 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I0524 11:36:31.645102    1534 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I0524 11:36:31.645531    1534 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I0524 11:36:31.645571    1534 kubeadm.go:322] [kubelet-start] Starting the kubelet

	I0524 11:36:31.737201    1534 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I0524 11:36:31.741345    1534 out.go:204]   - Booting up control plane ...

	I0524 11:36:31.741390    1534 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I0524 11:36:31.741439    1534 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I0524 11:36:31.741469    1534 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I0524 11:36:31.741512    1534 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I0524 11:36:31.741595    1534 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	I0524 11:36:35.739695    1534 kubeadm.go:322] [apiclient] All control plane components are healthy after 4.002246 seconds

	I0524 11:36:35.739796    1534 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I0524 11:36:35.750536    1534 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I0524 11:36:36.270805    1534 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs

	I0524 11:36:36.271028    1534 kubeadm.go:322] [mark-control-plane] Marking the node addons-514000 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I0524 11:36:36.776691    1534 kubeadm.go:322] [bootstrap-token] Using token: zlw52u.ca0agirmjwjpmd4f

	I0524 11:36:36.783931    1534 out.go:204]   - Configuring RBAC rules ...

	I0524 11:36:36.784005    1534 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I0524 11:36:36.785227    1534 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I0524 11:36:36.791945    1534 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I0524 11:36:36.793322    1534 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I0524 11:36:36.794557    1534 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I0524 11:36:36.795891    1534 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I0524 11:36:36.802617    1534 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I0524 11:36:36.956552    1534 kubeadm.go:322] [addons] Applied essential addon: CoreDNS

	I0524 11:36:37.187637    1534 kubeadm.go:322] [addons] Applied essential addon: kube-proxy

	I0524 11:36:37.187937    1534 kubeadm.go:322] 

	I0524 11:36:37.187967    1534 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!

	I0524 11:36:37.187973    1534 kubeadm.go:322] 

	I0524 11:36:37.188044    1534 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:

	I0524 11:36:37.188053    1534 kubeadm.go:322] 

	I0524 11:36:37.188069    1534 kubeadm.go:322]   mkdir -p $HOME/.kube

	I0524 11:36:37.188099    1534 kubeadm.go:322]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I0524 11:36:37.188128    1534 kubeadm.go:322]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I0524 11:36:37.188133    1534 kubeadm.go:322] 

	I0524 11:36:37.188155    1534 kubeadm.go:322] Alternatively, if you are the root user, you can run:

	I0524 11:36:37.188158    1534 kubeadm.go:322] 

	I0524 11:36:37.188189    1534 kubeadm.go:322]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I0524 11:36:37.188193    1534 kubeadm.go:322] 

	I0524 11:36:37.188219    1534 kubeadm.go:322] You should now deploy a pod network to the cluster.

	I0524 11:36:37.188277    1534 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I0524 11:36:37.188314    1534 kubeadm.go:322]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I0524 11:36:37.188322    1534 kubeadm.go:322] 

	I0524 11:36:37.188361    1534 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities

	I0524 11:36:37.188399    1534 kubeadm.go:322] and service account keys on each node and then running the following as root:

	I0524 11:36:37.188411    1534 kubeadm.go:322] 

	I0524 11:36:37.188464    1534 kubeadm.go:322]   kubeadm join control-plane.minikube.internal:8443 --token zlw52u.ca0agirmjwjpmd4f \

	I0524 11:36:37.188516    1534 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:31e7298e5fe39dd9013d3c0dfbef354d505381f39a7a09e3b4af334242438797 \

	I0524 11:36:37.188534    1534 kubeadm.go:322] 	--control-plane 

	I0524 11:36:37.188538    1534 kubeadm.go:322] 

	I0524 11:36:37.188580    1534 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:

	I0524 11:36:37.188584    1534 kubeadm.go:322] 

	I0524 11:36:37.188629    1534 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token zlw52u.ca0agirmjwjpmd4f \

	I0524 11:36:37.188681    1534 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:31e7298e5fe39dd9013d3c0dfbef354d505381f39a7a09e3b4af334242438797 

	I0524 11:36:37.188736    1534 kubeadm.go:322] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I0524 11:36:37.188819    1534 kubeadm.go:322] W0524 18:36:30.200947    1295 images.go:80] could not find officially supported version of etcd for Kubernetes v1.27.2, falling back to the nearest etcd version (3.5.7-0)

	I0524 11:36:37.188904    1534 kubeadm.go:322] W0524 18:36:31.916526    1295 images.go:80] could not find officially supported version of etcd for Kubernetes v1.27.2, falling back to the nearest etcd version (3.5.7-0)

	I0524 11:36:37.188909    1534 cni.go:84] Creating CNI manager for ""

	I0524 11:36:37.188916    1534 cni.go:157] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0524 11:36:37.195686    1534 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...

	I0524 11:36:37.199715    1534 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d

	I0524 11:36:37.203087    1534 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)

	I0524 11:36:37.208259    1534 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0524 11:36:37.208303    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:37.208333    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl label nodes minikube.k8s.io/version=v1.30.1 minikube.k8s.io/commit=d23ad66c17ded3bf1d7d6fb0fa0ee29881f9547e minikube.k8s.io/name=addons-514000 minikube.k8s.io/updated_at=2023_05_24T11_36_37_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:37.258566    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:37.271047    1534 ops.go:34] apiserver oom_adj: -16

	I0524 11:36:37.796169    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:38.296162    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:38.796257    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:39.295049    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:39.796244    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:40.296250    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:40.796162    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:41.296458    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:41.796245    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:42.296250    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:42.796323    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:43.296423    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:43.796432    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:44.296246    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:44.796149    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:45.296189    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:45.796183    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:46.296206    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:46.796370    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:47.296192    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:47.796245    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:48.296219    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:48.796135    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:49.296201    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:49.796192    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:50.296070    1534 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0524 11:36:50.332878    1534 kubeadm.go:1076] duration metric: took 13.124695208s to wait for elevateKubeSystemPrivileges.

	I0524 11:36:50.332892    1534 kubeadm.go:406] StartCluster complete in 20.404490625s

	I0524 11:36:50.332916    1534 settings.go:142] acquiring lock: {Name:mke0e8586c5ffdfb76a30452ad9385e81e1593cb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:50.333079    1534 settings.go:150] Updating kubeconfig:  /Users/jenkins/minikube-integration/16573-1024/kubeconfig

	I0524 11:36:50.333301    1534 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/16573-1024/kubeconfig: {Name:mkd6a5851332ae81ab607caaee690ec1266dd411 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0524 11:36:50.333499    1534 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.27.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0524 11:36:50.333541    1534 addons.go:496] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:true]

	I0524 11:36:50.333603    1534 addons.go:66] Setting ingress=true in profile "addons-514000"

	I0524 11:36:50.333609    1534 addons.go:66] Setting registry=true in profile "addons-514000"

	I0524 11:36:50.333611    1534 addons.go:228] Setting addon ingress=true in "addons-514000"

	I0524 11:36:50.333614    1534 addons.go:228] Setting addon registry=true in "addons-514000"

	I0524 11:36:50.333650    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.333646    1534 addons.go:66] Setting csi-hostpath-driver=true in profile "addons-514000"

	I0524 11:36:50.333656    1534 addons.go:66] Setting storage-provisioner=true in profile "addons-514000"

	I0524 11:36:50.333660    1534 addons.go:228] Setting addon storage-provisioner=true in "addons-514000"

	I0524 11:36:50.333671    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.333804    1534 addons.go:66] Setting metrics-server=true in profile "addons-514000"

	I0524 11:36:50.333879    1534 addons.go:228] Setting addon metrics-server=true in "addons-514000"

	I0524 11:36:50.333906    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.333926    1534 addons.go:228] Setting addon csi-hostpath-driver=true in "addons-514000"

	I0524 11:36:50.333947    1534 config.go:182] Loaded profile config "addons-514000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.27.2

	I0524 11:36:50.333682    1534 addons.go:66] Setting ingress-dns=true in profile "addons-514000"

	I0524 11:36:50.333976    1534 addons.go:228] Setting addon ingress-dns=true in "addons-514000"

	I0524 11:36:50.333995    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.334035    1534 addons.go:66] Setting gcp-auth=true in profile "addons-514000"

	I0524 11:36:50.333605    1534 addons.go:66] Setting volumesnapshots=true in profile "addons-514000"

	I0524 11:36:50.334092    1534 addons.go:228] Setting addon volumesnapshots=true in "addons-514000"

	I0524 11:36:50.334116    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.334159    1534 addons.go:66] Setting default-storageclass=true in profile "addons-514000"

	I0524 11:36:50.334172    1534 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-514000"

	I0524 11:36:50.333653    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.334095    1534 mustload.go:65] Loading cluster: addons-514000

	I0524 11:36:50.334706    1534 addons.go:66] Setting inspektor-gadget=true in profile "addons-514000"

	I0524 11:36:50.334713    1534 addons.go:228] Setting addon inspektor-gadget=true in "addons-514000"

	I0524 11:36:50.333694    1534 addons.go:66] Setting cloud-spanner=true in profile "addons-514000"

	I0524 11:36:50.334861    1534 addons.go:228] Setting addon cloud-spanner=true in "addons-514000"

	I0524 11:36:50.334877    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.334897    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.334942    1534 host.go:66] Checking if "addons-514000" exists ...

	W0524 11:36:50.335292    1534 host.go:54] host status for "addons-514000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor: connect: connection refused

	W0524 11:36:50.335303    1534 addons.go:274] "addons-514000" is not running, setting metrics-server=true and skipping enablement (err=<nil>)

	I0524 11:36:50.335306    1534 addons.go:464] Verifying addon metrics-server=true in "addons-514000"

	W0524 11:36:50.335329    1534 host.go:54] host status for "addons-514000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor: connect: connection refused

	W0524 11:36:50.335333    1534 addons.go:274] "addons-514000" is not running, setting ingress-dns=true and skipping enablement (err=<nil>)

	W0524 11:36:50.335353    1534 host.go:54] host status for "addons-514000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor: connect: connection refused

	W0524 11:36:50.335359    1534 addons.go:274] "addons-514000" is not running, setting registry=true and skipping enablement (err=<nil>)

	I0524 11:36:50.335362    1534 addons.go:464] Verifying addon registry=true in "addons-514000"

	W0524 11:36:50.335391    1534 host.go:54] host status for "addons-514000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor: connect: connection refused

	I0524 11:36:50.339535    1534 out.go:177] * Verifying registry addon...

	W0524 11:36:50.335411    1534 addons.go:274] "addons-514000" is not running, setting ingress=true and skipping enablement (err=<nil>)

	W0524 11:36:50.335412    1534 host.go:54] host status for "addons-514000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor: connect: connection refused

	W0524 11:36:50.335520    1534 host.go:54] host status for "addons-514000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor: connect: connection refused

	W0524 11:36:50.335588    1534 host.go:54] host status for "addons-514000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor: connect: connection refused

	I0524 11:36:50.335599    1534 config.go:182] Loaded profile config "addons-514000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.27.2

	W0524 11:36:50.335650    1534 host.go:54] host status for "addons-514000" returned error: state: connect: dial unix /Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/monitor: connect: connection refused

	W0524 11:36:50.349556    1534 addons.go:274] "addons-514000" is not running, setting csi-hostpath-driver=true and skipping enablement (err=<nil>)

	W0524 11:36:50.349673    1534 addons.go:274] "addons-514000" is not running, setting cloud-spanner=true and skipping enablement (err=<nil>)

	I0524 11:36:50.349673    1534 addons.go:464] Verifying addon ingress=true in "addons-514000"

	W0524 11:36:50.349688    1534 addons_storage_classes.go:55] "addons-514000" is not running, writing default-storageclass=true to disk and skipping enablement

	W0524 11:36:50.349678    1534 addons.go:274] "addons-514000" is not running, setting inspektor-gadget=true and skipping enablement (err=<nil>)

	I0524 11:36:50.350008    1534 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...

	I0524 11:36:50.350257    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.353441    1534 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0524 11:36:50.357663    1534 addons.go:228] Setting addon default-storageclass=true in "addons-514000"

	I0524 11:36:50.360618    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:50.360641    1534 addons.go:420] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0524 11:36:50.360646    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0524 11:36:50.360653    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:50.365539    1534 out.go:177] * Verifying ingress addon...

	I0524 11:36:50.357776    1534 out.go:177]   - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0

	I0524 11:36:50.357776    1534 addons.go:464] Verifying addon csi-hostpath-driver=true in "addons-514000"

	I0524 11:36:50.361446    1534 addons.go:420] installing /etc/kubernetes/addons/storageclass.yaml

	I0524 11:36:50.364279    1534 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=registry

	I0524 11:36:50.381598    1534 out.go:177] * Verifying csi-hostpath-driver addon...

	I0524 11:36:50.369698    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0524 11:36:50.369727    1534 addons.go:420] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml

	I0524 11:36:50.375900    1534 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...

	I0524 11:36:50.387638    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)

	I0524 11:36:50.387638    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:50.387646    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:50.388147    1534 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...

	I0524 11:36:50.390627    1534 kapi.go:86] Found 0 Pods for label selector app.kubernetes.io/name=ingress-nginx

	I0524 11:36:50.391169    1534 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver

	I0524 11:36:50.400375    1534 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.27.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.105.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.27.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0524 11:36:50.433263    1534 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0524 11:36:50.499595    1534 addons.go:420] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml

	I0524 11:36:50.499607    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)

	I0524 11:36:50.511369    1534 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0524 11:36:50.545082    1534 addons.go:420] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml

	I0524 11:36:50.545093    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)

	I0524 11:36:50.571075    1534 addons.go:420] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml

	I0524 11:36:50.571085    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)

	I0524 11:36:50.614490    1534 addons.go:420] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml

	I0524 11:36:50.614502    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)

	I0524 11:36:50.628252    1534 addons.go:420] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0524 11:36:50.628261    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)

	I0524 11:36:50.647925    1534 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0524 11:36:50.858973    1534 kapi.go:248] "coredns" deployment in "kube-system" namespace and "addons-514000" context rescaled to 1 replicas

	I0524 11:36:50.859000    1534 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.105.2 Port:8443 KubernetesVersion:v1.27.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0524 11:36:50.862644    1534 out.go:177] * Verifying Kubernetes components...

	I0524 11:36:50.870714    1534 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0524 11:36:51.015230    1534 start.go:916] {"host.minikube.internal": 192.168.105.1} host record injected into CoreDNS's ConfigMap

	W0524 11:36:51.239743    1534 addons.go:446] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I0524 11:36:51.239769    1534 retry.go:31] will retry after 300.967986ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I0524 11:36:51.240163    1534 node_ready.go:35] waiting up to 6m0s for node "addons-514000" to be "Ready" ...

	I0524 11:36:51.242031    1534 node_ready.go:49] node "addons-514000" has status "Ready":"True"

	I0524 11:36:51.242040    1534 node_ready.go:38] duration metric: took 1.869375ms waiting for node "addons-514000" to be "Ready" ...

	I0524 11:36:51.242043    1534 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0524 11:36:51.247820    1534 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5d78c9869d-dmkfx" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:51.542933    1534 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.2/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0524 11:36:53.257970    1534 pod_ready.go:92] pod "coredns-5d78c9869d-dmkfx" in "kube-system" namespace has status "Ready":"True"

	I0524 11:36:53.257986    1534 pod_ready.go:81] duration metric: took 2.01016425s waiting for pod "coredns-5d78c9869d-dmkfx" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.257991    1534 pod_ready.go:78] waiting up to 6m0s for pod "etcd-addons-514000" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.260855    1534 pod_ready.go:92] pod "etcd-addons-514000" in "kube-system" namespace has status "Ready":"True"

	I0524 11:36:53.260862    1534 pod_ready.go:81] duration metric: took 2.866833ms waiting for pod "etcd-addons-514000" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.260867    1534 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-addons-514000" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.263593    1534 pod_ready.go:92] pod "kube-apiserver-addons-514000" in "kube-system" namespace has status "Ready":"True"

	I0524 11:36:53.263598    1534 pod_ready.go:81] duration metric: took 2.728ms waiting for pod "kube-apiserver-addons-514000" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.263603    1534 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-addons-514000" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.266314    1534 pod_ready.go:92] pod "kube-controller-manager-addons-514000" in "kube-system" namespace has status "Ready":"True"

	I0524 11:36:53.266322    1534 pod_ready.go:81] duration metric: took 2.716417ms waiting for pod "kube-controller-manager-addons-514000" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.266326    1534 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-2gj6m" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.268820    1534 pod_ready.go:92] pod "kube-proxy-2gj6m" in "kube-system" namespace has status "Ready":"True"

	I0524 11:36:53.268826    1534 pod_ready.go:81] duration metric: took 2.496209ms waiting for pod "kube-proxy-2gj6m" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.268830    1534 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-addons-514000" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.659694    1534 pod_ready.go:92] pod "kube-scheduler-addons-514000" in "kube-system" namespace has status "Ready":"True"

	I0524 11:36:53.659709    1534 pod_ready.go:81] duration metric: took 390.87725ms waiting for pod "kube-scheduler-addons-514000" in "kube-system" namespace to be "Ready" ...

	I0524 11:36:53.659719    1534 pod_ready.go:38] duration metric: took 2.417685875s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0524 11:36:53.659737    1534 api_server.go:52] waiting for apiserver process to appear ...

	I0524 11:36:53.659818    1534 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0524 11:36:54.012047    1534 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.2/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (2.469105375s)

	I0524 11:36:54.012061    1534 api_server.go:72] duration metric: took 3.153054583s to wait for apiserver process to appear ...

	I0524 11:36:54.012066    1534 api_server.go:88] waiting for apiserver healthz status ...

	I0524 11:36:54.012074    1534 api_server.go:253] Checking apiserver healthz at https://192.168.105.2:8443/healthz ...

	I0524 11:36:54.015086    1534 api_server.go:279] https://192.168.105.2:8443/healthz returned 200:

	ok

	I0524 11:36:54.015747    1534 api_server.go:141] control plane version: v1.27.2

	I0524 11:36:54.015755    1534 api_server.go:131] duration metric: took 3.685917ms to wait for apiserver health ...

	I0524 11:36:54.015758    1534 system_pods.go:43] waiting for kube-system pods to appear ...

	I0524 11:36:54.018844    1534 system_pods.go:59] 9 kube-system pods found

	I0524 11:36:54.018857    1534 system_pods.go:61] "coredns-5d78c9869d-dmkfx" [03f7079a-733f-488e-a6b1-65e0ca65cffe] Running

	I0524 11:36:54.018861    1534 system_pods.go:61] "etcd-addons-514000" [f53490df-9f65-472d-8c24-fedfb5ff0b40] Running

	I0524 11:36:54.018863    1534 system_pods.go:61] "kube-apiserver-addons-514000" [39ad1080-0c49-4108-8f04-7aded262c978] Running

	I0524 11:36:54.018865    1534 system_pods.go:61] "kube-controller-manager-addons-514000" [8aed5f2f-4439-495f-9454-34920caed37f] Running

	I0524 11:36:54.018868    1534 system_pods.go:61] "kube-proxy-2gj6m" [8d0787ef-32df-4a09-ad1d-48a69a40bb43] Running

	I0524 11:36:54.018870    1534 system_pods.go:61] "kube-scheduler-addons-514000" [98ce7db6-4f70-4fb1-992f-7cf2bf68fb43] Running

	I0524 11:36:54.018873    1534 system_pods.go:61] "snapshot-controller-75bbb956b9-j5jhp" [953964d7-20b0-4fa4-b1ca-f05e6adb94e3] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0524 11:36:54.018876    1534 system_pods.go:61] "snapshot-controller-75bbb956b9-txrxl" [07fe4bd3-7311-4ec4-938d-a195ed8535a8] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0524 11:36:54.018879    1534 system_pods.go:61] "storage-provisioner" [49765353-a5e1-4781-ab06-a554a575daa5] Running

	I0524 11:36:54.018881    1534 system_pods.go:74] duration metric: took 3.121167ms to wait for pod list to return data ...

	I0524 11:36:54.018883    1534 default_sa.go:34] waiting for default service account to be created ...

	I0524 11:36:54.057892    1534 default_sa.go:45] found service account: "default"

	I0524 11:36:54.057899    1534 default_sa.go:55] duration metric: took 39.013541ms for default service account to be created ...

	I0524 11:36:54.057902    1534 system_pods.go:116] waiting for k8s-apps to be running ...

	I0524 11:36:54.259995    1534 system_pods.go:86] 9 kube-system pods found

	I0524 11:36:54.260005    1534 system_pods.go:89] "coredns-5d78c9869d-dmkfx" [03f7079a-733f-488e-a6b1-65e0ca65cffe] Running

	I0524 11:36:54.260008    1534 system_pods.go:89] "etcd-addons-514000" [f53490df-9f65-472d-8c24-fedfb5ff0b40] Running

	I0524 11:36:54.260011    1534 system_pods.go:89] "kube-apiserver-addons-514000" [39ad1080-0c49-4108-8f04-7aded262c978] Running

	I0524 11:36:54.260014    1534 system_pods.go:89] "kube-controller-manager-addons-514000" [8aed5f2f-4439-495f-9454-34920caed37f] Running

	I0524 11:36:54.260016    1534 system_pods.go:89] "kube-proxy-2gj6m" [8d0787ef-32df-4a09-ad1d-48a69a40bb43] Running

	I0524 11:36:54.260019    1534 system_pods.go:89] "kube-scheduler-addons-514000" [98ce7db6-4f70-4fb1-992f-7cf2bf68fb43] Running

	I0524 11:36:54.260023    1534 system_pods.go:89] "snapshot-controller-75bbb956b9-j5jhp" [953964d7-20b0-4fa4-b1ca-f05e6adb94e3] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0524 11:36:54.260027    1534 system_pods.go:89] "snapshot-controller-75bbb956b9-txrxl" [07fe4bd3-7311-4ec4-938d-a195ed8535a8] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])

	I0524 11:36:54.260030    1534 system_pods.go:89] "storage-provisioner" [49765353-a5e1-4781-ab06-a554a575daa5] Running

	I0524 11:36:54.260033    1534 system_pods.go:126] duration metric: took 202.129584ms to wait for k8s-apps to be running ...

	I0524 11:36:54.260037    1534 system_svc.go:44] waiting for kubelet service to be running ....

	I0524 11:36:54.260088    1534 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0524 11:36:54.265390    1534 system_svc.go:56] duration metric: took 5.350666ms WaitForService to wait for kubelet.

	I0524 11:36:54.265399    1534 kubeadm.go:581] duration metric: took 3.406395625s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...

	I0524 11:36:54.265408    1534 node_conditions.go:102] verifying NodePressure condition ...

	I0524 11:36:54.458086    1534 node_conditions.go:122] node storage ephemeral capacity is 17784760Ki

	I0524 11:36:54.458097    1534 node_conditions.go:123] node cpu capacity is 2

	I0524 11:36:54.458103    1534 node_conditions.go:105] duration metric: took 192.694167ms to run NodePressure ...

	I0524 11:36:54.458107    1534 start.go:228] waiting for startup goroutines ...

	I0524 11:36:56.972492    1534 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)

	I0524 11:36:56.972559    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:57.029376    1534 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)

	I0524 11:36:57.038824    1534 addons.go:228] Setting addon gcp-auth=true in "addons-514000"

	I0524 11:36:57.038864    1534 host.go:66] Checking if "addons-514000" exists ...

	I0524 11:36:57.040182    1534 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json

	I0524 11:36:57.040196    1534 sshutil.go:53] new ssh client: &{IP:192.168.105.2 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/16573-1024/.minikube/machines/addons-514000/id_rsa Username:docker}

	I0524 11:36:57.078053    1534 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20230312-helm-chart-4.5.2-28-g66a760794

	I0524 11:36:57.082115    1534 out.go:177]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.0

	I0524 11:36:57.085015    1534 addons.go:420] installing /etc/kubernetes/addons/gcp-auth-ns.yaml

	I0524 11:36:57.085022    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)

	I0524 11:36:57.091862    1534 addons.go:420] installing /etc/kubernetes/addons/gcp-auth-service.yaml

	I0524 11:36:57.091873    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)

	I0524 11:36:57.099462    1534 addons.go:420] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I0524 11:36:57.099472    1534 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5474 bytes)

	I0524 11:36:57.106631    1534 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.2/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I0524 11:36:57.550488    1534 addons.go:464] Verifying addon gcp-auth=true in "addons-514000"

	I0524 11:36:57.555392    1534 out.go:177] * Verifying gcp-auth addon...

	I0524 11:36:57.561721    1534 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...

	I0524 11:36:57.566760    1534 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth

	I0524 11:36:57.566769    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:36:58.070711    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:36:58.570942    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:36:59.076515    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:36:59.570540    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:00.070962    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:00.571104    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:01.071573    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:01.571018    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:02.072518    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:02.570869    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:03.071445    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:03.570661    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:04.070807    1534 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0524 11:37:04.570832    1534 kapi.go:107] duration metric: took 7.009157292s to wait for kubernetes.io/minikube-addons=gcp-auth ...

	I0524 11:37:04.574809    1534 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-514000 cluster.

	I0524 11:37:04.579620    1534 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.

	I0524 11:37:04.583658    1534 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.

	I0524 11:42:50.357445    1534 kapi.go:107] duration metric: took 6m0.009773291s to wait for kubernetes.io/minikube-addons=registry ...

	W0524 11:42:50.357907    1534 out.go:239] ! Enabling 'registry' returned an error: running callbacks: [waiting for kubernetes.io/minikube-addons=registry pods: context deadline exceeded]

	I0524 11:42:50.387243    1534 kapi.go:107] duration metric: took 6m0.001495875s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...

	I0524 11:42:50.387315    1534 kapi.go:107] duration metric: took 6m0.013814333s to wait for app.kubernetes.io/name=ingress-nginx ...

	W0524 11:42:50.387474    1534 out.go:239] ! Enabling 'csi-hostpath-driver' returned an error: running callbacks: [waiting for kubernetes.io/minikube-addons=csi-hostpath-driver pods: context deadline exceeded]

	W0524 11:42:50.387474    1534 out.go:239] ! Enabling 'ingress' returned an error: running callbacks: [waiting for app.kubernetes.io/name=ingress-nginx pods: context deadline exceeded]

	I0524 11:42:50.395532    1534 out.go:177] * Enabled addons: metrics-server, ingress-dns, inspektor-gadget, cloud-spanner, storage-provisioner, default-storageclass, volumesnapshots, gcp-auth

	I0524 11:42:50.403494    1534 addons.go:499] enable addons completed in 6m0.072361709s: enabled=[metrics-server ingress-dns inspektor-gadget cloud-spanner storage-provisioner default-storageclass volumesnapshots gcp-auth]

	I0524 11:42:50.403556    1534 start.go:233] waiting for cluster config update ...

	I0524 11:42:50.403587    1534 start.go:242] writing updated cluster config ...

	I0524 11:42:50.408325    1534 ssh_runner.go:195] Run: rm -f paused

	I0524 11:42:50.568016    1534 start.go:568] kubectl: 1.25.9, cluster: 1.27.2 (minor skew: 2)

	I0524 11:42:50.572568    1534 out.go:177] 

	W0524 11:42:50.576443    1534 out.go:239] ! /usr/local/bin/kubectl is version 1.25.9, which may have incompatibilities with Kubernetes 1.27.2.

	I0524 11:42:50.580476    1534 out.go:177]   - Want kubectl v1.27.2? Try 'minikube kubectl -- get pods -A'

	I0524 11:42:50.587567    1534 out.go:177] * Done! kubectl is now configured to use "addons-514000" cluster and "default" namespace by default

	* 

	* ==> Docker <==

	* -- Journal begins at Wed 2023-05-24 18:36:19 UTC, ends at Wed 2023-05-24 19:16:07 UTC. --

	May 24 18:37:01 addons-514000 dockerd[916]: time="2023-05-24T18:37:01.953788187Z" level=warning msg="reference for unknown type: " digest="sha256:d730651bb6584f969d95d8279a754cf9d8d31b5055c43dbdb8d7363a8c6371cf" remote="gcr.io/k8s-minikube/gcp-auth-webhook@sha256:d730651bb6584f969d95d8279a754cf9d8d31b5055c43dbdb8d7363a8c6371cf"

	May 24 18:37:02 addons-514000 dockerd[922]: time="2023-05-24T18:37:02.557702813Z" level=info msg="shim disconnected" id=953c17ffdc8ac0b98e66b9d8887f99c9b0a49236e6fd43f2647edb75c5e82150 namespace=moby

	May 24 18:37:02 addons-514000 dockerd[922]: time="2023-05-24T18:37:02.557754555Z" level=warning msg="cleaning up after shim disconnected" id=953c17ffdc8ac0b98e66b9d8887f99c9b0a49236e6fd43f2647edb75c5e82150 namespace=moby

	May 24 18:37:02 addons-514000 dockerd[922]: time="2023-05-24T18:37:02.557759977Z" level=info msg="cleaning up dead shim" namespace=moby

	May 24 18:37:02 addons-514000 dockerd[916]: time="2023-05-24T18:37:02.558086156Z" level=info msg="ignoring event" container=953c17ffdc8ac0b98e66b9d8887f99c9b0a49236e6fd43f2647edb75c5e82150 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 24 18:37:03 addons-514000 dockerd[916]: time="2023-05-24T18:37:03.602683250Z" level=info msg="ignoring event" container=7c145b5b88ef04d8237d20d8374f3a2c4283c8c7c120b4d01e6d9eda3df3496d module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 24 18:37:03 addons-514000 dockerd[922]: time="2023-05-24T18:37:03.603089611Z" level=info msg="shim disconnected" id=7c145b5b88ef04d8237d20d8374f3a2c4283c8c7c120b4d01e6d9eda3df3496d namespace=moby

	May 24 18:37:03 addons-514000 dockerd[922]: time="2023-05-24T18:37:03.603147527Z" level=warning msg="cleaning up after shim disconnected" id=7c145b5b88ef04d8237d20d8374f3a2c4283c8c7c120b4d01e6d9eda3df3496d namespace=moby

	May 24 18:37:03 addons-514000 dockerd[922]: time="2023-05-24T18:37:03.603154445Z" level=info msg="cleaning up dead shim" namespace=moby

	May 24 18:37:03 addons-514000 cri-dockerd[1138]: time="2023-05-24T18:37:03Z" level=info msg="Stop pulling image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.0@sha256:d730651bb6584f969d95d8279a754cf9d8d31b5055c43dbdb8d7363a8c6371cf: Status: Downloaded newer image for gcr.io/k8s-minikube/gcp-auth-webhook@sha256:d730651bb6584f969d95d8279a754cf9d8d31b5055c43dbdb8d7363a8c6371cf"

	May 24 18:37:03 addons-514000 dockerd[922]: time="2023-05-24T18:37:03.856707697Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	May 24 18:37:03 addons-514000 dockerd[922]: time="2023-05-24T18:37:03.856808407Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	May 24 18:37:03 addons-514000 dockerd[922]: time="2023-05-24T18:37:03.856985177Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	May 24 18:37:03 addons-514000 dockerd[922]: time="2023-05-24T18:37:03.856997233Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	May 24 19:04:45 addons-514000 dockerd[922]: time="2023-05-24T19:04:45.202234365Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	May 24 19:04:45 addons-514000 dockerd[922]: time="2023-05-24T19:04:45.202265406Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	May 24 19:04:45 addons-514000 dockerd[922]: time="2023-05-24T19:04:45.202273323Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	May 24 19:04:45 addons-514000 dockerd[922]: time="2023-05-24T19:04:45.202278489Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	May 24 19:04:45 addons-514000 cri-dockerd[1138]: time="2023-05-24T19:04:45Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/324faf77934c8dd14cc1dcdd99d834dde8eed7155b1727c2ec6265fcc5463aac/resolv.conf as [nameserver 10.96.0.10 search headlamp.svc.cluster.local svc.cluster.local cluster.local options ndots:5]"

	May 24 19:04:45 addons-514000 dockerd[916]: time="2023-05-24T19:04:45.605001003Z" level=warning msg="reference for unknown type: " digest="sha256:9c33d03e6032adc2ae0920bbda10f82aa223d796f99cfb9509608cd389a157be" remote="ghcr.io/headlamp-k8s/headlamp@sha256:9c33d03e6032adc2ae0920bbda10f82aa223d796f99cfb9509608cd389a157be"

	May 24 19:04:49 addons-514000 cri-dockerd[1138]: time="2023-05-24T19:04:49Z" level=info msg="Stop pulling image ghcr.io/headlamp-k8s/headlamp:v0.17.1@sha256:9c33d03e6032adc2ae0920bbda10f82aa223d796f99cfb9509608cd389a157be: Status: Downloaded newer image for ghcr.io/headlamp-k8s/headlamp@sha256:9c33d03e6032adc2ae0920bbda10f82aa223d796f99cfb9509608cd389a157be"

	May 24 19:04:49 addons-514000 dockerd[922]: time="2023-05-24T19:04:49.985023040Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	May 24 19:04:49 addons-514000 dockerd[922]: time="2023-05-24T19:04:49.985362786Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	May 24 19:04:49 addons-514000 dockerd[922]: time="2023-05-24T19:04:49.985376786Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	May 24 19:04:49 addons-514000 dockerd[922]: time="2023-05-24T19:04:49.985381869Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	* 

	* ==> container status <==

	* CONTAINER           IMAGE                                                                                                                     CREATED             STATE               NAME                         ATTEMPT             POD ID

	372016bac2d66       ghcr.io/headlamp-k8s/headlamp@sha256:9c33d03e6032adc2ae0920bbda10f82aa223d796f99cfb9509608cd389a157be                     11 minutes ago      Running             headlamp                     0                   324faf77934c8

	d1ad6d2cd7d4d       gcr.io/k8s-minikube/gcp-auth-webhook@sha256:d730651bb6584f969d95d8279a754cf9d8d31b5055c43dbdb8d7363a8c6371cf              39 minutes ago      Running             gcp-auth                     0                   f47df037d9956

	2623eeac77855       registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280   39 minutes ago      Running             volume-snapshot-controller   0                   60ea5019d1f26

	61fdb94dca547       registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280   39 minutes ago      Running             volume-snapshot-controller   0                   1f82f1afb5ca6

	5e708965dbb0a       97e04611ad434                                                                                                             39 minutes ago      Running             coredns                      0                   eaf04536825bb

	c6d1bdca910b8       ba04bb24b9575                                                                                                             39 minutes ago      Running             storage-provisioner          0                   55be207be2898

	bf84d832ec967       29921a0845422                                                                                                             39 minutes ago      Running             kube-proxy                   0                   59d50204b0754

	046435c695b1e       305d7ed1dae28                                                                                                             39 minutes ago      Running             kube-scheduler               0                   cd9a002bb369c

	aa80b21f85087       2ee705380c3c5                                                                                                             39 minutes ago      Running             kube-controller-manager      0                   0ebf3f27cb768

	d5556d8565d49       24bc64e911039                                                                                                             39 minutes ago      Running             etcd                         0                   37fcc92ec98a7

	a485542b186e4       72c9df6be7f1b                                                                                                             39 minutes ago      Running             kube-apiserver               0                   383872bb10f81

	* 

	* ==> coredns [5e708965dbb0] <==

	* .:53

	[INFO] plugin/reload: Running configuration SHA512 = ea7a0d73d9d208f758b1f67640ef03c58089b9d9366cf3478df3bb369b210e39f213811b46224f8a04380814b6e0890ccd358f5b5e8c80bc22ac19c8601ee35b

	CoreDNS-1.10.1

	linux/arm64, go1.20, 055b2c3

	[INFO] 127.0.0.1:59819 - 54023 "HINFO IN 5089267470380203033.66065138292483152. udp 55 false 512" NXDOMAIN qr,rd,ra 130 0.424436073s

	[INFO] 10.244.0.7:57634 - 60032 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000112931s

	[INFO] 10.244.0.7:36916 - 20311 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000078547s

	[INFO] 10.244.0.7:53888 - 30613 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000056548s

	[INFO] 10.244.0.7:40805 - 41575 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000031112s

	[INFO] 10.244.0.7:39418 - 54110 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000031567s

	[INFO] 10.244.0.7:45485 - 20279 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000113676s

	[INFO] 10.244.0.7:49511 - 45953 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 534 0.000780781s

	[INFO] 10.244.0.7:49660 - 37020 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.00090552s

	* 

	* ==> describe nodes <==

	* Name:               addons-514000

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=arm64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=arm64

	                    kubernetes.io/hostname=addons-514000

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=d23ad66c17ded3bf1d7d6fb0fa0ee29881f9547e

	                    minikube.k8s.io/name=addons-514000

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2023_05_24T11_36_37_0700

	                    minikube.k8s.io/version=v1.30.1

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Wed, 24 May 2023 18:36:34 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  addons-514000

	  AcquireTime:     <unset>

	  RenewTime:       Wed, 24 May 2023 19:16:07 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Wed, 24 May 2023 19:15:28 +0000   Wed, 24 May 2023 18:36:33 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Wed, 24 May 2023 19:15:28 +0000   Wed, 24 May 2023 18:36:33 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Wed, 24 May 2023 19:15:28 +0000   Wed, 24 May 2023 18:36:33 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Wed, 24 May 2023 19:15:28 +0000   Wed, 24 May 2023 18:36:39 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.105.2

	  Hostname:    addons-514000

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17784760Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3905972Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17784760Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             3905972Ki

	  pods:               110

	System Info:

	  Machine ID:                 cc66183cd0c646be999944d821185b81

	  System UUID:                cc66183cd0c646be999944d821185b81

	  Boot ID:                    2cd753bf-40ed-44ce-928e-d8bb002a6012

	  Kernel Version:             5.10.57

	  OS Image:                   Buildroot 2021.02.12

	  Operating System:           linux

	  Architecture:               arm64

	  Container Runtime Version:  docker://20.10.23

	  Kubelet Version:            v1.27.2

	  Kube-Proxy Version:         v1.27.2

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (11 in total)

	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---

	  gcp-auth                    gcp-auth-58478865f7-5429c                0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         39m

	  headlamp                    headlamp-6b5756787-kf2ww                 0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         11m

	  kube-system                 coredns-5d78c9869d-dmkfx                 100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (1%!)(MISSING)        170Mi (4%!)(MISSING)     39m

	  kube-system                 etcd-addons-514000                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (2%!)(MISSING)       0 (0%!)(MISSING)         39m

	  kube-system                 kube-apiserver-addons-514000             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         39m

	  kube-system                 kube-controller-manager-addons-514000    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         39m

	  kube-system                 kube-proxy-2gj6m                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         39m

	  kube-system                 kube-scheduler-addons-514000             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         39m

	  kube-system                 snapshot-controller-75bbb956b9-j5jhp     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         39m

	  kube-system                 snapshot-controller-75bbb956b9-txrxl     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         39m

	  kube-system                 storage-provisioner                      0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         39m

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%!)(MISSING)  0 (0%!)(MISSING)

	  memory             170Mi (4%!)(MISSING)  170Mi (4%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-32Mi     0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-64Ki     0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age   From             Message

	  ----    ------                   ----  ----             -------

	  Normal  Starting                 39m   kube-proxy       

	  Normal  Starting                 39m   kubelet          Starting kubelet.

	  Normal  NodeAllocatableEnforced  39m   kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  39m   kubelet          Node addons-514000 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    39m   kubelet          Node addons-514000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     39m   kubelet          Node addons-514000 status is now: NodeHasSufficientPID

	  Normal  NodeReady                39m   kubelet          Node addons-514000 status is now: NodeReady

	  Normal  RegisteredNode           39m   node-controller  Node addons-514000 event: Registered Node addons-514000 in Controller

	* 

	* ==> dmesg <==

	* [May24 18:36] ACPI: SRAT not present

	[  +0.000000] KASLR disabled due to lack of seed

	[  +0.727578] EINJ: EINJ table not found.

	[  +0.656332] systemd-fstab-generator[114]: Ignoring "noauto" for root device

	[  +0.043407] systemd[1]: systemd-journald.service: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.

	[  +0.000915] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)

	[  +3.905553] systemd-fstab-generator[471]: Ignoring "noauto" for root device

	[  +0.096232] systemd-fstab-generator[482]: Ignoring "noauto" for root device

	[  +2.874276] systemd-fstab-generator[684]: Ignoring "noauto" for root device

	[  +1.463827] systemd-fstab-generator[849]: Ignoring "noauto" for root device

	[  +0.166355] systemd-fstab-generator[885]: Ignoring "noauto" for root device

	[  +0.076432] systemd-fstab-generator[896]: Ignoring "noauto" for root device

	[  +0.091985] systemd-fstab-generator[909]: Ignoring "noauto" for root device

	[  +1.135416] kauditd_printk_skb: 53 callbacks suppressed

	[  +0.091978] systemd-fstab-generator[1057]: Ignoring "noauto" for root device

	[  +0.084182] systemd-fstab-generator[1068]: Ignoring "noauto" for root device

	[  +0.089221] systemd-fstab-generator[1079]: Ignoring "noauto" for root device

	[  +0.079548] systemd-fstab-generator[1090]: Ignoring "noauto" for root device

	[  +0.085105] systemd-fstab-generator[1131]: Ignoring "noauto" for root device

	[  +2.454751] systemd-fstab-generator[1385]: Ignoring "noauto" for root device

	[  +5.146027] systemd-fstab-generator[2260]: Ignoring "noauto" for root device

	[ +14.118818] kauditd_printk_skb: 41 callbacks suppressed

	[  +2.617169] TCP: eth0: Driver has suspect GRO implementation, TCP performance may be compromised.

	[  +3.922890] kauditd_printk_skb: 33 callbacks suppressed

	[May24 18:37] kauditd_printk_skb: 17 callbacks suppressed

	* 

	* ==> etcd [d5556d8565d4] <==

	* {"level":"info","ts":"2023-05-24T18:36:33.835Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}

	{"level":"info","ts":"2023-05-24T18:36:33.835Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}

	{"level":"info","ts":"2023-05-24T18:36:33.834Z","caller":"embed/serve.go:100","msg":"ready to serve client requests"}

	{"level":"info","ts":"2023-05-24T18:36:33.838Z","caller":"embed/serve.go:198","msg":"serving client traffic securely","address":"127.0.0.1:2379"}

	{"level":"info","ts":"2023-05-24T18:36:33.838Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"6e03e7863b4f9c54","local-member-id":"c46d288d2fcb0590","cluster-version":"3.5"}

	{"level":"info","ts":"2023-05-24T18:36:33.838Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}

	{"level":"info","ts":"2023-05-24T18:36:33.838Z","caller":"etcdserver/server.go:2595","msg":"cluster version is updated","cluster-version":"3.5"}

	{"level":"info","ts":"2023-05-24T18:46:33.876Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":846}

	{"level":"info","ts":"2023-05-24T18:46:33.881Z","caller":"mvcc/kvstore_compaction.go:66","msg":"finished scheduled compaction","compact-revision":846,"took":"3.400485ms","hash":3638416343}

	{"level":"info","ts":"2023-05-24T18:46:33.882Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":3638416343,"revision":846,"compact-revision":-1}

	{"level":"info","ts":"2023-05-24T18:51:33.887Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1145}

	{"level":"info","ts":"2023-05-24T18:51:33.890Z","caller":"mvcc/kvstore_compaction.go:66","msg":"finished scheduled compaction","compact-revision":1145,"took":"2.024563ms","hash":894933936}

	{"level":"info","ts":"2023-05-24T18:51:33.890Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":894933936,"revision":1145,"compact-revision":846}

	{"level":"info","ts":"2023-05-24T18:56:33.899Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1444}

	{"level":"info","ts":"2023-05-24T18:56:33.902Z","caller":"mvcc/kvstore_compaction.go:66","msg":"finished scheduled compaction","compact-revision":1444,"took":"1.805765ms","hash":2332186912}

	{"level":"info","ts":"2023-05-24T18:56:33.902Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":2332186912,"revision":1444,"compact-revision":1145}

	{"level":"info","ts":"2023-05-24T19:01:33.910Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1744}

	{"level":"info","ts":"2023-05-24T19:01:33.913Z","caller":"mvcc/kvstore_compaction.go:66","msg":"finished scheduled compaction","compact-revision":1744,"took":"1.711146ms","hash":1851239145}

	{"level":"info","ts":"2023-05-24T19:01:33.913Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":1851239145,"revision":1744,"compact-revision":1444}

	{"level":"info","ts":"2023-05-24T19:06:33.919Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":2043}

	{"level":"info","ts":"2023-05-24T19:06:33.922Z","caller":"mvcc/kvstore_compaction.go:66","msg":"finished scheduled compaction","compact-revision":2043,"took":"1.631648ms","hash":614110781}

	{"level":"info","ts":"2023-05-24T19:06:33.922Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":614110781,"revision":2043,"compact-revision":1744}

	{"level":"info","ts":"2023-05-24T19:11:33.930Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":2379}

	{"level":"info","ts":"2023-05-24T19:11:33.934Z","caller":"mvcc/kvstore_compaction.go:66","msg":"finished scheduled compaction","compact-revision":2379,"took":"2.540043ms","hash":4182065991}

	{"level":"info","ts":"2023-05-24T19:11:33.934Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":4182065991,"revision":2379,"compact-revision":2043}

	* 

	* ==> gcp-auth [d1ad6d2cd7d4] <==

	* 2023/05/24 18:37:03 GCP Auth Webhook started!

	2023/05/24 19:04:44 Ready to marshal response ...

	2023/05/24 19:04:44 Ready to write response ...

	2023/05/24 19:04:44 Ready to marshal response ...

	2023/05/24 19:04:44 Ready to write response ...

	2023/05/24 19:04:44 Ready to marshal response ...

	2023/05/24 19:04:44 Ready to write response ...

	* 

	* ==> kernel <==

	*  19:16:07 up 39 min,  0 users,  load average: 0.48, 0.47, 0.48

	Linux addons-514000 5.10.57 #1 SMP PREEMPT Sat May 20 00:35:14 UTC 2023 aarch64 GNU/Linux

	PRETTY_NAME="Buildroot 2021.02.12"

	* 

	* ==> kube-apiserver [a485542b186e] <==

	* I0524 18:51:34.556769       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 18:51:34.556848       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 18:56:34.536214       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 18:56:34.536373       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 18:56:34.548003       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 18:56:34.548106       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 19:01:34.537192       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 19:01:34.537290       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 19:01:34.537554       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 19:01:34.537601       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 19:01:34.538264       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 19:01:34.538305       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 19:04:44.806679       1 alloc.go:330] "allocated clusterIPs" service="headlamp/headlamp" clusterIPs=map[IPv4:10.102.182.222]

	I0524 19:06:34.546285       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 19:06:34.546419       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 19:06:34.553782       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 19:06:34.554165       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 19:06:34.557667       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 19:06:34.557813       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 19:11:34.537394       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 19:11:34.537548       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 19:11:34.547604       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 19:11:34.548155       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I0524 19:11:34.562736       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I0524 19:11:34.562812       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	* 

	* ==> kube-controller-manager [aa80b21f8508] <==

	* I0524 19:13:05.489615       1 event.go:307] "Event occurred" object="default/hpvc" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Warning" reason="ProvisioningFailed" message="storageclass.storage.k8s.io \"csi-hostpath-sc\" not found"

	E0524 19:13:20.490200       1 pv_controller.go:1571] "Error finding provisioning plugin for claim" err="storageclass.storage.k8s.io \"csi-hostpath-sc\" not found" PVC="default/hpvc"

	I0524 19:13:20.490782       1 event.go:307] "Event occurred" object="default/hpvc" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Warning" reason="ProvisioningFailed" message="storageclass.storage.k8s.io \"csi-hostpath-sc\" not found"

	E0524 19:13:35.490929       1 pv_controller.go:1571] "Error finding provisioning plugin for claim" err="storageclass.storage.k8s.io \"csi-hostpath-sc\" not found" PVC="default/hpvc"

	I0524 19:13:35.491134       1 event.go:307] "Event occurred" object="default/hpvc" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Warning" reason="ProvisioningFailed" message="storageclass.storage.k8s.io \"csi-hostpath-sc\" not found"

	E0524 19:13:50.492051       1 pv_controller.go:1571] "Error finding provisioning plugin for claim" err="storageclass.storage.k8s.io \"csi-hostpath-sc\" not found" PVC="default/hpvc"

	I0524 19:13:50.492370       1 event.go:307] "Event occurred" object="default/hpvc" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Warning" reason="ProvisioningFailed" message="storageclass.storage.k8s.io \"csi-hostpath-sc\" not found"

	E0524 19:14:05.492682       1 pv_controller.go:1571] "Error finding provisioning plugin for claim" err="storageclass.storage.k8s.io \"csi-hostpath-sc\" not found" PVC="default/hpvc"

	I0524 19:14:05.493051       1 event.go:307] "Event occurred" object="default/hpvc" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Warning" reason="ProvisioningFailed" message="storageclass.storage.k8s.io \"csi-hostpath-sc\" not found"

	E0524 19:14:20.494547       1 pv_controller.go:1571] "Error finding provisioning plugin for claim" err="storageclass.storage.k8s.io \"csi-hostpath-sc\" not found" PVC="default/hpvc"

	I0524 19:14:20.495269       1 event.go:307] "Event occurred" object="default/hpvc" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Warning" reason="ProvisioningFailed" message="storageclass.storage.k8s.io \"csi-hostpath-sc\" not found"

	E0524 19:14:35.497020       1 pv_controller.go:1571] "Error finding provisioning plugin for claim" err="storageclass.storage.k8s.io \"csi-hostpath-sc\" not found" PVC="default/hpvc"

	I0524 19:14:35.497053       1 event.go:307] "Event occurred" object="default/hpvc" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Warning" reason="ProvisioningFailed" message="storageclass.storage.k8s.io \"csi-hostpath-sc\" not found"

	E0524 19:14:50.498179       1 pv_controller.go:1571] "Error finding provisioning plugin for claim" err="storageclass.storage.k8s.io \"csi-hostpath-sc\" not found" PVC="default/hpvc"

	I0524 19:14:50.498434       1 event.go:307] "Event occurred" object="default/hpvc" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Warning" reason="ProvisioningFailed" message="storageclass.storage.k8s.io \"csi-hostpath-sc\" not found"

	E0524 19:15:05.498834       1 pv_controller.go:1571] "Error finding provisioning plugin for claim" err="storageclass.storage.k8s.io \"csi-hostpath-sc\" not found" PVC="default/hpvc"

	I0524 19:15:05.499421       1 event.go:307] "Event occurred" object="default/hpvc" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Warning" reason="ProvisioningFailed" message="storageclass.storage.k8s.io \"csi-hostpath-sc\" not found"

	E0524 19:15:20.499516       1 pv_controller.go:1571] "Error finding provisioning plugin for claim" err="storageclass.storage.k8s.io \"csi-hostpath-sc\" not found" PVC="default/hpvc"

	I0524 19:15:20.499847       1 event.go:307] "Event occurred" object="default/hpvc" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Warning" reason="ProvisioningFailed" message="storageclass.storage.k8s.io \"csi-hostpath-sc\" not found"

	E0524 19:15:35.504070       1 pv_controller.go:1571] "Error finding provisioning plugin for claim" err="storageclass.storage.k8s.io \"csi-hostpath-sc\" not found" PVC="default/hpvc"

	I0524 19:15:35.504556       1 event.go:307] "Event occurred" object="default/hpvc" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Warning" reason="ProvisioningFailed" message="storageclass.storage.k8s.io \"csi-hostpath-sc\" not found"

	E0524 19:15:50.504257       1 pv_controller.go:1571] "Error finding provisioning plugin for claim" err="storageclass.storage.k8s.io \"csi-hostpath-sc\" not found" PVC="default/hpvc"

	I0524 19:15:50.504654       1 event.go:307] "Event occurred" object="default/hpvc" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Warning" reason="ProvisioningFailed" message="storageclass.storage.k8s.io \"csi-hostpath-sc\" not found"

	E0524 19:16:05.504724       1 pv_controller.go:1571] "Error finding provisioning plugin for claim" err="storageclass.storage.k8s.io \"csi-hostpath-sc\" not found" PVC="default/hpvc"

	I0524 19:16:05.504775       1 event.go:307] "Event occurred" object="default/hpvc" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Warning" reason="ProvisioningFailed" message="storageclass.storage.k8s.io \"csi-hostpath-sc\" not found"

	* 

	* ==> kube-proxy [bf84d832ec96] <==

	* I0524 18:36:51.096070       1 node.go:141] Successfully retrieved node IP: 192.168.105.2

	I0524 18:36:51.096254       1 server_others.go:110] "Detected node IP" address="192.168.105.2"

	I0524 18:36:51.096305       1 server_others.go:551] "Using iptables proxy"

	I0524 18:36:51.129985       1 server_others.go:176] "kube-proxy running in single-stack mode: secondary ipFamily is not supported" ipFamily=IPv6

	I0524 18:36:51.130045       1 server_others.go:190] "Using iptables Proxier"

	I0524 18:36:51.130091       1 proxier.go:253] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"

	I0524 18:36:51.130875       1 server.go:657] "Version info" version="v1.27.2"

	I0524 18:36:51.130883       1 server.go:659] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0524 18:36:51.134580       1 config.go:188] "Starting service config controller"

	I0524 18:36:51.134608       1 shared_informer.go:311] Waiting for caches to sync for service config

	I0524 18:36:51.134627       1 config.go:97] "Starting endpoint slice config controller"

	I0524 18:36:51.134630       1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config

	I0524 18:36:51.134949       1 config.go:315] "Starting node config controller"

	I0524 18:36:51.134952       1 shared_informer.go:311] Waiting for caches to sync for node config

	I0524 18:36:51.240491       1 shared_informer.go:318] Caches are synced for node config

	I0524 18:36:51.240513       1 shared_informer.go:318] Caches are synced for service config

	I0524 18:36:51.240529       1 shared_informer.go:318] Caches are synced for endpoint slice config

	* 

	* ==> kube-scheduler [046435c695b1] <==

	* W0524 18:36:34.551296       1 reflector.go:533] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0524 18:36:34.551335       1 reflector.go:148] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	W0524 18:36:34.555158       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E0524 18:36:34.555224       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	W0524 18:36:34.555257       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0524 18:36:34.555277       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	W0524 18:36:34.555318       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E0524 18:36:34.555338       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	W0524 18:36:34.555364       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0524 18:36:34.555398       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	W0524 18:36:34.555416       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0524 18:36:34.555434       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	W0524 18:36:35.414754       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0524 18:36:35.414831       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	W0524 18:36:35.419590       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0524 18:36:35.419621       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	W0524 18:36:35.431658       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E0524 18:36:35.431697       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	W0524 18:36:35.542100       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0524 18:36:35.542130       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	W0524 18:36:35.557940       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0524 18:36:35.558018       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	W0524 18:36:35.599004       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0524 18:36:35.599089       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	I0524 18:36:36.142741       1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	* 

	* ==> kubelet <==

	* -- Journal begins at Wed 2023-05-24 18:36:19 UTC, ends at Wed 2023-05-24 19:16:07 UTC. --

	May 24 19:10:37 addons-514000 kubelet[2266]: E0524 19:10:37.214658    2266 iptables.go:575] "Could not set up iptables canary" err=<

	May 24 19:10:37 addons-514000 kubelet[2266]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	May 24 19:10:37 addons-514000 kubelet[2266]:         Perhaps ip6tables or your kernel needs to be upgraded.

	May 24 19:10:37 addons-514000 kubelet[2266]:  > table=nat chain=KUBE-KUBELET-CANARY

	May 24 19:11:37 addons-514000 kubelet[2266]: E0524 19:11:37.207012    2266 iptables.go:575] "Could not set up iptables canary" err=<

	May 24 19:11:37 addons-514000 kubelet[2266]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	May 24 19:11:37 addons-514000 kubelet[2266]:         Perhaps ip6tables or your kernel needs to be upgraded.

	May 24 19:11:37 addons-514000 kubelet[2266]:  > table=nat chain=KUBE-KUBELET-CANARY

	May 24 19:11:37 addons-514000 kubelet[2266]: W0524 19:11:37.212355    2266 machine.go:65] Cannot read vendor id correctly, set empty.

	May 24 19:12:37 addons-514000 kubelet[2266]: E0524 19:12:37.207212    2266 iptables.go:575] "Could not set up iptables canary" err=<

	May 24 19:12:37 addons-514000 kubelet[2266]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	May 24 19:12:37 addons-514000 kubelet[2266]:         Perhaps ip6tables or your kernel needs to be upgraded.

	May 24 19:12:37 addons-514000 kubelet[2266]:  > table=nat chain=KUBE-KUBELET-CANARY

	May 24 19:13:37 addons-514000 kubelet[2266]: E0524 19:13:37.206808    2266 iptables.go:575] "Could not set up iptables canary" err=<

	May 24 19:13:37 addons-514000 kubelet[2266]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	May 24 19:13:37 addons-514000 kubelet[2266]:         Perhaps ip6tables or your kernel needs to be upgraded.

	May 24 19:13:37 addons-514000 kubelet[2266]:  > table=nat chain=KUBE-KUBELET-CANARY

	May 24 19:14:37 addons-514000 kubelet[2266]: E0524 19:14:37.206826    2266 iptables.go:575] "Could not set up iptables canary" err=<

	May 24 19:14:37 addons-514000 kubelet[2266]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	May 24 19:14:37 addons-514000 kubelet[2266]:         Perhaps ip6tables or your kernel needs to be upgraded.

	May 24 19:14:37 addons-514000 kubelet[2266]:  > table=nat chain=KUBE-KUBELET-CANARY

	May 24 19:15:37 addons-514000 kubelet[2266]: E0524 19:15:37.206985    2266 iptables.go:575] "Could not set up iptables canary" err=<

	May 24 19:15:37 addons-514000 kubelet[2266]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: ip6tables v1.8.6 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	May 24 19:15:37 addons-514000 kubelet[2266]:         Perhaps ip6tables or your kernel needs to be upgraded.

	May 24 19:15:37 addons-514000 kubelet[2266]:  > table=nat chain=KUBE-KUBELET-CANARY

	* 

	* ==> storage-provisioner [c6d1bdca910b] <==

	* I0524 18:36:52.162540       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0524 18:36:52.179095       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0524 18:36:52.179236       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I0524 18:36:52.184538       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0524 18:36:52.185437       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-514000_06403223-0fe7-4b51-9128-30a4ab7aa15a!

	I0524 18:36:52.187871       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"6d6698b6-9eb5-4aee-aab5-f9c270917482", APIVersion:"v1", ResourceVersion:"417", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-514000_06403223-0fe7-4b51-9128-30a4ab7aa15a became leader

	I0524 18:36:52.285999       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-514000_06403223-0fe7-4b51-9128-30a4ab7aa15a!

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-darwin-arm64 status --format={{.APIServer}} -p addons-514000 -n addons-514000

helpers_test.go:261: (dbg) Run:  kubectl --context addons-514000 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:285: <<< TestAddons/parallel/CSI FAILED: end of post-mortem logs <<<

helpers_test.go:286: ---------------------/post-mortem---------------------------------

--- FAIL: TestAddons/parallel/CSI (670.89s)