=== RUN   TestDownloadOnly/v1.14.0/preload-exists

aaa_download_only_test.go:105: failed to verify preloaded tarball file exists: stat /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.14.0-docker-overlay2-amd64.tar.lz4: no such file or directory

--- FAIL: TestDownloadOnly/v1.14.0/preload-exists (0.19s)

=== RUN   TestAddons

addons_test.go:75: (dbg) Run:  out/minikube-darwin-amd64 start -p addons-20210813131532-8053 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=olm --addons=volumesnapshots --addons=csi-hostpath-driver --driver=docker  --addons=helm-tiller --addons=gcp-auth

addons_test.go:75: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p addons-20210813131532-8053 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=olm --addons=volumesnapshots --addons=csi-hostpath-driver --driver=docker  --addons=helm-tiller --addons=gcp-auth: exit status 1 (1m43.691956333s)

-- stdout --

	* [addons-20210813131532-8053] minikube v1.22.0 on Darwin 11.2.3

	  - MINIKUBE_LOCATION=12230

	  - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube

	* Using the docker driver based on user configuration

	* Starting control plane node addons-20210813131532-8053 in cluster addons-20210813131532-8053

	* Pulling base image ...

	* Creating docker container (CPUs=2, Memory=4000MB) ...

	* Preparing Kubernetes v1.21.3 on Docker 20.10.8 ...

	  - Generating certificates and keys ...

	  - Booting up control plane ...

	  - Configuring RBAC rules ...

	* Verifying Kubernetes components...

	  - Using image k8s.gcr.io/sig-storage/snapshot-controller:v4.0.0

	  - Using image gcr.io/kubernetes-helm/tiller:v2.16.12

	  - Using image k8s.gcr.io/metrics-server/metrics-server:v0.4.2

	  - Using image k8s.gcr.io/sig-storage/csi-resizer:v1.1.0

	  - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	  - Using image k8s.gcr.io/sig-storage/csi-attacher:v3.1.0

	  - Using image quay.io/operator-framework/olm:v0.17.0

	  - Using image quay.io/operator-framework/upstream-community-operators:07bbc13

	  - Using image k8s.gcr.io/sig-storage/csi-external-health-monitor-controller:v0.2.0

	  - Using image k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.0.1

-- /stdout --

** stderr ** 

	I0813 13:15:32.082075    8363 out.go:298] Setting OutFile to fd 1 ...

	I0813 13:15:32.082204    8363 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0813 13:15:32.082208    8363 out.go:311] Setting ErrFile to fd 2...

	I0813 13:15:32.082210    8363 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0813 13:15:32.082292    8363 root.go:313] Updating PATH: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/bin

	I0813 13:15:32.082621    8363 out.go:305] Setting JSON to false

	I0813 13:15:32.100597    8363 start.go:111] hostinfo: {"hostname":"37309.local","uptime":4507,"bootTime":1628881225,"procs":319,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"11.2.3","kernelVersion":"20.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"c86236b2-4976-3542-80ca-74a6b8b4ba03"}

	W0813 13:15:32.100698    8363 start.go:119] gopshost.Virtualization returned error: not implemented yet

	I0813 13:15:32.127906    8363 out.go:177] * [addons-20210813131532-8053] minikube v1.22.0 on Darwin 11.2.3

	I0813 13:15:32.128044    8363 notify.go:169] Checking for updates...

	I0813 13:15:32.175336    8363 out.go:177]   - MINIKUBE_LOCATION=12230

	I0813 13:15:32.201299    8363 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/kubeconfig

	I0813 13:15:32.227199    8363 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64

	I0813 13:15:32.253273    8363 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube

	I0813 13:15:32.253502    8363 driver.go:335] Setting default libvirt URI to qemu:///system

	I0813 13:15:32.346665    8363 docker.go:132] docker version: linux-20.10.6

	I0813 13:15:32.346801    8363 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I0813 13:15:32.522176    8363 info.go:263] docker info: {ID:43SM:MII3:NWBL:WJUG:JMKA:JL3W:EOOO:ZEGZ:7ZJH:ECYZ:GXPQ:XAL7 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:18 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:41 OomKillDisable:true NGoroutines:45 SystemTime:2021-08-13 20:15:32.459061361 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.25-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServer

Address:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6234726400 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.6 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05f951a3781f4f2c1911b05e61c160e9c30eaa8e Expected:05f951a3781f4f2c1911b05e61c160e9c30eaa8e} RuncCommit:{ID:12644e614e25b05da6fd08a38ffa0cfe1903fdec Expected:12644e614e25b05da6fd08a38ffa0cfe1903fdec} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=sec

comp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/local/lib/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Build with BuildKit Vendor:Docker Inc. Version:v0.5.1-docker] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:2.0.0-beta.1] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.8.0]] Warnings:<nil>}}

	I0813 13:15:32.549117    8363 out.go:177] * Using the docker driver based on user configuration

	I0813 13:15:32.549220    8363 start.go:278] selected driver: docker

	I0813 13:15:32.549232    8363 start.go:751] validating driver "docker" against <nil>

	I0813 13:15:32.549291    8363 start.go:762] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}

	I0813 13:15:32.553081    8363 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I0813 13:15:32.724826    8363 info.go:263] docker info: {ID:43SM:MII3:NWBL:WJUG:JMKA:JL3W:EOOO:ZEGZ:7ZJH:ECYZ:GXPQ:XAL7 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:18 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:41 OomKillDisable:true NGoroutines:45 SystemTime:2021-08-13 20:15:32.663505124 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.25-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServer

Address:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6234726400 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.6 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05f951a3781f4f2c1911b05e61c160e9c30eaa8e Expected:05f951a3781f4f2c1911b05e61c160e9c30eaa8e} RuncCommit:{ID:12644e614e25b05da6fd08a38ffa0cfe1903fdec Expected:12644e614e25b05da6fd08a38ffa0cfe1903fdec} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=sec

comp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/local/lib/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Build with BuildKit Vendor:Docker Inc. Version:v0.5.1-docker] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:2.0.0-beta.1] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.8.0]] Warnings:<nil>}}

	I0813 13:15:32.724926    8363 start_flags.go:263] no existing cluster config was found, will generate one from the flags 

	I0813 13:15:32.725054    8363 start_flags.go:697] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0813 13:15:32.725070    8363 cni.go:93] Creating CNI manager for ""

	I0813 13:15:32.725077    8363 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I0813 13:15:32.725081    8363 start_flags.go:277] config:

	{Name:addons-20210813131532-8053 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.21.3 ClusterName:addons-20210813131532-8053 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntim

e:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0813 13:15:32.752254    8363 out.go:177] * Starting control plane node addons-20210813131532-8053 in cluster addons-20210813131532-8053

	I0813 13:15:32.752315    8363 cache.go:117] Beginning downloading kic base image for docker with docker

	I0813 13:15:32.800633    8363 out.go:177] * Pulling base image ...

	I0813 13:15:32.800735    8363 preload.go:131] Checking if preload exists for k8s version v1.21.3 and runtime docker

	I0813 13:15:32.800821    8363 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 in local docker daemon

	I0813 13:15:32.800817    8363 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.3-docker-overlay2-amd64.tar.lz4

	I0813 13:15:32.800849    8363 cache.go:56] Caching tarball of preloaded images

	I0813 13:15:32.801038    8363 preload.go:173] Found /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I0813 13:15:32.801060    8363 cache.go:59] Finished verifying existence of preloaded tar for  v1.21.3 on docker

	I0813 13:15:32.803628    8363 profile.go:148] Saving config to /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813131532-8053/config.json ...

	I0813 13:15:32.803690    8363 lock.go:36] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813131532-8053/config.json: {Name:mkf6943fb45c9f165fbcd32dbf70ebed4263905e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 13:15:32.913936    8363 cache.go:145] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 to local cache

	I0813 13:15:32.914052    8363 image.go:59] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 in local cache directory

	I0813 13:15:32.914070    8363 image.go:62] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 in local cache directory, skipping pull

	I0813 13:15:32.914075    8363 image.go:103] gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 exists in cache, skipping pull

	I0813 13:15:32.914084    8363 cache.go:148] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 as a tarball

	I0813 13:15:32.914088    8363 cache.go:159] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 from local cache

	I0813 13:15:51.148901    8363 cache.go:162] successfully loaded gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 from cached tarball

	I0813 13:15:51.148925    8363 cache.go:205] Successfully downloaded all kic artifacts

	I0813 13:15:51.148971    8363 start.go:313] acquiring machines lock for addons-20210813131532-8053: {Name:mk8a4772fdba699715d09c4226c86ded500586b7 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0813 13:15:51.149204    8363 start.go:317] acquired machines lock for "addons-20210813131532-8053" in 218.844µs

	I0813 13:15:51.149251    8363 start.go:89] Provisioning new machine with config: &{Name:addons-20210813131532-8053 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.21.3 ClusterName:addons-20210813131532-8053 Namespace:default APIServerName:mi

nikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.21.3 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0} &{Name: IP: Port:8443 KubernetesVersion:v1.21.3 ControlPlane:true Worker:true}

	I0813 13:15:51.149303    8363 start.go:126] createHost starting for "" (driver="docker")

	I0813 13:15:51.175737    8363 out.go:204] * Creating docker container (CPUs=2, Memory=4000MB) ...

	I0813 13:15:51.175956    8363 start.go:160] libmachine.API.Create for "addons-20210813131532-8053" (driver="docker")

	I0813 13:15:51.175979    8363 client.go:168] LocalClient.Create starting

	I0813 13:15:51.176140    8363 main.go:130] libmachine: Creating CA: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem

	I0813 13:15:51.311789    8363 main.go:130] libmachine: Creating client certificate: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/cert.pem

	I0813 13:15:51.469011    8363 cli_runner.go:115] Run: docker network inspect addons-20210813131532-8053 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W0813 13:15:51.581493    8363 cli_runner.go:162] docker network inspect addons-20210813131532-8053 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I0813 13:15:51.581621    8363 network_create.go:255] running [docker network inspect addons-20210813131532-8053] to gather additional debugging logs...

	I0813 13:15:51.581641    8363 cli_runner.go:115] Run: docker network inspect addons-20210813131532-8053

	W0813 13:15:51.689078    8363 cli_runner.go:162] docker network inspect addons-20210813131532-8053 returned with exit code 1

	I0813 13:15:51.689107    8363 network_create.go:258] error running [docker network inspect addons-20210813131532-8053]: docker network inspect addons-20210813131532-8053: exit status 1

	stdout:

	[]

	stderr:

	Error: No such network: addons-20210813131532-8053

	I0813 13:15:51.689125    8363 network_create.go:260] output of [docker network inspect addons-20210813131532-8053]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error: No such network: addons-20210813131532-8053

	** /stderr **

	I0813 13:15:51.689216    8363 cli_runner.go:115] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I0813 13:15:51.797334    8363 network.go:288] reserving subnet 192.168.49.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.49.0:0xc0005e6210] misses:0}

	I0813 13:15:51.797371    8363 network.go:235] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}

	I0813 13:15:51.797392    8363 network_create.go:106] attempt to create docker network addons-20210813131532-8053 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...

	I0813 13:15:51.797476    8363 cli_runner.go:115] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true addons-20210813131532-8053

	I0813 13:15:55.690252    8363 cli_runner.go:168] Completed: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true addons-20210813131532-8053: (3.886272168s)

	I0813 13:15:55.690287    8363 network_create.go:90] docker network addons-20210813131532-8053 192.168.49.0/24 created

	I0813 13:15:55.690304    8363 kic.go:106] calculated static IP "192.168.49.2" for the "addons-20210813131532-8053" container

	I0813 13:15:55.690432    8363 cli_runner.go:115] Run: docker ps -a --format {{.Names}}

	I0813 13:15:55.798375    8363 cli_runner.go:115] Run: docker volume create addons-20210813131532-8053 --label name.minikube.sigs.k8s.io=addons-20210813131532-8053 --label created_by.minikube.sigs.k8s.io=true

	I0813 13:15:55.907908    8363 oci.go:102] Successfully created a docker volume addons-20210813131532-8053

	I0813 13:15:55.908118    8363 cli_runner.go:115] Run: docker run --rm --name addons-20210813131532-8053-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-20210813131532-8053 --entrypoint /usr/bin/test -v addons-20210813131532-8053:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 -d /var/lib

	I0813 13:15:57.814364    8363 cli_runner.go:168] Completed: docker run --rm --name addons-20210813131532-8053-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-20210813131532-8053 --entrypoint /usr/bin/test -v addons-20210813131532-8053:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 -d /var/lib: (1.90359976s)

	I0813 13:15:57.814386    8363 oci.go:106] Successfully prepared a docker volume addons-20210813131532-8053

	I0813 13:15:57.814450    8363 preload.go:131] Checking if preload exists for k8s version v1.21.3 and runtime docker

	I0813 13:15:57.814471    8363 kic.go:179] Starting extracting preloaded images to volume ...

	I0813 13:15:57.814510    8363 cli_runner.go:115] Run: docker info --format "'{{json .SecurityOptions}}'"

	I0813 13:15:57.814556    8363 cli_runner.go:115] Run: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.3-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v addons-20210813131532-8053:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 -I lz4 -xf /preloaded.tar -C /extractDir

	I0813 13:15:58.005020    8363 cli_runner.go:115] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-20210813131532-8053 --name addons-20210813131532-8053 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-20210813131532-8053 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-20210813131532-8053 --network addons-20210813131532-8053 --ip 192.168.49.2 --volume addons-20210813131532-8053:/var --security-opt apparmor=unconfined --memory=4000mb --memory-swap=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6

	I0813 13:16:04.148370    8363 cli_runner.go:168] Completed: docker run --rm --entrypoint /usr/bin/tar -v /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.3-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v addons-20210813131532-8053:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 -I lz4 -xf /preloaded.tar -C /extractDir: (6.327155519s)

	I0813 13:16:04.148397    8363 kic.go:188] duration metric: took 6.327324 seconds to extract preloaded images to volume

	I0813 13:16:06.707846    8363 cli_runner.go:168] Completed: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-20210813131532-8053 --name addons-20210813131532-8053 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-20210813131532-8053 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-20210813131532-8053 --network addons-20210813131532-8053 --ip 192.168.49.2 --volume addons-20210813131532-8053:/var --security-opt apparmor=unconfined --memory=4000mb --memory-swap=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6: (8.694386676s)

	I0813 13:16:06.707960    8363 cli_runner.go:115] Run: docker container inspect addons-20210813131532-8053 --format={{.State.Running}}

	I0813 13:16:06.822189    8363 cli_runner.go:115] Run: docker container inspect addons-20210813131532-8053 --format={{.State.Status}}

	I0813 13:16:06.932087    8363 cli_runner.go:115] Run: docker exec addons-20210813131532-8053 stat /var/lib/dpkg/alternatives/iptables

	I0813 13:16:07.114383    8363 oci.go:278] the created container "addons-20210813131532-8053" has a running status.

	I0813 13:16:07.114409    8363 kic.go:210] Creating ssh key for kic: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/addons-20210813131532-8053/id_rsa...

	I0813 13:16:07.197038    8363 kic_runner.go:188] docker (temp): /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/addons-20210813131532-8053/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)

	I0813 13:16:07.363149    8363 cli_runner.go:115] Run: docker container inspect addons-20210813131532-8053 --format={{.State.Status}}

	I0813 13:16:07.474992    8363 kic_runner.go:94] Run: chown docker:docker /home/docker/.ssh/authorized_keys

	I0813 13:16:07.475016    8363 kic_runner.go:115] Args: [docker exec --privileged addons-20210813131532-8053 chown docker:docker /home/docker/.ssh/authorized_keys]

	I0813 13:16:07.632451    8363 cli_runner.go:115] Run: docker container inspect addons-20210813131532-8053 --format={{.State.Status}}

	I0813 13:16:07.746212    8363 machine.go:88] provisioning docker machine ...

	I0813 13:16:07.746251    8363 ubuntu.go:169] provisioning hostname "addons-20210813131532-8053"

	I0813 13:16:07.746353    8363 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-20210813131532-8053

	I0813 13:16:07.859818    8363 main.go:130] libmachine: Using SSH client type: native

	I0813 13:16:07.860041    8363 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x13fa2e0] 0x13fa2a0 <nil>  [] 0s} 127.0.0.1 58213 <nil> <nil>}

	I0813 13:16:07.860051    8363 main.go:130] libmachine: About to run SSH command:

	sudo hostname addons-20210813131532-8053 && echo "addons-20210813131532-8053" | sudo tee /etc/hostname

	I0813 13:16:07.861320    8363 main.go:130] libmachine: Error dialing TCP: ssh: handshake failed: EOF

	I0813 13:16:11.006607    8363 main.go:130] libmachine: SSH cmd err, output: <nil>: addons-20210813131532-8053

	I0813 13:16:11.006710    8363 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-20210813131532-8053

	I0813 13:16:11.118378    8363 main.go:130] libmachine: Using SSH client type: native

	I0813 13:16:11.118561    8363 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x13fa2e0] 0x13fa2a0 <nil>  [] 0s} 127.0.0.1 58213 <nil> <nil>}

	I0813 13:16:11.118581    8363 main.go:130] libmachine: About to run SSH command:

			if ! grep -xq '.*\saddons-20210813131532-8053' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-20210813131532-8053/g' /etc/hosts;

				else 

					echo '127.0.1.1 addons-20210813131532-8053' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0813 13:16:11.244779    8363 main.go:130] libmachine: SSH cmd err, output: <nil>: 

	I0813 13:16:11.244798    8363 ubuntu.go:175] set auth options {CertDir:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube CaCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/se

rver.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube}

	I0813 13:16:11.244820    8363 ubuntu.go:177] setting up certificates

	I0813 13:16:11.244826    8363 provision.go:83] configureAuth start

	I0813 13:16:11.244911    8363 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-20210813131532-8053

	I0813 13:16:11.357270    8363 provision.go:138] copyHostCerts

	I0813 13:16:11.357376    8363 exec_runner.go:152] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cert.pem (1123 bytes)

	I0813 13:16:11.357609    8363 exec_runner.go:152] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/key.pem (1675 bytes)

	I0813 13:16:11.357772    8363 exec_runner.go:152] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.pem (1082 bytes)

	I0813 13:16:11.357896    8363 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca-key.pem org=jenkins.addons-20210813131532-8053 san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube addons-20210813131532-8053]

	I0813 13:16:11.431353    8363 provision.go:172] copyRemoteCerts

	I0813 13:16:11.431411    8363 ssh_runner.go:149] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0813 13:16:11.431478    8363 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-20210813131532-8053

	I0813 13:16:11.545283    8363 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:58213 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/addons-20210813131532-8053/id_rsa Username:docker}

	I0813 13:16:11.633519    8363 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0813 13:16:11.650518    8363 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server.pem --> /etc/docker/server.pem (1253 bytes)

	I0813 13:16:11.667948    8363 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I0813 13:16:11.684226    8363 provision.go:86] duration metric: configureAuth took 439.1518ms

	I0813 13:16:11.684239    8363 ubuntu.go:193] setting minikube options for container-runtime

	I0813 13:16:11.684388    8363 config.go:177] Loaded profile config "addons-20210813131532-8053": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.21.3

	I0813 13:16:11.684478    8363 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-20210813131532-8053

	I0813 13:16:11.796351    8363 main.go:130] libmachine: Using SSH client type: native

	I0813 13:16:11.796567    8363 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x13fa2e0] 0x13fa2a0 <nil>  [] 0s} 127.0.0.1 58213 <nil> <nil>}

	I0813 13:16:11.796577    8363 main.go:130] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0813 13:16:11.928428    8363 main.go:130] libmachine: SSH cmd err, output: <nil>: overlay

	I0813 13:16:11.928446    8363 ubuntu.go:71] root file system type: overlay

	I0813 13:16:11.928595    8363 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I0813 13:16:11.928693    8363 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-20210813131532-8053

	I0813 13:16:12.039241    8363 main.go:130] libmachine: Using SSH client type: native

	I0813 13:16:12.039410    8363 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x13fa2e0] 0x13fa2a0 <nil>  [] 0s} 127.0.0.1 58213 <nil> <nil>}

	I0813 13:16:12.039466    8363 main.go:130] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %s "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0813 13:16:12.181903    8363 main.go:130] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0813 13:16:12.182024    8363 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-20210813131532-8053

	I0813 13:16:12.293523    8363 main.go:130] libmachine: Using SSH client type: native

	I0813 13:16:12.293678    8363 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x13fa2e0] 0x13fa2a0 <nil>  [] 0s} 127.0.0.1 58213 <nil> <nil>}

	I0813 13:16:12.293691    8363 main.go:130] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0813 13:16:35.390432    8363 main.go:130] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service	2021-07-30 19:52:33.000000000 +0000

	+++ /lib/systemd/system/docker.service.new	2021-08-13 20:16:12.171777171 +0000

	@@ -1,30 +1,32 @@

	 [Unit]

	 Description=Docker Application Container Engine

	 Documentation=https://docs.docker.com

	+BindsTo=containerd.service

	 After=network-online.target firewalld.service containerd.service

	 Wants=network-online.target

	-Requires=docker.socket containerd.service

	+Requires=docker.socket

	+StartLimitBurst=3

	+StartLimitIntervalSec=60

	 [Service]

	 Type=notify

	-# the default is not to use systemd for cgroups because the delegate issues still

	-# exists and systemd currently does not support the cgroup feature set required

	-# for containers run by docker

	-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock

	-ExecReload=/bin/kill -s HUP $MAINPID

	-TimeoutSec=0

	-RestartSec=2

	-Restart=always

	-

	-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.

	-# Both the old, and new location are accepted by systemd 229 and up, so using the old location

	-# to make them work for either version of systemd.

	-StartLimitBurst=3

	+Restart=on-failure

	-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.

	-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make

	-# this option work for either version of systemd.

	-StartLimitInterval=60s

	+

	+

	+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	+# The base configuration already specifies an 'ExecStart=...' command. The first directive

	+# here is to clear out that command inherited from the base configuration. Without this,

	+# the command from the base configuration and the command specified here are treated as

	+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	+# will catch this invalid input and refuse to start the service with an error like:

	+#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	+

	+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	+ExecStart=

	+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	+ExecReload=/bin/kill -s HUP $MAINPID

	 # Having non-zero Limit*s causes performance problems due to accounting overhead

	 # in the kernel. We recommend using cgroups to do container-local accounting.

	@@ -32,16 +34,16 @@

	 LimitNPROC=infinity

	 LimitCORE=infinity

	-# Comment TasksMax if your systemd version does not support it.

	-# Only systemd 226 and above support this option.

	+# Uncomment TasksMax if your systemd version supports it.

	+# Only systemd 226 and above support this version.

	 TasksMax=infinity

	+TimeoutStartSec=0

	 # set delegate yes so that systemd does not reset the cgroups of docker containers

	 Delegate=yes

	 # kill only the docker process, not all processes in the cgroup

	 KillMode=process

	-OOMScoreAdjust=-500

	 [Install]

	 WantedBy=multi-user.target

	Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.

	Executing: /lib/systemd/systemd-sysv-install enable docker

	I0813 13:16:35.390461    8363 machine.go:91] provisioned docker machine in 27.635533797s

	I0813 13:16:35.390473    8363 client.go:171] LocalClient.Create took 44.185948315s

	I0813 13:16:35.390490    8363 start.go:168] duration metric: libmachine.API.Create for "addons-20210813131532-8053" took 44.185991609s

	I0813 13:16:35.390503    8363 start.go:267] post-start starting for "addons-20210813131532-8053" (driver="docker")

	I0813 13:16:35.390510    8363 start.go:277] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0813 13:16:35.390651    8363 ssh_runner.go:149] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0813 13:16:35.390759    8363 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-20210813131532-8053

	I0813 13:16:35.501194    8363 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:58213 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/addons-20210813131532-8053/id_rsa Username:docker}

	I0813 13:16:35.593499    8363 ssh_runner.go:149] Run: cat /etc/os-release

	I0813 13:16:35.597245    8363 main.go:130] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found

	I0813 13:16:35.597260    8363 main.go:130] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found

	I0813 13:16:35.597283    8363 main.go:130] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found

	I0813 13:16:35.597291    8363 info.go:137] Remote host: Ubuntu 20.04.2 LTS

	I0813 13:16:35.597308    8363 filesync.go:126] Scanning /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/addons for local assets ...

	I0813 13:16:35.597400    8363 filesync.go:126] Scanning /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files for local assets ...

	I0813 13:16:35.597446    8363 start.go:270] post-start completed in 206.913474ms

	I0813 13:16:35.597893    8363 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-20210813131532-8053

	I0813 13:16:35.707407    8363 profile.go:148] Saving config to /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813131532-8053/config.json ...

	I0813 13:16:35.707840    8363 ssh_runner.go:149] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0813 13:16:35.707908    8363 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-20210813131532-8053

	I0813 13:16:35.819818    8363 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:58213 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/addons-20210813131532-8053/id_rsa Username:docker}

	I0813 13:16:35.908911    8363 start.go:129] duration metric: createHost completed in 44.730943165s

	I0813 13:16:35.908930    8363 start.go:80] releasing machines lock for "addons-20210813131532-8053", held for 44.7310635s

	I0813 13:16:35.909050    8363 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-20210813131532-8053

	I0813 13:16:36.016713    8363 ssh_runner.go:149] Run: curl -sS -m 2 https://k8s.gcr.io/

	I0813 13:16:36.016721    8363 ssh_runner.go:149] Run: systemctl --version

	I0813 13:16:36.016795    8363 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-20210813131532-8053

	I0813 13:16:36.016802    8363 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-20210813131532-8053

	I0813 13:16:36.135698    8363 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:58213 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/addons-20210813131532-8053/id_rsa Username:docker}

	I0813 13:16:36.135906    8363 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:58213 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/addons-20210813131532-8053/id_rsa Username:docker}

	I0813 13:16:36.330280    8363 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service containerd

	I0813 13:16:36.339097    8363 ssh_runner.go:149] Run: sudo systemctl cat docker.service

	I0813 13:16:36.348260    8363 cruntime.go:249] skipping containerd shutdown because we are bound to it

	I0813 13:16:36.348321    8363 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service crio

	I0813 13:16:36.356942    8363 ssh_runner.go:149] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/dockershim.sock

	image-endpoint: unix:///var/run/dockershim.sock

	" | sudo tee /etc/crictl.yaml"

	I0813 13:16:36.368699    8363 ssh_runner.go:149] Run: sudo systemctl unmask docker.service

	I0813 13:16:36.421640    8363 ssh_runner.go:149] Run: sudo systemctl enable docker.socket

	I0813 13:16:36.472839    8363 ssh_runner.go:149] Run: sudo systemctl cat docker.service

	I0813 13:16:36.482151    8363 ssh_runner.go:149] Run: sudo systemctl daemon-reload

	I0813 13:16:36.534178    8363 ssh_runner.go:149] Run: sudo systemctl start docker

	I0813 13:16:36.543814    8363 ssh_runner.go:149] Run: docker version --format {{.Server.Version}}

	I0813 13:16:36.580918    8363 ssh_runner.go:149] Run: docker version --format {{.Server.Version}}

	I0813 13:16:36.646849    8363 out.go:204] * Preparing Kubernetes v1.21.3 on Docker 20.10.8 ...

	I0813 13:16:36.647054    8363 cli_runner.go:115] Run: docker exec -t addons-20210813131532-8053 dig +short host.docker.internal

	I0813 13:16:36.825177    8363 network.go:69] got host ip for mount in container by digging dns: 192.168.65.2

	I0813 13:16:36.825267    8363 ssh_runner.go:149] Run: grep 192.168.65.2	host.minikube.internal$ /etc/hosts

	I0813 13:16:36.829548    8363 ssh_runner.go:149] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.2	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0813 13:16:36.838558    8363 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" addons-20210813131532-8053

	I0813 13:16:36.948641    8363 preload.go:131] Checking if preload exists for k8s version v1.21.3 and runtime docker

	I0813 13:16:36.948726    8363 ssh_runner.go:149] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0813 13:16:36.976094    8363 docker.go:535] Got preloaded images: -- stdout --

	k8s.gcr.io/kube-apiserver:v1.21.3

	k8s.gcr.io/kube-scheduler:v1.21.3

	k8s.gcr.io/kube-proxy:v1.21.3

	k8s.gcr.io/kube-controller-manager:v1.21.3

	gcr.io/k8s-minikube/storage-provisioner:v5

	k8s.gcr.io/pause:3.4.1

	kubernetesui/dashboard:v2.1.0

	k8s.gcr.io/coredns/coredns:v1.8.0

	k8s.gcr.io/etcd:3.4.13-0

	kubernetesui/metrics-scraper:v1.0.4

	-- /stdout --

	I0813 13:16:36.976106    8363 docker.go:466] Images already preloaded, skipping extraction

	I0813 13:16:36.976198    8363 ssh_runner.go:149] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0813 13:16:37.004958    8363 docker.go:535] Got preloaded images: -- stdout --

	k8s.gcr.io/kube-apiserver:v1.21.3

	k8s.gcr.io/kube-scheduler:v1.21.3

	k8s.gcr.io/kube-controller-manager:v1.21.3

	k8s.gcr.io/kube-proxy:v1.21.3

	gcr.io/k8s-minikube/storage-provisioner:v5

	k8s.gcr.io/pause:3.4.1

	kubernetesui/dashboard:v2.1.0

	k8s.gcr.io/coredns/coredns:v1.8.0

	k8s.gcr.io/etcd:3.4.13-0

	kubernetesui/metrics-scraper:v1.0.4

	-- /stdout --

	I0813 13:16:37.004979    8363 cache_images.go:74] Images are preloaded, skipping loading

	I0813 13:16:37.005081    8363 ssh_runner.go:149] Run: docker info --format {{.CgroupDriver}}

	I0813 13:16:37.081255    8363 cni.go:93] Creating CNI manager for ""

	I0813 13:16:37.081271    8363 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I0813 13:16:37.081294    8363 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I0813 13:16:37.081314    8363 kubeadm.go:153] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.21.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-20210813131532-8053 NodeName:addons-20210813131532-8053 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/mi

nikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}

	I0813 13:16:37.081477    8363 kubeadm.go:157] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.49.2

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: /var/run/dockershim.sock

	  name: "addons-20210813131532-8053"

	  kubeletExtraArgs:

	    node-ip: 192.168.49.2

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	dns:

	  type: CoreDNS

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.21.3

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%"

	  nodefs.inodesFree: "0%"

	  imagefs.available: "0%"

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0813 13:16:37.081591    8363 kubeadm.go:909] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.21.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=addons-20210813131532-8053 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2

	[Install]

	 config:

	{KubernetesVersion:v1.21.3 ClusterName:addons-20210813131532-8053 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I0813 13:16:37.081670    8363 ssh_runner.go:149] Run: sudo ls /var/lib/minikube/binaries/v1.21.3

	I0813 13:16:37.090118    8363 binaries.go:44] Found k8s binaries, skipping transfer

	I0813 13:16:37.090175    8363 ssh_runner.go:149] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0813 13:16:37.096869    8363 ssh_runner.go:316] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (352 bytes)

	I0813 13:16:37.130797    8363 ssh_runner.go:316] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0813 13:16:37.142108    8363 ssh_runner.go:316] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2069 bytes)

	I0813 13:16:37.153672    8363 ssh_runner.go:149] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts

	I0813 13:16:37.158021    8363 ssh_runner.go:149] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0813 13:16:37.167002    8363 certs.go:52] Setting up /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813131532-8053 for IP: 192.168.49.2

	I0813 13:16:37.167045    8363 certs.go:183] generating minikubeCA CA: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.key

	I0813 13:16:37.328758    8363 crypto.go:157] Writing cert to /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt ...

	I0813 13:16:37.328769    8363 lock.go:36] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt: {Name:mk9173625ebaa641ecd8ebc1c7e7c14653c04a0b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 13:16:37.329734    8363 crypto.go:165] Writing key to /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.key ...

	I0813 13:16:37.329753    8363 lock.go:36] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.key: {Name:mk5ab980150a294fe3ebac0533d5f5ff610a433c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 13:16:37.330023    8363 certs.go:183] generating proxyClientCA CA: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.key

	I0813 13:16:37.362237    8363 crypto.go:157] Writing cert to /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.crt ...

	I0813 13:16:37.362245    8363 lock.go:36] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.crt: {Name:mk4c5a4fc9b6b0d0c3a28b8cab4e3382e9cc8473 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 13:16:37.362463    8363 crypto.go:165] Writing key to /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.key ...

	I0813 13:16:37.362472    8363 lock.go:36] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.key: {Name:mk5d5090e9831856716928a5d3a7d00f5d4496be Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 13:16:37.362685    8363 certs.go:297] generating minikube-user signed cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813131532-8053/client.key

	I0813 13:16:37.362693    8363 crypto.go:69] Generating cert /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813131532-8053/client.crt with IP's: []

	I0813 13:16:37.559903    8363 crypto.go:157] Writing cert to /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813131532-8053/client.crt ...

	I0813 13:16:37.559919    8363 lock.go:36] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813131532-8053/client.crt: {Name:mk566110d0024c3dd070b051e56e4335e454f5bc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 13:16:37.560172    8363 crypto.go:165] Writing key to /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813131532-8053/client.key ...

	I0813 13:16:37.560181    8363 lock.go:36] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813131532-8053/client.key: {Name:mkad19b6ab73940df786b5393ed5a09fe6c3f783 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 13:16:37.560361    8363 certs.go:297] generating minikube signed cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813131532-8053/apiserver.key.dd3b5fb2

	I0813 13:16:37.560367    8363 crypto.go:69] Generating cert /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813131532-8053/apiserver.crt.dd3b5fb2 with IP's: [192.168.49.2 10.96.0.1 127.0.0.1 10.0.0.1]

	I0813 13:16:37.655617    8363 crypto.go:157] Writing cert to /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813131532-8053/apiserver.crt.dd3b5fb2 ...

	I0813 13:16:37.655627    8363 lock.go:36] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813131532-8053/apiserver.crt.dd3b5fb2: {Name:mkdf7139538cb2c78d2439f4bdd881a4b32ffe68 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 13:16:37.655853    8363 crypto.go:165] Writing key to /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813131532-8053/apiserver.key.dd3b5fb2 ...

	I0813 13:16:37.655861    8363 lock.go:36] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813131532-8053/apiserver.key.dd3b5fb2: {Name:mkd7b6eeabba6fe3ba13db4516c2e7728bf9b3ea Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 13:16:37.656032    8363 certs.go:308] copying /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813131532-8053/apiserver.crt.dd3b5fb2 -> /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813131532-8053/apiserver.crt

	I0813 13:16:37.656191    8363 certs.go:312] copying /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813131532-8053/apiserver.key.dd3b5fb2 -> /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813131532-8053/apiserver.key

	I0813 13:16:37.656342    8363 certs.go:297] generating aggregator signed cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813131532-8053/proxy-client.key

	I0813 13:16:37.656349    8363 crypto.go:69] Generating cert /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813131532-8053/proxy-client.crt with IP's: []

	I0813 13:16:37.795671    8363 crypto.go:157] Writing cert to /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813131532-8053/proxy-client.crt ...

	I0813 13:16:37.795685    8363 lock.go:36] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813131532-8053/proxy-client.crt: {Name:mkd6b4ec15e1099cd7eb9c873756b6a1437e5c52 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 13:16:37.795953    8363 crypto.go:165] Writing key to /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813131532-8053/proxy-client.key ...

	I0813 13:16:37.795971    8363 lock.go:36] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813131532-8053/proxy-client.key: {Name:mkd1b3200915c9bded5cc4258fd800cb9063f47d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 13:16:37.796368    8363 certs.go:376] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca-key.pem (1675 bytes)

	I0813 13:16:37.796418    8363 certs.go:376] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem (1082 bytes)

	I0813 13:16:37.796457    8363 certs.go:376] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/cert.pem (1123 bytes)

	I0813 13:16:37.796495    8363 certs.go:376] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/key.pem (1675 bytes)

	I0813 13:16:37.797300    8363 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813131532-8053/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I0813 13:16:37.814114    8363 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813131532-8053/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I0813 13:16:37.831090    8363 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813131532-8053/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0813 13:16:37.847754    8363 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/addons-20210813131532-8053/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0813 13:16:37.863348    8363 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0813 13:16:37.879521    8363 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I0813 13:16:37.895106    8363 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0813 13:16:37.910732    8363 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I0813 13:16:37.925926    8363 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0813 13:16:37.941672    8363 ssh_runner.go:316] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0813 13:16:37.953068    8363 ssh_runner.go:149] Run: openssl version

	I0813 13:16:37.958219    8363 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0813 13:16:37.966974    8363 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0813 13:16:37.970675    8363 certs.go:419] hashing: -rw-r--r-- 1 root root 1111 Aug 13 20:16 /usr/share/ca-certificates/minikubeCA.pem

	I0813 13:16:37.970721    8363 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0813 13:16:37.976025    8363 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0813 13:16:37.983449    8363 kubeadm.go:390] StartCluster: {Name:addons-20210813131532-8053 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.21.3 ClusterName:addons-20210813131532-8053 Namespace:default APIServerName:minikubeCA APIServerName

s:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.21.3 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0813 13:16:37.983552    8363 ssh_runner.go:149] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0813 13:16:38.009966    8363 ssh_runner.go:149] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0813 13:16:38.017218    8363 ssh_runner.go:149] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0813 13:16:38.024088    8363 kubeadm.go:220] ignoring SystemVerification for kubeadm because of docker driver

	I0813 13:16:38.024144    8363 ssh_runner.go:149] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0813 13:16:38.030819    8363 kubeadm.go:151] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0813 13:16:38.030848    8363 ssh_runner.go:240] Start: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.3:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"

	I0813 13:16:38.684197    8363 out.go:204]   - Generating certificates and keys ...

	I0813 13:16:40.811201    8363 out.go:204]   - Booting up control plane ...

	I0813 13:17:00.840329    8363 out.go:204]   - Configuring RBAC rules ...

	I0813 13:17:01.224043    8363 cni.go:93] Creating CNI manager for ""

	I0813 13:17:01.224055    8363 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I0813 13:17:01.224081    8363 ssh_runner.go:149] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0813 13:17:01.224168    8363 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl label nodes minikube.k8s.io/version=v1.22.0 minikube.k8s.io/commit=852050cf77fe767e86d5a194bb91c06c4dc6c13c minikube.k8s.io/name=addons-20210813131532-8053 minikube.k8s.io/updated_at=2021_08_13T13_17_01_0700 --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 13:17:01.224172    8363 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 13:17:01.398152    8363 ops.go:34] apiserver oom_adj: -16

	I0813 13:17:01.398252    8363 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 13:17:01.963239    8363 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 13:17:02.464313    8363 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 13:17:02.969198    8363 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 13:17:03.463345    8363 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 13:17:03.968368    8363 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 13:17:04.464923    8363 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 13:17:04.963185    8363 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 13:17:05.463824    8363 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 13:17:05.965013    8363 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 13:17:06.463719    8363 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 13:17:06.970322    8363 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 13:17:07.464595    8363 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 13:17:07.967292    8363 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 13:17:08.464964    8363 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 13:17:08.964069    8363 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 13:17:09.467384    8363 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 13:17:09.969693    8363 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 13:17:10.463773    8363 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 13:17:10.964306    8363 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 13:17:11.463450    8363 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 13:17:11.964789    8363 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 13:17:12.470883    8363 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 13:17:12.964775    8363 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 13:17:13.463649    8363 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 13:17:13.972169    8363 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 13:17:14.463497    8363 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0813 13:17:14.525352    8363 kubeadm.go:985] duration metric: took 13.301042912s to wait for elevateKubeSystemPrivileges.

	I0813 13:17:14.525368    8363 kubeadm.go:392] StartCluster complete in 36.540493743s

	I0813 13:17:14.525380    8363 settings.go:142] acquiring lock: {Name:mkea671a8cf1619d5bb0d33f936826680e87cf9b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 13:17:14.525544    8363 settings.go:150] Updating kubeconfig:  /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/kubeconfig

	I0813 13:17:14.526407    8363 lock.go:36] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/kubeconfig: {Name:mk2e9f304ce9a26dabf1dc11ded078755e07052d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 13:17:15.046045    8363 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "addons-20210813131532-8053" rescaled to 1

	I0813 13:17:15.046084    8363 ssh_runner.go:149] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.21.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0813 13:17:15.046090    8363 start.go:226] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.21.3 ControlPlane:true Worker:true}

	I0813 13:17:15.046131    8363 addons.go:342] enableAddons start: toEnable=map[], additional=[registry metrics-server olm volumesnapshots csi-hostpath-driver helm-tiller gcp-auth]

	I0813 13:17:15.074379    8363 out.go:177] * Verifying Kubernetes components...

	I0813 13:17:15.046260    8363 config.go:177] Loaded profile config "addons-20210813131532-8053": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.21.3

	I0813 13:17:15.074454    8363 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service kubelet

	I0813 13:17:15.074459    8363 addons.go:59] Setting default-storageclass=true in profile "addons-20210813131532-8053"

	I0813 13:17:15.074468    8363 addons.go:59] Setting storage-provisioner=true in profile "addons-20210813131532-8053"

	I0813 13:17:15.074478    8363 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-20210813131532-8053"

	I0813 13:17:15.074482    8363 addons.go:135] Setting addon storage-provisioner=true in "addons-20210813131532-8053"

	I0813 13:17:15.074483    8363 addons.go:59] Setting gcp-auth=true in profile "addons-20210813131532-8053"

	I0813 13:17:15.074492    8363 addons.go:59] Setting csi-hostpath-driver=true in profile "addons-20210813131532-8053"

	W0813 13:17:15.074494    8363 addons.go:147] addon storage-provisioner should already be in state true

	I0813 13:17:15.074489    8363 addons.go:59] Setting registry=true in profile "addons-20210813131532-8053"

	I0813 13:17:15.074469    8363 addons.go:59] Setting metrics-server=true in profile "addons-20210813131532-8053"

	I0813 13:17:15.074459    8363 addons.go:59] Setting volumesnapshots=true in profile "addons-20210813131532-8053"

	I0813 13:17:15.074516    8363 mustload.go:65] Loading cluster: addons-20210813131532-8053

	I0813 13:17:15.074515    8363 addons.go:135] Setting addon registry=true in "addons-20210813131532-8053"

	I0813 13:17:15.074524    8363 host.go:66] Checking if "addons-20210813131532-8053" exists ...

	I0813 13:17:15.074536    8363 addons.go:59] Setting helm-tiller=true in profile "addons-20210813131532-8053"

	I0813 13:17:15.074544    8363 addons.go:135] Setting addon volumesnapshots=true in "addons-20210813131532-8053"

	I0813 13:17:15.074560    8363 addons.go:135] Setting addon helm-tiller=true in "addons-20210813131532-8053"

	I0813 13:17:15.074525    8363 addons.go:135] Setting addon csi-hostpath-driver=true in "addons-20210813131532-8053"

	I0813 13:17:15.074607    8363 host.go:66] Checking if "addons-20210813131532-8053" exists ...

	I0813 13:17:15.074529    8363 addons.go:135] Setting addon metrics-server=true in "addons-20210813131532-8053"

	I0813 13:17:15.074653    8363 host.go:66] Checking if "addons-20210813131532-8053" exists ...

	I0813 13:17:15.074568    8363 host.go:66] Checking if "addons-20210813131532-8053" exists ...

	I0813 13:17:15.074706    8363 config.go:177] Loaded profile config "addons-20210813131532-8053": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.21.3

	I0813 13:17:15.074711    8363 host.go:66] Checking if "addons-20210813131532-8053" exists ...

	I0813 13:17:15.074551    8363 addons.go:59] Setting olm=true in profile "addons-20210813131532-8053"

	I0813 13:17:15.074766    8363 addons.go:135] Setting addon olm=true in "addons-20210813131532-8053"

	I0813 13:17:15.074573    8363 host.go:66] Checking if "addons-20210813131532-8053" exists ...

	I0813 13:17:15.074901    8363 host.go:66] Checking if "addons-20210813131532-8053" exists ...

	I0813 13:17:15.075081    8363 cli_runner.go:115] Run: docker container inspect addons-20210813131532-8053 --format={{.State.Status}}

	I0813 13:17:15.075137    8363 cli_runner.go:115] Run: docker container inspect addons-20210813131532-8053 --format={{.State.Status}}

	I0813 13:17:15.111670    8363 cli_runner.go:115] Run: docker container inspect addons-20210813131532-8053 --format={{.State.Status}}

	I0813 13:17:15.111703    8363 cli_runner.go:115] Run: docker container inspect addons-20210813131532-8053 --format={{.State.Status}}

	I0813 13:17:15.111710    8363 cli_runner.go:115] Run: docker container inspect addons-20210813131532-8053 --format={{.State.Status}}

	I0813 13:17:15.111741    8363 cli_runner.go:115] Run: docker container inspect addons-20210813131532-8053 --format={{.State.Status}}

	I0813 13:17:15.111746    8363 cli_runner.go:115] Run: docker container inspect addons-20210813131532-8053 --format={{.State.Status}}

	I0813 13:17:15.111751    8363 cli_runner.go:115] Run: docker container inspect addons-20210813131532-8053 --format={{.State.Status}}

	I0813 13:17:15.113416    8363 cli_runner.go:115] Run: docker container inspect addons-20210813131532-8053 --format={{.State.Status}}

	I0813 13:17:15.163885    8363 ssh_runner.go:149] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.21.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.65.2 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.21.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0813 13:17:15.163939    8363 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" addons-20210813131532-8053

	I0813 13:17:15.294057    8363 host.go:66] Checking if "addons-20210813131532-8053" exists ...

	I0813 13:17:15.294513    8363 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" addons-20210813131532-8053

	I0813 13:17:15.332844    8363 addons.go:135] Setting addon default-storageclass=true in "addons-20210813131532-8053"

	W0813 13:17:15.332884    8363 addons.go:147] addon default-storageclass should already be in state true

	I0813 13:17:15.332914    8363 host.go:66] Checking if "addons-20210813131532-8053" exists ...

	I0813 13:17:15.333513    8363 cli_runner.go:115] Run: docker container inspect addons-20210813131532-8053 --format={{.State.Status}}

	I0813 13:17:15.346650    8363 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "5000/tcp") 0).HostPort}}'" addons-20210813131532-8053

	I0813 13:17:15.377409    8363 out.go:177]   - Using image k8s.gcr.io/sig-storage/snapshot-controller:v4.0.0

	I0813 13:17:15.420602    8363 out.go:177]   - Using image gcr.io/kubernetes-helm/tiller:v2.16.12

	I0813 13:17:15.420772    8363 addons.go:275] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml

	I0813 13:17:15.420801    8363 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)

	I0813 13:17:15.420823    8363 addons.go:275] installing /etc/kubernetes/addons/helm-tiller-dp.yaml

	I0813 13:17:15.420835    8363 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/helm-tiller-dp.yaml (2433 bytes)

	I0813 13:17:15.420963    8363 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-20210813131532-8053

	I0813 13:17:15.420974    8363 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-20210813131532-8053

	I0813 13:17:15.490365    8363 out.go:177]   - Using image k8s.gcr.io/metrics-server/metrics-server:v0.4.2

	I0813 13:17:15.453535    8363 out.go:177]   - Using image k8s.gcr.io/sig-storage/csi-resizer:v1.1.0

	I0813 13:17:15.566594    8363 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0813 13:17:15.490508    8363 addons.go:275] installing /etc/kubernetes/addons/metrics-apiservice.yaml

	I0813 13:17:15.566626    8363 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (396 bytes)

	I0813 13:17:15.635588    8363 out.go:177]   - Using image k8s.gcr.io/sig-storage/csi-attacher:v3.1.0

	I0813 13:17:15.566739    8363 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-20210813131532-8053

	I0813 13:17:15.540504    8363 out.go:177]   - Using image quay.io/operator-framework/olm:v0.17.0

	I0813 13:17:15.495930    8363 node_ready.go:35] waiting up to 6m0s for node "addons-20210813131532-8053" to be "Ready" ...

	I0813 13:17:15.566735    8363 addons.go:275] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0813 13:17:15.575574    8363 addons.go:275] installing /etc/kubernetes/addons/storageclass.yaml

	I0813 13:17:15.639391    8363 start.go:728] {"host.minikube.internal": 192.168.65.2} host record injected into CoreDNS

	I0813 13:17:15.661250    8363 out.go:177]   - Using image k8s.gcr.io/sig-storage/csi-external-health-monitor-controller:v0.2.0

	I0813 13:17:15.661283    8363 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0813 13:17:15.661296    8363 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0813 13:17:15.667781    8363 node_ready.go:49] node "addons-20210813131532-8053" has status "Ready":"True"

	I0813 13:17:15.668205    8363 ssh_runner.go:316] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)

	I0813 13:17:15.687466    8363 out.go:177]   - Using image quay.io/operator-framework/upstream-community-operators:07bbc13

	I0813 13:17:15.687603    8363 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-20210813131532-8053

	I0813 13:17:15.687621    8363 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-20210813131532-8053

	I0813 13:17:15.687670    8363 node_ready.go:38] duration metric: took 26.374739ms waiting for node "addons-20210813131532-8053" to be "Ready" ...

	I0813 13:17:15.687696    8363 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0813 13:17:15.729513    8363 out.go:177]   - Using image k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.0.1

	I0813 13:17:15.687603    8363 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-20210813131532-8053

	I0813 13:17:15.711052    8363 addons.go:275] installing /etc/kubernetes/addons/crds.yaml

	I0813 13:17:15.729640    8363 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/crds.yaml (825331 bytes)

	I0813 13:17:15.731958    8363 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-20210813131532-8053

	I0813 13:17:15.735962    8363 main.go:116] stdlog: detect_unix.go:31 open /proc/sys/kernel/osrelease: no such file or directory

** /stderr **

addons_test.go:77: out/minikube-darwin-amd64 start -p addons-20210813131532-8053 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=olm --addons=volumesnapshots --addons=csi-hostpath-driver --driver=docker  --addons=helm-tiller --addons=gcp-auth failed: exit status 1

helpers_test.go:176: Cleaning up "addons-20210813131532-8053" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-darwin-amd64 delete -p addons-20210813131532-8053

helpers_test.go:179: (dbg) Done: out/minikube-darwin-amd64 delete -p addons-20210813131532-8053: (13.110279199s)

--- FAIL: TestAddons (116.83s)

=== RUN   TestCertOptions

=== PAUSE TestCertOptions

=== CONT  TestCertOptions

cert_options_test.go:47: (dbg) Run:  out/minikube-darwin-amd64 start -p cert-options-20210813143549-8053 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --apiserver-name=localhost

=== CONT  TestCertOptions

cert_options_test.go:47: (dbg) Done: out/minikube-darwin-amd64 start -p cert-options-20210813143549-8053 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --apiserver-name=localhost: (51.505808482s)

cert_options_test.go:58: (dbg) Run:  out/minikube-darwin-amd64 -p cert-options-20210813143549-8053 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"

cert_options_test.go:73: (dbg) Run:  kubectl --context cert-options-20210813143549-8053 config view

cert_options_test.go:78: apiserver server port incorrect. Output of 'kubectl config view' = "\n-- stdout --\n\tapiVersion: v1\n\tclusters:\n\t- cluster:\n\t    certificate-authority: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt\n\t    extensions:\n\t    - extension:\n\t        last-update: Fri, 13 Aug 2021 14:36:35 PDT\n\t        provider: minikube.sigs.k8s.io\n\t        version: v1.22.0\n\t      name: cluster_info\n\t    server: https://localhost:63408\n\t  name: cert-options-20210813143549-8053\n\tcontexts:\n\t- context:\n\t    cluster: cert-options-20210813143549-8053\n\t    extensions:\n\t    - extension:\n\t        last-update: Fri, 13 Aug 2021 14:36:35 PDT\n\t        provider: minikube.sigs.k8s.io\n\t        version: v1.22.0\n\t      name: context_info\n\t    namespace: default\n\t    user: cert-options-20210813143549-8053\n\t  name: cert-options-20210813143549-8053\n\tcurrent-context: cert-options-20210813143549-8053\n

\tkind: Config\n\tpreferences: {}\n\tusers:\n\t- name: cert-options-20210813143549-8053\n\t  user:\n\t    client-certificate: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/cert-options-20210813143549-8053/client.crt\n\t    client-key: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/cert-options-20210813143549-8053/client.key\n\n-- /stdout --"

cert_options_test.go:81: *** TestCertOptions FAILED at 2021-08-13 14:36:41.77708 -0700 PDT m=+4925.534422327

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:231: ======>  post-mortem[TestCertOptions]: docker inspect <======

helpers_test.go:232: (dbg) Run:  docker inspect cert-options-20210813143549-8053

helpers_test.go:236: (dbg) docker inspect cert-options-20210813143549-8053:

-- stdout --

	[

	    {

	        "Id": "31f60e55e02d3b7c49d6f153df6c12fa98652958cfe5abee086c87482031b9d4",

	        "Created": "2021-08-13T21:35:52.803212377Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

	        ],

	        "State": {

	            "Status": "running",

	            "Running": true,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 253180,

	            "ExitCode": 0,

	            "Error": "",

	            "StartedAt": "2021-08-13T21:35:57.358914053Z",

	            "FinishedAt": "0001-01-01T00:00:00Z"

	        },

	        "Image": "sha256:965ebc74cb435c5d73c204fcd638e9daa526ad4ce3ec7f76be1149f30a789fab",

	        "ResolvConfPath": "/var/lib/docker/containers/31f60e55e02d3b7c49d6f153df6c12fa98652958cfe5abee086c87482031b9d4/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/31f60e55e02d3b7c49d6f153df6c12fa98652958cfe5abee086c87482031b9d4/hostname",

	        "HostsPath": "/var/lib/docker/containers/31f60e55e02d3b7c49d6f153df6c12fa98652958cfe5abee086c87482031b9d4/hosts",

	        "LogPath": "/var/lib/docker/containers/31f60e55e02d3b7c49d6f153df6c12fa98652958cfe5abee086c87482031b9d4/31f60e55e02d3b7c49d6f153df6c12fa98652958cfe5abee086c87482031b9d4-json.log",

	        "Name": "/cert-options-20210813143549-8053",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "/lib/modules:/lib/modules:ro",

	                "cert-options-20210813143549-8053:/var"

	            ],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

	            },

	            "NetworkMode": "cert-options-20210813143549-8053",

	            "PortBindings": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "8555/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ]

	            },

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

	            },

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "CapAdd": null,

	            "CapDrop": null,

	            "CgroupnsMode": "host",

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

	            ],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

	            },

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "ConsoleSize": [

	                0,

	                0

	            ],

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 2147483648,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": null,

	            "BlkioDeviceWriteBps": null,

	            "BlkioDeviceReadIOps": null,

	            "BlkioDeviceWriteIOps": null,

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "KernelMemory": 0,

	            "KernelMemoryTCP": 0,

	            "MemoryReservation": 0,

	            "MemorySwap": 2147483648,

	            "MemorySwappiness": null,

	            "OomKillDisable": false,

	            "PidsLimit": null,

	            "Ulimits": null,

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

	        },

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/f1ef6a6341c617831ea2171d1d7bbeab16837b63a843be2aba8b7b436e140e6f-init/diff:/var/lib/docker/overlay2/b54d50d9722d23fb9637685b11892fb665fc20ba78ef431e07ed0ddfa868f7a1/diff:/var/lib/docker/overlay2/1ae49b54a8b23aaf60a7e9c9307ca333358576bae3a785f52751cdad083df982/diff:/var/lib/docker/overlay2/ea6c3052036e679f2d58c32269d4ea3143a3fc6f94abfc4e49173b050ea86a8b/diff:/var/lib/docker/overlay2/2a2dd58c96ee8d28d6328f3dc040dba105ab05a3a180db9efc72ab81c4f2dea8/diff:/var/lib/docker/overlay2/9b983e97e9a66172cc09d2798bfaa346d9fd6426e616339301e3bb8123e0e4f8/diff:/var/lib/docker/overlay2/dfeb06e54a5cea59763125a281a2a6800cd59c816b67601654af91996c53b0e9/diff:/var/lib/docker/overlay2/c9d50722d4822ee84b54a4086271aaa76449764ccee5cd9b3107efe20362db77/diff:/var/lib/docker/overlay2/7146eb1978a4f01c8661964f9a7e8e6900a73759e6d7f926784135a8c3675a0e/diff:/var/lib/docker/overlay2/6bcc532777a8b16bf0a8d49f5eba5dce2dad7acf9dd5d76a36fe91e4865df73c/diff:/var/lib/docker/overlay2/14de3b

84777e6d4bcd5b959be54fc67048ed8595b21548c2cb72c44e5bab5411/diff:/var/lib/docker/overlay2/f1ddefd3cddc8a76bb8102eba187352b3597d4a313ab8481788107dc17bb30be/diff:/var/lib/docker/overlay2/2be5ff1c0f18fc355d3d429c9a258aa1be9e5ebd0dd9b444f05aace4cc7acfea/diff:/var/lib/docker/overlay2/d1937ecc380ba5be5a64d9961a07aa0fa09d55136209e276d6ab5a08a2a5ce3c/diff:/var/lib/docker/overlay2/4b9bb8d1431c5ac321918e64797c008658b5e0db3587b9e7f484d00192b5a4be/diff:/var/lib/docker/overlay2/f9e7584420f2143a3affbe57ddd381ed9799067270b57d06e1af337987563637/diff:/var/lib/docker/overlay2/1ae74edd645de1296fe2ff40ac0d7659d56c4af7676d1e2b7077666f5cb598c4/diff:/var/lib/docker/overlay2/33df86dfa679c1be13df61855de34c224815a39320b3ee12131540df41ef4561/diff:/var/lib/docker/overlay2/eb8b1800e30954e5cf6fc67fbfa89db41d615ee50103aa0589446907b8c7ac49/diff:/var/lib/docker/overlay2/5c052f8924308a6f0fe3ae4941882e4b909ed1aeb01123b9e2faa7df2696de93/diff:/var/lib/docker/overlay2/69b433d87c6a506c3d510619bb41e8737b7e3d06bac5eb128be3e00efb740b98/diff:/var/lib/d

ocker/overlay2/c07998bd533865848849c722ed55cfa571f9562726f3fdb9bfd15f7b5936a8e6/diff:/var/lib/docker/overlay2/3df1a883fd0d44918646d29788faa76a5e7aaaf4b46a6ea2240c9d4b8bd4dc09/diff:/var/lib/docker/overlay2/9f2a07552f95e43119898b9bbe1e61d165ecd9eb3e862730a04a643bcc53a8c6/diff:/var/lib/docker/overlay2/fd2df25ca7e6b268f819b2fb38bbab50fbd5c6c8a4a2b4778f3917e567c64b8b/diff:/var/lib/docker/overlay2/a4639cb93382ebf39584a53948b6816dc6aa8e7011f2474b82320e09565c40ee/diff:/var/lib/docker/overlay2/16f320558e9c6c23b229f8b4dcf6f5c61670fa7b6513b707c1ceee8ff53ab012/diff:/var/lib/docker/overlay2/efde92a54c645d3d214babfea86fe173c88681a9a8bf1ee4c66f406eac0ce1f3/diff:/var/lib/docker/overlay2/67c175358f08a90e727cc2e59d3dc3f243bf98721348962ca80cedaa946e11e5/diff:/var/lib/docker/overlay2/abce6c2b52def112a2855b7240dfeb6e7ce8747ff80ae82b8c90df4358b5499f/diff:/var/lib/docker/overlay2/04adc9448565c768e00d76ed848aec196d92c4bcb1ba0268162b97accedfe7c0/diff:/var/lib/docker/overlay2/785c77e0f49a7d75d4a92bd8febab1b2a23633cd8c7be0e16fc628afb34

bcd83/diff:/var/lib/docker/overlay2/6716a51894c949d720d02845ebfc34f1d9f2431f04ffc2521d1b4fdf617ba172/diff:/var/lib/docker/overlay2/f7a3d7b89f4cc68fc5e0dd1756a2ae6260c2f0f5ab4bc40c3ce6b1b4d6ef0004/diff:/var/lib/docker/overlay2/91b9a991885a072e8afd1908c183be7e860cef03f6b3fbb173e06fdc90db2527/diff:/var/lib/docker/overlay2/8f4a011cc74f93ad854a02453507ef603a3da67ee7a766dfca38d3a46f5cdfb9/diff:/var/lib/docker/overlay2/b26e3ade0d328d23c224932591c878b90768d1c5e7058ccb26382021520bd343/diff",

	                "MergedDir": "/var/lib/docker/overlay2/f1ef6a6341c617831ea2171d1d7bbeab16837b63a843be2aba8b7b436e140e6f/merged",

	                "UpperDir": "/var/lib/docker/overlay2/f1ef6a6341c617831ea2171d1d7bbeab16837b63a843be2aba8b7b436e140e6f/diff",

	                "WorkDir": "/var/lib/docker/overlay2/f1ef6a6341c617831ea2171d1d7bbeab16837b63a843be2aba8b7b436e140e6f/work"

	            },

	            "Name": "overlay2"

	        },

	        "Mounts": [

	            {

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

	            },

	            {

	                "Type": "volume",

	                "Name": "cert-options-20210813143549-8053",

	                "Source": "/var/lib/docker/volumes/cert-options-20210813143549-8053/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

	            }

	        ],

	        "Config": {

	            "Hostname": "cert-options-20210813143549-8053",

	            "Domainname": "",

	            "User": "root",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8555/tcp": {}

	            },

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

	            ],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6",

	            "Volumes": null,

	            "WorkingDir": "",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

	            ],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "cert-options-20210813143549-8053",

	                "name.minikube.sigs.k8s.io": "cert-options-20210813143549-8053",

	                "role.minikube.sigs.k8s.io": ""

	            },

	            "StopSignal": "SIGRTMIN+3"

	        },

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "6712eb52a6b04fee2d29019186655f402454b0a490be59e3032488fc68ea791f",

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "Ports": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "63404"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "63405"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "63406"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "63407"

	                    }

	                ],

	                "8555/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "63408"

	                    }

	                ]

	            },

	            "SandboxKey": "/var/run/docker/netns/6712eb52a6b0",

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "cert-options-20210813143549-8053": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.49.2"

	                    },

	                    "Links": null,

	                    "Aliases": [

	                        "31f60e55e02d",

	                        "cert-options-20210813143549-8053"

	                    ],

	                    "NetworkID": "a56fd99f8efb9d7b1e3f11675ea6a75bef68100d9817877e0c008d7af87120f5",

	                    "EndpointID": "80ef871c86edd6add767d80f269f4b7799c3c4a22453269668977caa4b307655",

	                    "Gateway": "192.168.49.1",

	                    "IPAddress": "192.168.49.2",

	                    "IPPrefixLen": 24,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "MacAddress": "02:42:c0:a8:31:02",

	                    "DriverOpts": null

	                }

	            }

	        }

	    }

	]

-- /stdout --

helpers_test.go:240: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p cert-options-20210813143549-8053 -n cert-options-20210813143549-8053

helpers_test.go:245: <<< TestCertOptions FAILED: start of post-mortem logs <<<

helpers_test.go:246: ======>  post-mortem[TestCertOptions]: minikube logs <======

helpers_test.go:248: (dbg) Run:  out/minikube-darwin-amd64 -p cert-options-20210813143549-8053 logs -n 25

helpers_test.go:248: (dbg) Done: out/minikube-darwin-amd64 -p cert-options-20210813143549-8053 logs -n 25: (2.061744441s)

helpers_test.go:253: TestCertOptions logs: 

-- stdout --

	* 

	* ==> Audit <==

	* |---------|----------------------------------------|----------------------------------------|---------|---------|-------------------------------|-------------------------------|

	| Command |                  Args                  |                Profile                 |  User   | Version |          Start Time           |           End Time            |

	|---------|----------------------------------------|----------------------------------------|---------|---------|-------------------------------|-------------------------------|

	| delete  | -p pause-20210813142447-8053           | pause-20210813142447-8053              | jenkins | v1.22.0 | Fri, 13 Aug 2021 14:27:07 PDT | Fri, 13 Aug 2021 14:27:07 PDT |

	| start   | -p                                     | kubernetes-upgrade-20210813142707-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 14:27:07 PDT | Fri, 13 Aug 2021 14:28:03 PDT |

	|         | kubernetes-upgrade-20210813142707-8053 |                                        |         |         |                               |                               |

	|         | --memory=2200                          |                                        |         |         |                               |                               |

	|         | --kubernetes-version=v1.14.0           |                                        |         |         |                               |                               |

	|         | --alsologtostderr -v=1 --driver=docker |                                        |         |         |                               |                               |

	|         |                                        |                                        |         |         |                               |                               |

	| stop    | -p                                     | kubernetes-upgrade-20210813142707-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 14:28:03 PDT | Fri, 13 Aug 2021 14:28:21 PDT |

	|         | kubernetes-upgrade-20210813142707-8053 |                                        |         |         |                               |                               |

	| start   | -p                                     | missing-upgrade-20210813142651-8053    | jenkins | v1.22.0 | Fri, 13 Aug 2021 14:28:04 PDT | Fri, 13 Aug 2021 14:29:20 PDT |

	|         | missing-upgrade-20210813142651-8053    |                                        |         |         |                               |                               |

	|         | --memory=2200 --alsologtostderr        |                                        |         |         |                               |                               |

	|         | -v=1 --driver=docker                   |                                        |         |         |                               |                               |

	| start   | -p                                     | kubernetes-upgrade-20210813142707-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 14:28:21 PDT | Fri, 13 Aug 2021 14:29:23 PDT |

	|         | kubernetes-upgrade-20210813142707-8053 |                                        |         |         |                               |                               |

	|         | --memory=2200                          |                                        |         |         |                               |                               |

	|         | --kubernetes-version=v1.22.0-rc.0      |                                        |         |         |                               |                               |

	|         | --alsologtostderr -v=1 --driver=docker |                                        |         |         |                               |                               |

	|         |                                        |                                        |         |         |                               |                               |

	| start   | -p                                     | kubernetes-upgrade-20210813142707-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 14:29:24 PDT | Fri, 13 Aug 2021 14:29:30 PDT |

	|         | kubernetes-upgrade-20210813142707-8053 |                                        |         |         |                               |                               |

	|         | --memory=2200                          |                                        |         |         |                               |                               |

	|         | --kubernetes-version=v1.22.0-rc.0      |                                        |         |         |                               |                               |

	|         | --alsologtostderr -v=1 --driver=docker |                                        |         |         |                               |                               |

	|         |                                        |                                        |         |         |                               |                               |

	| delete  | -p                                     | missing-upgrade-20210813142651-8053    | jenkins | v1.22.0 | Fri, 13 Aug 2021 14:29:20 PDT | Fri, 13 Aug 2021 14:29:31 PDT |

	|         | missing-upgrade-20210813142651-8053    |                                        |         |         |                               |                               |

	| delete  | -p                                     | kubernetes-upgrade-20210813142707-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 14:29:30 PDT | Fri, 13 Aug 2021 14:29:41 PDT |

	|         | kubernetes-upgrade-20210813142707-8053 |                                        |         |         |                               |                               |

	| start   | -p                                     | stopped-upgrade-20210813142931-8053    | jenkins | v1.22.0 | Fri, 13 Aug 2021 14:30:46 PDT | Fri, 13 Aug 2021 14:31:47 PDT |

	|         | stopped-upgrade-20210813142931-8053    |                                        |         |         |                               |                               |

	|         | --memory=2200 --alsologtostderr        |                                        |         |         |                               |                               |

	|         | -v=1 --driver=docker                   |                                        |         |         |                               |                               |

	| logs    | -p                                     | stopped-upgrade-20210813142931-8053    | jenkins | v1.22.0 | Fri, 13 Aug 2021 14:31:48 PDT | Fri, 13 Aug 2021 14:31:50 PDT |

	|         | stopped-upgrade-20210813142931-8053    |                                        |         |         |                               |                               |

	| start   | -p                                     | running-upgrade-20210813142941-8053    | jenkins | v1.22.0 | Fri, 13 Aug 2021 14:31:15 PDT | Fri, 13 Aug 2021 14:31:58 PDT |

	|         | running-upgrade-20210813142941-8053    |                                        |         |         |                               |                               |

	|         | --memory=2200 --alsologtostderr        |                                        |         |         |                               |                               |

	|         | -v=1 --driver=docker                   |                                        |         |         |                               |                               |

	| delete  | -p                                     | stopped-upgrade-20210813142931-8053    | jenkins | v1.22.0 | Fri, 13 Aug 2021 14:31:51 PDT | Fri, 13 Aug 2021 14:31:59 PDT |

	|         | stopped-upgrade-20210813142931-8053    |                                        |         |         |                               |                               |

	| delete  | -p                                     | running-upgrade-20210813142941-8053    | jenkins | v1.22.0 | Fri, 13 Aug 2021 14:31:58 PDT | Fri, 13 Aug 2021 14:32:13 PDT |

	|         | running-upgrade-20210813142941-8053    |                                        |         |         |                               |                               |

	| start   | -p                                     | docker-flags-20210813143238-8053       | jenkins | v1.22.0 | Fri, 13 Aug 2021 14:32:38 PDT | Fri, 13 Aug 2021 14:33:56 PDT |

	|         | docker-flags-20210813143238-8053       |                                        |         |         |                               |                               |

	|         | --cache-images=false                   |                                        |         |         |                               |                               |

	|         | --memory=2048                          |                                        |         |         |                               |                               |

	|         | --install-addons=false                 |                                        |         |         |                               |                               |

	|         | --wait=false                           |                                        |         |         |                               |                               |

	|         | --docker-env=FOO=BAR                   |                                        |         |         |                               |                               |

	|         | --docker-env=BAZ=BAT                   |                                        |         |         |                               |                               |

	|         | --docker-opt=debug                     |                                        |         |         |                               |                               |

	|         | --docker-opt=icc=true                  |                                        |         |         |                               |                               |

	|         | --alsologtostderr -v=5                 |                                        |         |         |                               |                               |

	|         | --driver=docker                        |                                        |         |         |                               |                               |

	| -p      | docker-flags-20210813143238-8053       | docker-flags-20210813143238-8053       | jenkins | v1.22.0 | Fri, 13 Aug 2021 14:33:56 PDT | Fri, 13 Aug 2021 14:33:57 PDT |

	|         | ssh sudo systemctl show                |                                        |         |         |                               |                               |

	|         | docker --property=Environment          |                                        |         |         |                               |                               |

	|         | --no-pager                             |                                        |         |         |                               |                               |

	| -p      | docker-flags-20210813143238-8053       | docker-flags-20210813143238-8053       | jenkins | v1.22.0 | Fri, 13 Aug 2021 14:33:57 PDT | Fri, 13 Aug 2021 14:33:58 PDT |

	|         | ssh sudo systemctl show docker         |                                        |         |         |                               |                               |

	|         | --property=ExecStart --no-pager        |                                        |         |         |                               |                               |

	| delete  | -p                                     | docker-flags-20210813143238-8053       | jenkins | v1.22.0 | Fri, 13 Aug 2021 14:33:58 PDT | Fri, 13 Aug 2021 14:34:11 PDT |

	|         | docker-flags-20210813143238-8053       |                                        |         |         |                               |                               |

	| start   | -p                                     | force-systemd-flag-20210813143411-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 14:34:11 PDT | Fri, 13 Aug 2021 14:35:42 PDT |

	|         | force-systemd-flag-20210813143411-8053 |                                        |         |         |                               |                               |

	|         | --memory=2048 --force-systemd          |                                        |         |         |                               |                               |

	|         | --alsologtostderr -v=5 --driver=docker |                                        |         |         |                               |                               |

	|         |                                        |                                        |         |         |                               |                               |

	| -p      | force-systemd-flag-20210813143411-8053 | force-systemd-flag-20210813143411-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 14:35:42 PDT | Fri, 13 Aug 2021 14:35:43 PDT |

	|         | ssh docker info --format               |                                        |         |         |                               |                               |

	|         | {{.CgroupDriver}}                      |                                        |         |         |                               |                               |

	| delete  | -p                                     | force-systemd-flag-20210813143411-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 14:35:43 PDT | Fri, 13 Aug 2021 14:35:49 PDT |

	|         | force-systemd-flag-20210813143411-8053 |                                        |         |         |                               |                               |

	| start   | -p                                     | force-systemd-env-20210813143159-8053  | jenkins | v1.22.0 | Fri, 13 Aug 2021 14:31:59 PDT | Fri, 13 Aug 2021 14:36:23 PDT |

	|         | force-systemd-env-20210813143159-8053  |                                        |         |         |                               |                               |

	|         | --memory=2048 --alsologtostderr -v=5   |                                        |         |         |                               |                               |

	|         | --driver=docker                        |                                        |         |         |                               |                               |

	| -p      | force-systemd-env-20210813143159-8053  | force-systemd-env-20210813143159-8053  | jenkins | v1.22.0 | Fri, 13 Aug 2021 14:36:23 PDT | Fri, 13 Aug 2021 14:36:24 PDT |

	|         | ssh docker info --format               |                                        |         |         |                               |                               |

	|         | {{.CgroupDriver}}                      |                                        |         |         |                               |                               |

	| delete  | -p                                     | force-systemd-env-20210813143159-8053  | jenkins | v1.22.0 | Fri, 13 Aug 2021 14:36:24 PDT | Fri, 13 Aug 2021 14:36:37 PDT |

	|         | force-systemd-env-20210813143159-8053  |                                        |         |         |                               |                               |

	| start   | -p                                     | cert-options-20210813143549-8053       | jenkins | v1.22.0 | Fri, 13 Aug 2021 14:35:49 PDT | Fri, 13 Aug 2021 14:36:41 PDT |

	|         | cert-options-20210813143549-8053       |                                        |         |         |                               |                               |

	|         | --memory=2048                          |                                        |         |         |                               |                               |

	|         | --apiserver-ips=127.0.0.1              |                                        |         |         |                               |                               |

	|         | --apiserver-ips=192.168.15.15          |                                        |         |         |                               |                               |

	|         | --apiserver-names=localhost            |                                        |         |         |                               |                               |

	|         | --apiserver-names=www.google.com       |                                        |         |         |                               |                               |

	|         | --apiserver-port=8555                  |                                        |         |         |                               |                               |

	|         | --driver=docker                        |                                        |         |         |                               |                               |

	|         | --apiserver-name=localhost             |                                        |         |         |                               |                               |

	| -p      | cert-options-20210813143549-8053       | cert-options-20210813143549-8053       | jenkins | v1.22.0 | Fri, 13 Aug 2021 14:36:41 PDT | Fri, 13 Aug 2021 14:36:41 PDT |

	|         | ssh openssl x509 -text -noout -in      |                                        |         |         |                               |                               |

	|         | /var/lib/minikube/certs/apiserver.crt  |                                        |         |         |                               |                               |

	|---------|----------------------------------------|----------------------------------------|---------|---------|-------------------------------|-------------------------------|

	* 

	* ==> Last Start <==

	* Log file created at: 2021/08/13 14:36:37

	Running on machine: 37309

	Binary: Built with gc go1.16.7 for darwin/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0813 14:36:37.831589   21581 out.go:298] Setting OutFile to fd 1 ...

	I0813 14:36:37.831718   21581 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0813 14:36:37.831723   21581 out.go:311] Setting ErrFile to fd 2...

	I0813 14:36:37.831726   21581 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0813 14:36:37.831803   21581 root.go:313] Updating PATH: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/bin

	I0813 14:36:37.832133   21581 out.go:305] Setting JSON to false

	I0813 14:36:37.849992   21581 start.go:111] hostinfo: {"hostname":"37309.local","uptime":9372,"bootTime":1628881225,"procs":322,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"11.2.3","kernelVersion":"20.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"c86236b2-4976-3542-80ca-74a6b8b4ba03"}

	W0813 14:36:37.850089   21581 start.go:119] gopshost.Virtualization returned error: not implemented yet

	I0813 14:36:37.877112   21581 out.go:177] * [auto-20210813142650-8053] minikube v1.22.0 on Darwin 11.2.3

	I0813 14:36:37.877267   21581 notify.go:169] Checking for updates...

	I0813 14:36:37.903779   21581 out.go:177]   - MINIKUBE_LOCATION=12230

	I0813 14:36:37.929758   21581 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/kubeconfig

	I0813 14:36:37.955788   21581 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64

	I0813 14:36:37.981971   21581 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube

	I0813 14:36:37.982803   21581 config.go:177] Loaded profile config "cert-options-20210813143549-8053": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.21.3

	I0813 14:36:37.982877   21581 driver.go:335] Setting default libvirt URI to qemu:///system

	I0813 14:36:38.082603   21581 docker.go:132] docker version: linux-20.10.6

	I0813 14:36:38.082734   21581 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I0813 14:36:38.273047   21581 info.go:263] docker info: {ID:43SM:MII3:NWBL:WJUG:JMKA:JL3W:EOOO:ZEGZ:7ZJH:ECYZ:GXPQ:XAL7 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:19 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:50 OomKillDisable:true NGoroutines:51 SystemTime:2021-08-13 21:36:38.20843895 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.25-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServerA

ddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6234726400 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.6 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05f951a3781f4f2c1911b05e61c160e9c30eaa8e Expected:05f951a3781f4f2c1911b05e61c160e9c30eaa8e} RuncCommit:{ID:12644e614e25b05da6fd08a38ffa0cfe1903fdec Expected:12644e614e25b05da6fd08a38ffa0cfe1903fdec} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=secc

omp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/local/lib/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Build with BuildKit Vendor:Docker Inc. Version:v0.5.1-docker] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:2.0.0-beta.1] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.8.0]] Warnings:<nil>}}

	I0813 14:36:38.299848   21581 out.go:177] * Using the docker driver based on user configuration

	I0813 14:36:38.299874   21581 start.go:278] selected driver: docker

	I0813 14:36:38.299887   21581 start.go:751] validating driver "docker" against <nil>

	I0813 14:36:38.299901   21581 start.go:762] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}

	I0813 14:36:38.302768   21581 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I0813 14:36:38.504872   21581 info.go:263] docker info: {ID:43SM:MII3:NWBL:WJUG:JMKA:JL3W:EOOO:ZEGZ:7ZJH:ECYZ:GXPQ:XAL7 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:19 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:50 OomKillDisable:true NGoroutines:51 SystemTime:2021-08-13 21:36:38.443628295 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.25-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServer

Address:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6234726400 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.6 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05f951a3781f4f2c1911b05e61c160e9c30eaa8e Expected:05f951a3781f4f2c1911b05e61c160e9c30eaa8e} RuncCommit:{ID:12644e614e25b05da6fd08a38ffa0cfe1903fdec Expected:12644e614e25b05da6fd08a38ffa0cfe1903fdec} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=sec

comp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/local/lib/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Build with BuildKit Vendor:Docker Inc. Version:v0.5.1-docker] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:2.0.0-beta.1] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.8.0]] Warnings:<nil>}}

	I0813 14:36:38.504989   21581 start_flags.go:263] no existing cluster config was found, will generate one from the flags 

	I0813 14:36:38.505117   21581 start_flags.go:697] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0813 14:36:38.505133   21581 cni.go:93] Creating CNI manager for ""

	I0813 14:36:38.505141   21581 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I0813 14:36:38.505145   21581 start_flags.go:277] config:

	{Name:auto-20210813142650-8053 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.21.3 ClusterName:auto-20210813142650-8053 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:do

cker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:5m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0813 14:36:38.532045   21581 out.go:177] * Starting control plane node auto-20210813142650-8053 in cluster auto-20210813142650-8053

	I0813 14:36:38.532080   21581 cache.go:117] Beginning downloading kic base image for docker with docker

	I0813 14:36:38.636673   21581 out.go:177] * Pulling base image ...

	I0813 14:36:38.636789   21581 preload.go:131] Checking if preload exists for k8s version v1.21.3 and runtime docker

	I0813 14:36:38.636829   21581 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 in local docker daemon

	I0813 14:36:38.636883   21581 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.3-docker-overlay2-amd64.tar.lz4

	I0813 14:36:38.636916   21581 cache.go:56] Caching tarball of preloaded images

	I0813 14:36:38.638193   21581 preload.go:173] Found /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I0813 14:36:38.638335   21581 cache.go:59] Finished verifying existence of preloaded tar for  v1.21.3 on docker

	I0813 14:36:38.638645   21581 profile.go:148] Saving config to /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/auto-20210813142650-8053/config.json ...

	I0813 14:36:38.638727   21581 lock.go:36] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/auto-20210813142650-8053/config.json: {Name:mk073eb6d1c93b6b5f687ca6aaefc72f390dd107 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 14:36:38.757406   21581 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 in local docker daemon, skipping pull

	I0813 14:36:38.757433   21581 cache.go:139] gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 exists in daemon, skipping load

	I0813 14:36:38.757447   21581 cache.go:205] Successfully downloaded all kic artifacts

	I0813 14:36:38.757493   21581 start.go:313] acquiring machines lock for auto-20210813142650-8053: {Name:mk8c89f2ae951a0570fffd9acf3dfb6651505ffc Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0813 14:36:38.757648   21581 start.go:317] acquired machines lock for "auto-20210813142650-8053" in 141.299µs

	I0813 14:36:38.757677   21581 start.go:89] Provisioning new machine with config: &{Name:auto-20210813142650-8053 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.21.3 ClusterName:auto-20210813142650-8053 Namespace:default APIServerName:miniku

beCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.21.3 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:5m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0} &{Name: IP: Port:8443 KubernetesVersion:v1.21.3 ControlPlane:true Worker:true}

	I0813 14:36:38.757743   21581 start.go:126] createHost starting for "" (driver="docker")

	I0813 14:36:36.573727   21205 out.go:177] * Enabled addons: storage-provisioner, default-storageclass

	I0813 14:36:36.573739   21205 addons.go:344] enableAddons completed in 815.334885ms

	I0813 14:36:36.767101   21205 system_pods.go:59] 1 kube-system pods found

	I0813 14:36:36.767122   21205 system_pods.go:61] "storage-provisioner" [9b86defb-65b9-4298-9d82-1091317c82be] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate.)

	I0813 14:36:36.767128   21205 retry.go:31] will retry after 422.765636ms: only 1 pod(s) have shown up

	I0813 14:36:37.194136   21205 system_pods.go:59] 1 kube-system pods found

	I0813 14:36:37.194146   21205 system_pods.go:61] "storage-provisioner" [9b86defb-65b9-4298-9d82-1091317c82be] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate.)

	I0813 14:36:37.194152   21205 retry.go:31] will retry after 473.074753ms: only 1 pod(s) have shown up

	I0813 14:36:37.673655   21205 system_pods.go:59] 1 kube-system pods found

	I0813 14:36:37.673666   21205 system_pods.go:61] "storage-provisioner" [9b86defb-65b9-4298-9d82-1091317c82be] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate.)

	I0813 14:36:37.673672   21205 retry.go:31] will retry after 587.352751ms: only 1 pod(s) have shown up

	I0813 14:36:38.267550   21205 system_pods.go:59] 1 kube-system pods found

	I0813 14:36:38.267567   21205 system_pods.go:61] "storage-provisioner" [9b86defb-65b9-4298-9d82-1091317c82be] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate.)

	I0813 14:36:38.267577   21205 retry.go:31] will retry after 834.206799ms: only 1 pod(s) have shown up

	I0813 14:36:39.108548   21205 system_pods.go:59] 1 kube-system pods found

	I0813 14:36:39.108558   21205 system_pods.go:61] "storage-provisioner" [9b86defb-65b9-4298-9d82-1091317c82be] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate.)

	I0813 14:36:39.108564   21205 retry.go:31] will retry after 746.553905ms: only 1 pod(s) have shown up

	I0813 14:36:39.865881   21205 system_pods.go:59] 1 kube-system pods found

	I0813 14:36:39.865894   21205 system_pods.go:61] "storage-provisioner" [9b86defb-65b9-4298-9d82-1091317c82be] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate.)

	I0813 14:36:39.865902   21205 retry.go:31] will retry after 987.362415ms: only 1 pod(s) have shown up

	I0813 14:36:40.867240   21205 system_pods.go:59] 5 kube-system pods found

	I0813 14:36:40.867249   21205 system_pods.go:61] "etcd-cert-options-20210813143549-8053" [16bf26f4-ee2a-4ca8-81c0-2e680a731602] Pending

	I0813 14:36:40.867253   21205 system_pods.go:61] "kube-apiserver-cert-options-20210813143549-8053" [a0e3cfb8-d26b-4cd3-bb74-49442b4bd93f] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])

	I0813 14:36:40.867260   21205 system_pods.go:61] "kube-controller-manager-cert-options-20210813143549-8053" [467dac45-6c30-40fd-9641-a23c2777ef56] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])

	I0813 14:36:40.867265   21205 system_pods.go:61] "kube-scheduler-cert-options-20210813143549-8053" [fefda88b-fb01-4444-8e60-d7b38775bbff] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])

	I0813 14:36:40.867271   21205 system_pods.go:61] "storage-provisioner" [9b86defb-65b9-4298-9d82-1091317c82be] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate.)

	I0813 14:36:40.867274   21205 system_pods.go:74] duration metric: took 4.766438393s to wait for pod list to return data ...

	I0813 14:36:40.867281   21205 kubeadm.go:547] duration metric: took 5.10887058s to wait for : map[apiserver:true system_pods:true] ...

	I0813 14:36:40.867289   21205 node_conditions.go:102] verifying NodePressure condition ...

	I0813 14:36:40.870905   21205 node_conditions.go:122] node storage ephemeral capacity is 123591232Ki

	I0813 14:36:40.870918   21205 node_conditions.go:123] node cpu capacity is 6

	I0813 14:36:40.870928   21205 node_conditions.go:105] duration metric: took 3.637526ms to run NodePressure ...

	I0813 14:36:40.870935   21205 start.go:231] waiting for startup goroutines ...

	I0813 14:36:40.909067   21205 start.go:462] kubectl: 1.19.7, cluster: 1.21.3 (minor skew: 2)

	I0813 14:36:40.936130   21205 out.go:177] 

	W0813 14:36:40.936413   21205 out.go:242] ! /usr/local/bin/kubectl is version 1.19.7, which may have incompatibilites with Kubernetes 1.21.3.

	I0813 14:36:40.961097   21205 out.go:177]   - Want kubectl v1.21.3? Try 'minikube kubectl -- get pods -A'

	I0813 14:36:41.013167   21205 out.go:177] * Done! kubectl is now configured to use "cert-options-20210813143549-8053" cluster and "default" namespace by default

	* 

	* ==> Docker <==

	* -- Logs begin at Fri 2021-08-13 21:35:59 UTC, end at Fri 2021-08-13 21:36:43 UTC. --

	Aug 13 21:36:03 cert-options-20210813143549-8053 dockerd[226]: time="2021-08-13T21:36:03.526977145Z" level=info msg="Daemon shutdown complete"

	Aug 13 21:36:03 cert-options-20210813143549-8053 dockerd[226]: time="2021-08-13T21:36:03.527108746Z" level=info msg="stopping event stream following graceful shutdown" error="context canceled" module=libcontainerd namespace=plugins.moby

	Aug 13 21:36:03 cert-options-20210813143549-8053 systemd[1]: docker.service: Succeeded.

	Aug 13 21:36:03 cert-options-20210813143549-8053 systemd[1]: Stopped Docker Application Container Engine.

	Aug 13 21:36:03 cert-options-20210813143549-8053 systemd[1]: Starting Docker Application Container Engine...

	Aug 13 21:36:03 cert-options-20210813143549-8053 dockerd[469]: time="2021-08-13T21:36:03.568007437Z" level=info msg="Starting up"

	Aug 13 21:36:03 cert-options-20210813143549-8053 dockerd[469]: time="2021-08-13T21:36:03.569795548Z" level=info msg="parsed scheme: \"unix\"" module=grpc

	Aug 13 21:36:03 cert-options-20210813143549-8053 dockerd[469]: time="2021-08-13T21:36:03.569828968Z" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc

	Aug 13 21:36:03 cert-options-20210813143549-8053 dockerd[469]: time="2021-08-13T21:36:03.569847347Z" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///run/containerd/containerd.sock  <nil> 0 <nil>}] <nil> <nil>}" module=grpc

	Aug 13 21:36:03 cert-options-20210813143549-8053 dockerd[469]: time="2021-08-13T21:36:03.569854914Z" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc

	Aug 13 21:36:03 cert-options-20210813143549-8053 dockerd[469]: time="2021-08-13T21:36:03.570577762Z" level=info msg="parsed scheme: \"unix\"" module=grpc

	Aug 13 21:36:03 cert-options-20210813143549-8053 dockerd[469]: time="2021-08-13T21:36:03.570610592Z" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc

	Aug 13 21:36:03 cert-options-20210813143549-8053 dockerd[469]: time="2021-08-13T21:36:03.570767319Z" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///run/containerd/containerd.sock  <nil> 0 <nil>}] <nil> <nil>}" module=grpc

	Aug 13 21:36:03 cert-options-20210813143549-8053 dockerd[469]: time="2021-08-13T21:36:03.570797208Z" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc

	Aug 13 21:36:03 cert-options-20210813143549-8053 dockerd[469]: time="2021-08-13T21:36:03.574474595Z" level=info msg="[graphdriver] using prior storage driver: overlay2"

	Aug 13 21:36:03 cert-options-20210813143549-8053 dockerd[469]: time="2021-08-13T21:36:03.579994841Z" level=warning msg="Your kernel does not support cgroup blkio weight"

	Aug 13 21:36:03 cert-options-20210813143549-8053 dockerd[469]: time="2021-08-13T21:36:03.580024997Z" level=warning msg="Your kernel does not support cgroup blkio weight_device"

	Aug 13 21:36:03 cert-options-20210813143549-8053 dockerd[469]: time="2021-08-13T21:36:03.580210406Z" level=info msg="Loading containers: start."

	Aug 13 21:36:11 cert-options-20210813143549-8053 dockerd[469]: time="2021-08-13T21:36:11.346132457Z" level=info msg="Default bridge (docker0) is assigned with an IP address 172.17.0.0/16. Daemon option --bip can be used to set a preferred IP address"

	Aug 13 21:36:12 cert-options-20210813143549-8053 dockerd[469]: time="2021-08-13T21:36:12.697775817Z" level=info msg="Loading containers: done."

	Aug 13 21:36:12 cert-options-20210813143549-8053 dockerd[469]: time="2021-08-13T21:36:12.714973086Z" level=info msg="Docker daemon" commit=75249d8 graphdriver(s)=overlay2 version=20.10.8

	Aug 13 21:36:12 cert-options-20210813143549-8053 dockerd[469]: time="2021-08-13T21:36:12.715085801Z" level=info msg="Daemon has completed initialization"

	Aug 13 21:36:12 cert-options-20210813143549-8053 systemd[1]: Started Docker Application Container Engine.

	Aug 13 21:36:12 cert-options-20210813143549-8053 dockerd[469]: time="2021-08-13T21:36:12.740684593Z" level=info msg="API listen on [::]:2376"

	Aug 13 21:36:12 cert-options-20210813143549-8053 dockerd[469]: time="2021-08-13T21:36:12.743090150Z" level=info msg="API listen on /var/run/docker.sock"

	* 

	* ==> container status <==

	* CONTAINER           IMAGE               CREATED             STATE               NAME                      ATTEMPT             POD ID

	e6ac3b5b5890d       6be0dc1302e30       16 seconds ago      Running             kube-scheduler            0                   8faf81b41deab

	87f5f484aa6a2       bc2bb319a7038       16 seconds ago      Running             kube-controller-manager   0                   ec6ecce3bd52d

	1a03596cdcea8       0369cf4303ffd       16 seconds ago      Running             etcd                      0                   c7e3124735df5

	cee1e73da9ed3       3d174f00aa39e       16 seconds ago      Running             kube-apiserver            0                   c988ce7e6b401

	* 

	* ==> describe nodes <==

	* Name:               cert-options-20210813143549-8053

	Roles:              control-plane,master

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=cert-options-20210813143549-8053

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=852050cf77fe767e86d5a194bb91c06c4dc6c13c

	                    minikube.k8s.io/name=cert-options-20210813143549-8053

	                    minikube.k8s.io/updated_at=2021_08_13T14_36_35_0700

	                    minikube.k8s.io/version=v1.22.0

	                    node-role.kubernetes.io/control-plane=

	                    node-role.kubernetes.io/master=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /var/run/dockershim.sock

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Fri, 13 Aug 2021 21:36:33 +0000

	Taints:             node.kubernetes.io/not-ready:NoSchedule

	Unschedulable:      false

	Lease:

	  HolderIdentity:  cert-options-20210813143549-8053

	  AcquireTime:     <unset>

	  RenewTime:       Fri, 13 Aug 2021 21:36:38 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Fri, 13 Aug 2021 21:36:38 +0000   Fri, 13 Aug 2021 21:36:33 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Fri, 13 Aug 2021 21:36:38 +0000   Fri, 13 Aug 2021 21:36:33 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Fri, 13 Aug 2021 21:36:38 +0000   Fri, 13 Aug 2021 21:36:33 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            False   Fri, 13 Aug 2021 21:36:38 +0000   Fri, 13 Aug 2021 21:36:33 +0000   KubeletNotReady              PLEG is not healthy: pleg has yet to be successful

	Addresses:

	  InternalIP:  192.168.49.2

	  Hostname:    cert-options-20210813143549-8053

	Capacity:

	  cpu:                6

	  ephemeral-storage:  123591232Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  memory:             6088600Ki

	  pods:               110

	Allocatable:

	  cpu:                6

	  ephemeral-storage:  123591232Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  memory:             6088600Ki

	  pods:               110

	System Info:

	  Machine ID:                 dfc5def84a78402c9caa00a7cad25a86

	  System UUID:                8cd9c622-c4b3-4870-b506-dc856278e6cf

	  Boot ID:                    9c1335d8-2b93-45e8-96a7-e09bd9b095e5

	  Kernel Version:             5.10.25-linuxkit

	  OS Image:                   Ubuntu 20.04.2 LTS

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  docker://20.10.8

	  Kubelet Version:            v1.21.3

	  Kube-Proxy Version:         v1.21.3

	Non-terminated Pods:          (4 in total)

	  Namespace                   Name                                                        CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                                        ------------  ----------  ---------------  -------------  ---

	  kube-system                 etcd-cert-options-20210813143549-8053                       100m (1%!)(MISSING)     0 (0%!)(MISSING)      100Mi (1%!)(MISSING)       0 (0%!)(MISSING)         4s

	  kube-system                 kube-apiserver-cert-options-20210813143549-8053             250m (4%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4s

	  kube-system                 kube-controller-manager-cert-options-20210813143549-8053    200m (3%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4s

	  kube-system                 kube-scheduler-cert-options-20210813143549-8053             100m (1%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                650m (10%!)(MISSING)  0 (0%!)(MISSING)

	  memory             100Mi (1%!)(MISSING)  0 (0%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age   From     Message

	  ----    ------                   ----  ----     -------

	  Normal  Starting                 5s    kubelet  Starting kubelet.

	  Normal  NodeHasSufficientMemory  5s    kubelet  Node cert-options-20210813143549-8053 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    5s    kubelet  Node cert-options-20210813143549-8053 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     5s    kubelet  Node cert-options-20210813143549-8053 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  5s    kubelet  Updated Node Allocatable limit across pods

	* 

	* ==> dmesg <==

	* [  +0.038848] bpfilter: read fail 0

	[  +0.028583] bpfilter: read fail 0

	[  +0.032240] bpfilter: read fail 0

	[  +0.031873] bpfilter: read fail 0

	[  +0.045891] bpfilter: read fail 0

	[  +0.038081] bpfilter: read fail 0

	[  +0.032107] bpfilter: read fail 0

	[  +0.027851] bpfilter: read fail 0

	[  +0.047615] bpfilter: read fail 0

	[  +0.027340] bpfilter: read fail 0

	[  +0.041626] bpfilter: read fail 0

	[  +0.030192] bpfilter: read fail 0

	[  +0.043441] bpfilter: read fail 0

	[  +0.031164] bpfilter: read fail 0

	[  +0.033948] bpfilter: read fail 0

	[  +0.026728] bpfilter: read fail 0

	[  +0.042698] bpfilter: read fail 0

	[  +0.036930] bpfilter: read fail 0

	[  +0.031159] bpfilter: write fail -32

	[  +0.033785] bpfilter: write fail -32

	[  +0.040456] bpfilter: read fail 0

	[  +0.027124] bpfilter: read fail 0

	[  +0.028710] bpfilter: read fail 0

	[  +0.030413] bpfilter: read fail 0

	[  +0.030742] bpfilter: write fail -32

	* 

	* ==> etcd [1a03596cdcea] <==

	* raft2021/08/13 21:36:27 INFO: aec36adc501070cc became follower at term 0

	raft2021/08/13 21:36:27 INFO: newRaft aec36adc501070cc [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]

	raft2021/08/13 21:36:27 INFO: aec36adc501070cc became follower at term 1

	raft2021/08/13 21:36:27 INFO: aec36adc501070cc switched to configuration voters=(12593026477526642892)

	2021-08-13 21:36:27.585729 W | auth: simple token is not cryptographically signed

	2021-08-13 21:36:27.588734 I | etcdserver: starting server... [version: 3.4.13, cluster version: to_be_decided]

	2021-08-13 21:36:27.588827 I | etcdserver: aec36adc501070cc as single-node; fast-forwarding 9 ticks (election ticks 10)

	raft2021/08/13 21:36:27 INFO: aec36adc501070cc switched to configuration voters=(12593026477526642892)

	2021-08-13 21:36:27.589242 I | etcdserver/membership: added member aec36adc501070cc [https://192.168.49.2:2380] to cluster fa54960ea34d58be

	2021-08-13 21:36:27.590627 I | embed: ClientTLS: cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = 

	2021-08-13 21:36:27.590710 I | embed: listening for peers on 192.168.49.2:2380

	2021-08-13 21:36:27.590814 I | embed: listening for metrics on http://127.0.0.1:2381

	raft2021/08/13 21:36:28 INFO: aec36adc501070cc is starting a new election at term 1

	raft2021/08/13 21:36:28 INFO: aec36adc501070cc became candidate at term 2

	raft2021/08/13 21:36:28 INFO: aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2

	raft2021/08/13 21:36:28 INFO: aec36adc501070cc became leader at term 2

	raft2021/08/13 21:36:28 INFO: raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2

	2021-08-13 21:36:28.185685 I | etcdserver: setting up the initial cluster version to 3.4

	2021-08-13 21:36:28.186387 N | etcdserver/membership: set the initial cluster version to 3.4

	2021-08-13 21:36:28.186731 I | etcdserver: published {Name:cert-options-20210813143549-8053 ClientURLs:[https://192.168.49.2:2379]} to cluster fa54960ea34d58be

	2021-08-13 21:36:28.186739 I | embed: ready to serve client requests

	2021-08-13 21:36:28.186741 I | etcdserver/api: enabled capabilities for version 3.4

	2021-08-13 21:36:28.186975 I | embed: ready to serve client requests

	2021-08-13 21:36:28.188460 I | embed: serving client requests on 127.0.0.1:2379

	2021-08-13 21:36:28.195246 I | embed: serving client requests on 192.168.49.2:2379

	* 

	* ==> kernel <==

	*  21:36:44 up  1:22,  0 users,  load average: 3.78, 2.83, 2.02

	Linux cert-options-20210813143549-8053 5.10.25-linuxkit #1 SMP Tue Mar 23 09:27:39 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux

	PRETTY_NAME="Ubuntu 20.04.2 LTS"

	* 

	* ==> kube-apiserver [cee1e73da9ed] <==

	* I0813 21:36:31.197939       1 crd_finalizer.go:266] Starting CRDFinalizer

	I0813 21:36:31.198235       1 available_controller.go:475] Starting AvailableConditionController

	I0813 21:36:31.198258       1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller

	I0813 21:36:31.256297       1 controller.go:611] quota admission added evaluator for: namespaces

	I0813 21:36:31.285917       1 shared_informer.go:247] Caches are synced for node_authorizer 

	I0813 21:36:31.288238       1 shared_informer.go:247] Caches are synced for cluster_authentication_trust_controller 

	I0813 21:36:31.290457       1 apf_controller.go:299] Running API Priority and Fairness config worker

	I0813 21:36:31.290495       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller

	I0813 21:36:31.292604       1 cache.go:39] Caches are synced for autoregister controller

	I0813 21:36:31.292665       1 shared_informer.go:247] Caches are synced for crd-autoregister 

	I0813 21:36:31.298304       1 cache.go:39] Caches are synced for AvailableConditionController controller

	I0813 21:36:32.187595       1 controller.go:132] OpenAPI AggregationController: action for item : Nothing (removed from the queue).

	I0813 21:36:32.187743       1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).

	I0813 21:36:32.198211       1 storage_scheduling.go:132] created PriorityClass system-node-critical with value 2000001000

	I0813 21:36:32.205263       1 storage_scheduling.go:132] created PriorityClass system-cluster-critical with value 2000000000

	I0813 21:36:32.205353       1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.

	I0813 21:36:32.566161       1 controller.go:611] quota admission added evaluator for: roles.rbac.authorization.k8s.io

	I0813 21:36:32.595963       1 controller.go:611] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io

	W0813 21:36:32.669484       1 lease.go:233] Resetting endpoints for master service "kubernetes" to [192.168.49.2]

	I0813 21:36:32.670416       1 controller.go:611] quota admission added evaluator for: endpoints

	I0813 21:36:32.674205       1 controller.go:611] quota admission added evaluator for: endpointslices.discovery.k8s.io

	I0813 21:36:33.764692       1 controller.go:611] quota admission added evaluator for: serviceaccounts

	I0813 21:36:34.729101       1 controller.go:611] quota admission added evaluator for: deployments.apps

	I0813 21:36:34.779749       1 controller.go:611] quota admission added evaluator for: daemonsets.apps

	I0813 21:36:38.261315       1 controller.go:611] quota admission added evaluator for: leases.coordination.k8s.io

	* 

	* ==> kube-controller-manager [87f5f484aa6a] <==

	* W0813 21:36:35.765091       1 controllermanager.go:566] Skipping "cloud-node-lifecycle"

	I0813 21:36:35.916592       1 controllermanager.go:574] Started "persistentvolume-expander"

	I0813 21:36:35.916619       1 expand_controller.go:327] Starting expand controller

	I0813 21:36:35.916627       1 shared_informer.go:240] Waiting for caches to sync for expand

	I0813 21:36:36.065300       1 controllermanager.go:574] Started "job"

	I0813 21:36:36.065353       1 job_controller.go:150] Starting job controller

	I0813 21:36:36.065358       1 shared_informer.go:240] Waiting for caches to sync for job

	I0813 21:36:36.364007       1 controllermanager.go:574] Started "horizontalpodautoscaling"

	I0813 21:36:36.364046       1 horizontal.go:169] Starting HPA controller

	I0813 21:36:36.364054       1 shared_informer.go:240] Waiting for caches to sync for HPA

	I0813 21:36:36.514693       1 controllermanager.go:574] Started "endpoint"

	I0813 21:36:36.514723       1 endpoints_controller.go:189] Starting endpoint controller

	I0813 21:36:36.514727       1 shared_informer.go:240] Waiting for caches to sync for endpoint

	I0813 21:36:36.666636       1 controllermanager.go:574] Started "replicationcontroller"

	I0813 21:36:36.666673       1 replica_set.go:182] Starting replicationcontroller controller

	I0813 21:36:36.666679       1 shared_informer.go:240] Waiting for caches to sync for ReplicationController

	I0813 21:36:36.713294       1 controllermanager.go:574] Started "csrapproving"

	I0813 21:36:36.713350       1 certificate_controller.go:118] Starting certificate controller "csrapproving"

	I0813 21:36:36.713357       1 shared_informer.go:240] Waiting for caches to sync for certificate-csrapproving

	I0813 21:36:36.764843       1 controllermanager.go:574] Started "csrcleaner"

	I0813 21:36:36.764959       1 cleaner.go:82] Starting CSR cleaner controller

	I0813 21:36:36.914963       1 controllermanager.go:574] Started "ttl"

	I0813 21:36:36.915016       1 ttl_controller.go:121] Starting TTL controller

	I0813 21:36:36.915024       1 shared_informer.go:240] Waiting for caches to sync for TTL

	I0813 21:36:36.965404       1 node_ipam_controller.go:91] Sending events to api server.

	* 

	* ==> kube-scheduler [e6ac3b5b5890] <==

	* E0813 21:36:31.258857       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0813 21:36:31.258889       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0813 21:36:31.258999       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E0813 21:36:31.259042       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0813 21:36:31.259085       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0813 21:36:31.259087       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E0813 21:36:31.259563       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0813 21:36:31.259621       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0813 21:36:31.259854       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.CSIStorageCapacity: failed to list *v1beta1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0813 21:36:31.259914       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0813 21:36:31.260136       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0813 21:36:31.260149       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0813 21:36:31.260167       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0813 21:36:31.260213       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E0813 21:36:32.092127       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0813 21:36:32.141411       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E0813 21:36:32.145050       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0813 21:36:32.226734       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0813 21:36:32.233994       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0813 21:36:32.332661       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0813 21:36:32.346645       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0813 21:36:32.365302       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E0813 21:36:32.412462       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.CSIStorageCapacity: failed to list *v1beta1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0813 21:36:32.470358       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	I0813 21:36:34.356124       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 

	* 

	* ==> kubelet <==

	* -- Logs begin at Fri 2021-08-13 21:35:59 UTC, end at Fri 2021-08-13 21:36:44 UTC. --

	Aug 13 21:36:39 cert-options-20210813143549-8053 kubelet[2548]: I0813 21:36:39.766749    2548 kubelet_network_linux.go:56] "Initialized protocol iptables rules." protocol=IPv4

	Aug 13 21:36:39 cert-options-20210813143549-8053 kubelet[2548]: I0813 21:36:39.781486    2548 kubelet_network_linux.go:56] "Initialized protocol iptables rules." protocol=IPv6

	Aug 13 21:36:39 cert-options-20210813143549-8053 kubelet[2548]: I0813 21:36:39.781525    2548 status_manager.go:157] "Starting to sync pod status with apiserver"

	Aug 13 21:36:39 cert-options-20210813143549-8053 kubelet[2548]: I0813 21:36:39.781539    2548 kubelet.go:1846] "Starting kubelet main sync loop"

	Aug 13 21:36:39 cert-options-20210813143549-8053 kubelet[2548]: E0813 21:36:39.781565    2548 kubelet.go:1870] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"

	Aug 13 21:36:39 cert-options-20210813143549-8053 kubelet[2548]: I0813 21:36:39.882514    2548 topology_manager.go:187] "Topology Admit Handler"

	Aug 13 21:36:39 cert-options-20210813143549-8053 kubelet[2548]: I0813 21:36:39.882612    2548 topology_manager.go:187] "Topology Admit Handler"

	Aug 13 21:36:39 cert-options-20210813143549-8053 kubelet[2548]: I0813 21:36:39.882658    2548 topology_manager.go:187] "Topology Admit Handler"

	Aug 13 21:36:39 cert-options-20210813143549-8053 kubelet[2548]: I0813 21:36:39.882687    2548 topology_manager.go:187] "Topology Admit Handler"

	Aug 13 21:36:39 cert-options-20210813143549-8053 kubelet[2548]: I0813 21:36:39.964194    2548 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/host-path/95e5f5f4281dcde6357e66dca95d3edc-ca-certs\") pod \"kube-apiserver-cert-options-20210813143549-8053\" (UID: \"95e5f5f4281dcde6357e66dca95d3edc\") "

	Aug 13 21:36:39 cert-options-20210813143549-8053 kubelet[2548]: I0813 21:36:39.964260    2548 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/95e5f5f4281dcde6357e66dca95d3edc-etc-ca-certificates\") pod \"kube-apiserver-cert-options-20210813143549-8053\" (UID: \"95e5f5f4281dcde6357e66dca95d3edc\") "

	Aug 13 21:36:39 cert-options-20210813143549-8053 kubelet[2548]: I0813 21:36:39.964285    2548 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"k8s-certs\" (UniqueName: \"kubernetes.io/host-path/95e5f5f4281dcde6357e66dca95d3edc-k8s-certs\") pod \"kube-apiserver-cert-options-20210813143549-8053\" (UID: \"95e5f5f4281dcde6357e66dca95d3edc\") "

	Aug 13 21:36:39 cert-options-20210813143549-8053 kubelet[2548]: I0813 21:36:39.964307    2548 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"flexvolume-dir\" (UniqueName: \"kubernetes.io/host-path/e910aaa6f761db2e384bba10355fe9ca-flexvolume-dir\") pod \"kube-controller-manager-cert-options-20210813143549-8053\" (UID: \"e910aaa6f761db2e384bba10355fe9ca\") "

	Aug 13 21:36:39 cert-options-20210813143549-8053 kubelet[2548]: I0813 21:36:39.964370    2548 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/e910aaa6f761db2e384bba10355fe9ca-kubeconfig\") pod \"kube-controller-manager-cert-options-20210813143549-8053\" (UID: \"e910aaa6f761db2e384bba10355fe9ca\") "

	Aug 13 21:36:39 cert-options-20210813143549-8053 kubelet[2548]: I0813 21:36:39.964409    2548 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-local-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/e910aaa6f761db2e384bba10355fe9ca-usr-local-share-ca-certificates\") pod \"kube-controller-manager-cert-options-20210813143549-8053\" (UID: \"e910aaa6f761db2e384bba10355fe9ca\") "

	Aug 13 21:36:39 cert-options-20210813143549-8053 kubelet[2548]: I0813 21:36:39.964440    2548 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-local-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/95e5f5f4281dcde6357e66dca95d3edc-usr-local-share-ca-certificates\") pod \"kube-apiserver-cert-options-20210813143549-8053\" (UID: \"95e5f5f4281dcde6357e66dca95d3edc\") "

	Aug 13 21:36:39 cert-options-20210813143549-8053 kubelet[2548]: I0813 21:36:39.964463    2548 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/host-path/e910aaa6f761db2e384bba10355fe9ca-ca-certs\") pod \"kube-controller-manager-cert-options-20210813143549-8053\" (UID: \"e910aaa6f761db2e384bba10355fe9ca\") "

	Aug 13 21:36:39 cert-options-20210813143549-8053 kubelet[2548]: I0813 21:36:39.964486    2548 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/e910aaa6f761db2e384bba10355fe9ca-etc-ca-certificates\") pod \"kube-controller-manager-cert-options-20210813143549-8053\" (UID: \"e910aaa6f761db2e384bba10355fe9ca\") "

	Aug 13 21:36:39 cert-options-20210813143549-8053 kubelet[2548]: I0813 21:36:39.964506    2548 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"k8s-certs\" (UniqueName: \"kubernetes.io/host-path/e910aaa6f761db2e384bba10355fe9ca-k8s-certs\") pod \"kube-controller-manager-cert-options-20210813143549-8053\" (UID: \"e910aaa6f761db2e384bba10355fe9ca\") "

	Aug 13 21:36:39 cert-options-20210813143549-8053 kubelet[2548]: I0813 21:36:39.964525    2548 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/e910aaa6f761db2e384bba10355fe9ca-usr-share-ca-certificates\") pod \"kube-controller-manager-cert-options-20210813143549-8053\" (UID: \"e910aaa6f761db2e384bba10355fe9ca\") "

	Aug 13 21:36:39 cert-options-20210813143549-8053 kubelet[2548]: I0813 21:36:39.964544    2548 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-certs\" (UniqueName: \"kubernetes.io/host-path/ab78f066b3c12ebba356f45ec36a6b23-etcd-certs\") pod \"etcd-cert-options-20210813143549-8053\" (UID: \"ab78f066b3c12ebba356f45ec36a6b23\") "

	Aug 13 21:36:39 cert-options-20210813143549-8053 kubelet[2548]: I0813 21:36:39.964570    2548 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/95e5f5f4281dcde6357e66dca95d3edc-usr-share-ca-certificates\") pod \"kube-apiserver-cert-options-20210813143549-8053\" (UID: \"95e5f5f4281dcde6357e66dca95d3edc\") "

	Aug 13 21:36:39 cert-options-20210813143549-8053 kubelet[2548]: I0813 21:36:39.964591    2548 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-data\" (UniqueName: \"kubernetes.io/host-path/ab78f066b3c12ebba356f45ec36a6b23-etcd-data\") pod \"etcd-cert-options-20210813143549-8053\" (UID: \"ab78f066b3c12ebba356f45ec36a6b23\") "

	Aug 13 21:36:39 cert-options-20210813143549-8053 kubelet[2548]: I0813 21:36:39.964610    2548 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/d2d1d2fc5cd7ac8e69b8239d4d713d15-kubeconfig\") pod \"kube-scheduler-cert-options-20210813143549-8053\" (UID: \"d2d1d2fc5cd7ac8e69b8239d4d713d15\") "

	Aug 13 21:36:39 cert-options-20210813143549-8053 kubelet[2548]: I0813 21:36:39.964622    2548 reconciler.go:157] "Reconciler: start to sync state"

-- /stdout --

helpers_test.go:255: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.APIServer}} -p cert-options-20210813143549-8053 -n cert-options-20210813143549-8053

helpers_test.go:262: (dbg) Run:  kubectl --context cert-options-20210813143549-8053 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:262: (dbg) Done: kubectl --context cert-options-20210813143549-8053 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running: (2.869498951s)

helpers_test.go:271: non-running pods: coredns-558bd4d5db-9m6lx kube-proxy-bmkcl storage-provisioner

helpers_test.go:273: ======> post-mortem[TestCertOptions]: describe non-running pods <======

helpers_test.go:276: (dbg) Run:  kubectl --context cert-options-20210813143549-8053 describe pod coredns-558bd4d5db-9m6lx kube-proxy-bmkcl storage-provisioner

helpers_test.go:276: (dbg) Non-zero exit: kubectl --context cert-options-20210813143549-8053 describe pod coredns-558bd4d5db-9m6lx kube-proxy-bmkcl storage-provisioner: exit status 1 (82.175779ms)

** stderr ** 

	Error from server (NotFound): pods "coredns-558bd4d5db-9m6lx" not found

	Error from server (NotFound): pods "kube-proxy-bmkcl" not found

	Error from server (NotFound): pods "storage-provisioner" not found

** /stderr **

helpers_test.go:278: kubectl --context cert-options-20210813143549-8053 describe pod coredns-558bd4d5db-9m6lx kube-proxy-bmkcl storage-provisioner: exit status 1

helpers_test.go:176: Cleaning up "cert-options-20210813143549-8053" profile ...

helpers_test.go:179: (dbg) Run:  out/minikube-darwin-amd64 delete -p cert-options-20210813143549-8053

helpers_test.go:179: (dbg) Done: out/minikube-darwin-amd64 delete -p cert-options-20210813143549-8053: (12.089900982s)

--- FAIL: TestCertOptions (70.76s)

=== RUN   TestFunctional/serial/ExtraConfig

functional_test.go:715: (dbg) Run:  out/minikube-darwin-amd64 start -p functional-20210813131926-8053 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all

functional_test.go:715: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p functional-20210813131926-8053 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all: exit status 1 (32.693442849s)

-- stdout --

	* [functional-20210813131926-8053] minikube v1.22.0 on Darwin 11.2.3

	  - MINIKUBE_LOCATION=12230

	  - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube

	* Using the docker driver based on existing profile

	* Starting control plane node functional-20210813131926-8053 in cluster functional-20210813131926-8053

	* Pulling base image ...

	* Updating the running docker "functional-20210813131926-8053" container ...

	* Preparing Kubernetes v1.21.3 on Docker 20.10.8 ...

	  - apiserver.enable-admission-plugins=NamespaceAutoProvision

	* Verifying Kubernetes components...

	  - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	* Enabled addons: storage-provisioner, default-storageclass

-- /stdout --

** stderr ** 

	E0813 13:22:11.523028    9787 pod_ready.go:66] WaitExtra: waitPodCondition: node "functional-20210813131926-8053" hosting pod "etcd-functional-20210813131926-8053" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	E0813 13:22:11.527536    9787 pod_ready.go:66] WaitExtra: waitPodCondition: node "functional-20210813131926-8053" hosting pod "kube-apiserver-functional-20210813131926-8053" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	E0813 13:22:11.531869    9787 pod_ready.go:66] WaitExtra: waitPodCondition: node "functional-20210813131926-8053" hosting pod "kube-controller-manager-functional-20210813131926-8053" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	E0813 13:22:11.537025    9787 pod_ready.go:66] WaitExtra: waitPodCondition: node "functional-20210813131926-8053" hosting pod "kube-proxy-kv9mv" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	E0813 13:22:11.545841    9787 pod_ready.go:66] WaitExtra: waitPodCondition: node "functional-20210813131926-8053" hosting pod "kube-scheduler-functional-20210813131926-8053" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	X Exiting due to GUEST_START: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: error getting node "functional-20210813131926-8053": an error on the server ("") has prevented the request from succeeding (get nodes functional-20210813131926-8053)

	* 

** /stderr **

functional_test.go:717: failed to restart minikube. args "out/minikube-darwin-amd64 start -p functional-20210813131926-8053 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all": exit status 1

functional_test.go:719: restart took 32.693822576s for "functional-20210813131926-8053" cluster.

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:231: ======>  post-mortem[TestFunctional/serial/ExtraConfig]: docker inspect <======

helpers_test.go:232: (dbg) Run:  docker inspect functional-20210813131926-8053

helpers_test.go:236: (dbg) docker inspect functional-20210813131926-8053:

-- stdout --

	[

	    {

	        "Id": "bd6d952ddeb5f310f9e68d0a941d3ceea9f8bcc59b82fe82663073652312e7bf",

	        "Created": "2021-08-13T20:19:33.443339625Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

	        ],

	        "State": {

	            "Status": "running",

	            "Running": true,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 19884,

	            "ExitCode": 0,

	            "Error": "",

	            "StartedAt": "2021-08-13T20:19:45.440445983Z",

	            "FinishedAt": "0001-01-01T00:00:00Z"

	        },

	        "Image": "sha256:965ebc74cb435c5d73c204fcd638e9daa526ad4ce3ec7f76be1149f30a789fab",

	        "ResolvConfPath": "/var/lib/docker/containers/bd6d952ddeb5f310f9e68d0a941d3ceea9f8bcc59b82fe82663073652312e7bf/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/bd6d952ddeb5f310f9e68d0a941d3ceea9f8bcc59b82fe82663073652312e7bf/hostname",

	        "HostsPath": "/var/lib/docker/containers/bd6d952ddeb5f310f9e68d0a941d3ceea9f8bcc59b82fe82663073652312e7bf/hosts",

	        "LogPath": "/var/lib/docker/containers/bd6d952ddeb5f310f9e68d0a941d3ceea9f8bcc59b82fe82663073652312e7bf/bd6d952ddeb5f310f9e68d0a941d3ceea9f8bcc59b82fe82663073652312e7bf-json.log",

	        "Name": "/functional-20210813131926-8053",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "/lib/modules:/lib/modules:ro",

	                "functional-20210813131926-8053:/var"

	            ],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

	            },

	            "NetworkMode": "functional-20210813131926-8053",

	            "PortBindings": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "8441/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ]

	            },

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

	            },

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "CapAdd": null,

	            "CapDrop": null,

	            "CgroupnsMode": "host",

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

	            ],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

	            },

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "ConsoleSize": [

	                0,

	                0

	            ],

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 4194304000,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": null,

	            "BlkioDeviceWriteBps": null,

	            "BlkioDeviceReadIOps": null,

	            "BlkioDeviceWriteIOps": null,

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "KernelMemory": 0,

	            "KernelMemoryTCP": 0,

	            "MemoryReservation": 0,

	            "MemorySwap": 4194304000,

	            "MemorySwappiness": null,

	            "OomKillDisable": false,

	            "PidsLimit": null,

	            "Ulimits": null,

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

	        },

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/3e4f101879c21cc86d3a345e84686ecfb0097ad0ef90e43949ac1917b277a31e-init/diff:/var/lib/docker/overlay2/b54d50d9722d23fb9637685b11892fb665fc20ba78ef431e07ed0ddfa868f7a1/diff:/var/lib/docker/overlay2/1ae49b54a8b23aaf60a7e9c9307ca333358576bae3a785f52751cdad083df982/diff:/var/lib/docker/overlay2/ea6c3052036e679f2d58c32269d4ea3143a3fc6f94abfc4e49173b050ea86a8b/diff:/var/lib/docker/overlay2/2a2dd58c96ee8d28d6328f3dc040dba105ab05a3a180db9efc72ab81c4f2dea8/diff:/var/lib/docker/overlay2/9b983e97e9a66172cc09d2798bfaa346d9fd6426e616339301e3bb8123e0e4f8/diff:/var/lib/docker/overlay2/dfeb06e54a5cea59763125a281a2a6800cd59c816b67601654af91996c53b0e9/diff:/var/lib/docker/overlay2/c9d50722d4822ee84b54a4086271aaa76449764ccee5cd9b3107efe20362db77/diff:/var/lib/docker/overlay2/7146eb1978a4f01c8661964f9a7e8e6900a73759e6d7f926784135a8c3675a0e/diff:/var/lib/docker/overlay2/6bcc532777a8b16bf0a8d49f5eba5dce2dad7acf9dd5d76a36fe91e4865df73c/diff:/var/lib/docker/overlay2/14de3b

84777e6d4bcd5b959be54fc67048ed8595b21548c2cb72c44e5bab5411/diff:/var/lib/docker/overlay2/f1ddefd3cddc8a76bb8102eba187352b3597d4a313ab8481788107dc17bb30be/diff:/var/lib/docker/overlay2/2be5ff1c0f18fc355d3d429c9a258aa1be9e5ebd0dd9b444f05aace4cc7acfea/diff:/var/lib/docker/overlay2/d1937ecc380ba5be5a64d9961a07aa0fa09d55136209e276d6ab5a08a2a5ce3c/diff:/var/lib/docker/overlay2/4b9bb8d1431c5ac321918e64797c008658b5e0db3587b9e7f484d00192b5a4be/diff:/var/lib/docker/overlay2/f9e7584420f2143a3affbe57ddd381ed9799067270b57d06e1af337987563637/diff:/var/lib/docker/overlay2/1ae74edd645de1296fe2ff40ac0d7659d56c4af7676d1e2b7077666f5cb598c4/diff:/var/lib/docker/overlay2/33df86dfa679c1be13df61855de34c224815a39320b3ee12131540df41ef4561/diff:/var/lib/docker/overlay2/eb8b1800e30954e5cf6fc67fbfa89db41d615ee50103aa0589446907b8c7ac49/diff:/var/lib/docker/overlay2/5c052f8924308a6f0fe3ae4941882e4b909ed1aeb01123b9e2faa7df2696de93/diff:/var/lib/docker/overlay2/69b433d87c6a506c3d510619bb41e8737b7e3d06bac5eb128be3e00efb740b98/diff:/var/lib/d

ocker/overlay2/c07998bd533865848849c722ed55cfa571f9562726f3fdb9bfd15f7b5936a8e6/diff:/var/lib/docker/overlay2/3df1a883fd0d44918646d29788faa76a5e7aaaf4b46a6ea2240c9d4b8bd4dc09/diff:/var/lib/docker/overlay2/9f2a07552f95e43119898b9bbe1e61d165ecd9eb3e862730a04a643bcc53a8c6/diff:/var/lib/docker/overlay2/fd2df25ca7e6b268f819b2fb38bbab50fbd5c6c8a4a2b4778f3917e567c64b8b/diff:/var/lib/docker/overlay2/a4639cb93382ebf39584a53948b6816dc6aa8e7011f2474b82320e09565c40ee/diff:/var/lib/docker/overlay2/16f320558e9c6c23b229f8b4dcf6f5c61670fa7b6513b707c1ceee8ff53ab012/diff:/var/lib/docker/overlay2/efde92a54c645d3d214babfea86fe173c88681a9a8bf1ee4c66f406eac0ce1f3/diff:/var/lib/docker/overlay2/67c175358f08a90e727cc2e59d3dc3f243bf98721348962ca80cedaa946e11e5/diff:/var/lib/docker/overlay2/abce6c2b52def112a2855b7240dfeb6e7ce8747ff80ae82b8c90df4358b5499f/diff:/var/lib/docker/overlay2/04adc9448565c768e00d76ed848aec196d92c4bcb1ba0268162b97accedfe7c0/diff:/var/lib/docker/overlay2/785c77e0f49a7d75d4a92bd8febab1b2a23633cd8c7be0e16fc628afb34

bcd83/diff:/var/lib/docker/overlay2/6716a51894c949d720d02845ebfc34f1d9f2431f04ffc2521d1b4fdf617ba172/diff:/var/lib/docker/overlay2/f7a3d7b89f4cc68fc5e0dd1756a2ae6260c2f0f5ab4bc40c3ce6b1b4d6ef0004/diff:/var/lib/docker/overlay2/91b9a991885a072e8afd1908c183be7e860cef03f6b3fbb173e06fdc90db2527/diff:/var/lib/docker/overlay2/8f4a011cc74f93ad854a02453507ef603a3da67ee7a766dfca38d3a46f5cdfb9/diff:/var/lib/docker/overlay2/b26e3ade0d328d23c224932591c878b90768d1c5e7058ccb26382021520bd343/diff",

	                "MergedDir": "/var/lib/docker/overlay2/3e4f101879c21cc86d3a345e84686ecfb0097ad0ef90e43949ac1917b277a31e/merged",

	                "UpperDir": "/var/lib/docker/overlay2/3e4f101879c21cc86d3a345e84686ecfb0097ad0ef90e43949ac1917b277a31e/diff",

	                "WorkDir": "/var/lib/docker/overlay2/3e4f101879c21cc86d3a345e84686ecfb0097ad0ef90e43949ac1917b277a31e/work"

	            },

	            "Name": "overlay2"

	        },

	        "Mounts": [

	            {

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

	            },

	            {

	                "Type": "volume",

	                "Name": "functional-20210813131926-8053",

	                "Source": "/var/lib/docker/volumes/functional-20210813131926-8053/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

	            }

	        ],

	        "Config": {

	            "Hostname": "functional-20210813131926-8053",

	            "Domainname": "",

	            "User": "root",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8441/tcp": {}

	            },

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

	            ],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6",

	            "Volumes": null,

	            "WorkingDir": "",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

	            ],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "functional-20210813131926-8053",

	                "name.minikube.sigs.k8s.io": "functional-20210813131926-8053",

	                "role.minikube.sigs.k8s.io": ""

	            },

	            "StopSignal": "SIGRTMIN+3"

	        },

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "fffc56d9ef4e71afae913f074fc77456290700b22c27c1f9874cc15c0358d2a3",

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "Ports": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "59731"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "59727"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "59728"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "59729"

	                    }

	                ],

	                "8441/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "59730"

	                    }

	                ]

	            },

	            "SandboxKey": "/var/run/docker/netns/fffc56d9ef4e",

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "functional-20210813131926-8053": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.49.2"

	                    },

	                    "Links": null,

	                    "Aliases": [

	                        "bd6d952ddeb5",

	                        "functional-20210813131926-8053"

	                    ],

	                    "NetworkID": "743ef3df7ddcc98a6822c8028d2b77ac28e2e76e3cc13ccd232db1d778dce820",

	                    "EndpointID": "9696b4dcace8ca7aad9efa41f1202a5fb2b54319373b4ef9628f151b3d732e54",

	                    "Gateway": "192.168.49.1",

	                    "IPAddress": "192.168.49.2",

	                    "IPPrefixLen": 24,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "MacAddress": "02:42:c0:a8:31:02",

	                    "DriverOpts": null

	                }

	            }

	        }

	    }

	]

-- /stdout --

helpers_test.go:240: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-20210813131926-8053 -n functional-20210813131926-8053

helpers_test.go:240: (dbg) Done: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-20210813131926-8053 -n functional-20210813131926-8053: (14.644022933s)

helpers_test.go:245: <<< TestFunctional/serial/ExtraConfig FAILED: start of post-mortem logs <<<

helpers_test.go:246: ======>  post-mortem[TestFunctional/serial/ExtraConfig]: minikube logs <======

helpers_test.go:248: (dbg) Run:  out/minikube-darwin-amd64 -p functional-20210813131926-8053 logs -n 25

helpers_test.go:248: (dbg) Done: out/minikube-darwin-amd64 -p functional-20210813131926-8053 logs -n 25: (3.345597033s)

helpers_test.go:253: TestFunctional/serial/ExtraConfig logs: 

-- stdout --

	* 

	* ==> Audit <==

	* |---------|-----------------------------------------------------------------------------|--------------------------------|---------|---------|-------------------------------|-------------------------------|

	| Command |                                    Args                                     |            Profile             |  User   | Version |          Start Time           |           End Time            |

	|---------|-----------------------------------------------------------------------------|--------------------------------|---------|---------|-------------------------------|-------------------------------|

	| -p      | nospam-20210813131728-8053 --log_dir                                        | nospam-20210813131728-8053     | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:18:58 PDT | Fri, 13 Aug 2021 13:18:59 PDT |

	|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-20210813131728-8053 |                                |         |         |                               |                               |

	|         | pause                                                                       |                                |         |         |                               |                               |

	| -p      | nospam-20210813131728-8053 --log_dir                                        | nospam-20210813131728-8053     | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:18:59 PDT | Fri, 13 Aug 2021 13:18:59 PDT |

	|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-20210813131728-8053 |                                |         |         |                               |                               |

	|         | unpause                                                                     |                                |         |         |                               |                               |

	| -p      | nospam-20210813131728-8053 --log_dir                                        | nospam-20210813131728-8053     | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:18:59 PDT | Fri, 13 Aug 2021 13:19:00 PDT |

	|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-20210813131728-8053 |                                |         |         |                               |                               |

	|         | unpause                                                                     |                                |         |         |                               |                               |

	| -p      | nospam-20210813131728-8053 --log_dir                                        | nospam-20210813131728-8053     | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:19:00 PDT | Fri, 13 Aug 2021 13:19:01 PDT |

	|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-20210813131728-8053 |                                |         |         |                               |                               |

	|         | unpause                                                                     |                                |         |         |                               |                               |

	| -p      | nospam-20210813131728-8053 --log_dir                                        | nospam-20210813131728-8053     | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:19:01 PDT | Fri, 13 Aug 2021 13:19:18 PDT |

	|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-20210813131728-8053 |                                |         |         |                               |                               |

	|         | stop                                                                        |                                |         |         |                               |                               |

	| -p      | nospam-20210813131728-8053 --log_dir                                        | nospam-20210813131728-8053     | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:19:18 PDT | Fri, 13 Aug 2021 13:19:19 PDT |

	|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-20210813131728-8053 |                                |         |         |                               |                               |

	|         | stop                                                                        |                                |         |         |                               |                               |

	| -p      | nospam-20210813131728-8053 --log_dir                                        | nospam-20210813131728-8053     | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:19:19 PDT | Fri, 13 Aug 2021 13:19:19 PDT |

	|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-20210813131728-8053 |                                |         |         |                               |                               |

	|         | stop                                                                        |                                |         |         |                               |                               |

	| delete  | -p nospam-20210813131728-8053                                               | nospam-20210813131728-8053     | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:19:19 PDT | Fri, 13 Aug 2021 13:19:25 PDT |

	| start   | -p                                                                          | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:19:26 PDT | Fri, 13 Aug 2021 13:21:30 PDT |

	|         | functional-20210813131926-8053                                              |                                |         |         |                               |                               |

	|         | --memory=4000                                                               |                                |         |         |                               |                               |

	|         | --apiserver-port=8441                                                       |                                |         |         |                               |                               |

	|         | --wait=all --driver=docker                                                  |                                |         |         |                               |                               |

	| start   | -p                                                                          | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:30 PDT | Fri, 13 Aug 2021 13:21:38 PDT |

	|         | functional-20210813131926-8053                                              |                                |         |         |                               |                               |

	|         | --alsologtostderr -v=8                                                      |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                              | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:40 PDT | Fri, 13 Aug 2021 13:21:41 PDT |

	|         | cache add k8s.gcr.io/pause:3.1                                              |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                              | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:41 PDT | Fri, 13 Aug 2021 13:21:44 PDT |

	|         | cache add k8s.gcr.io/pause:3.3                                              |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                              | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:44 PDT | Fri, 13 Aug 2021 13:21:46 PDT |

	|         | cache add                                                                   |                                |         |         |                               |                               |

	|         | k8s.gcr.io/pause:latest                                                     |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053 cache add                                    | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:46 PDT | Fri, 13 Aug 2021 13:21:48 PDT |

	|         | minikube-local-cache-test:functional-20210813131926-8053                    |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053 cache delete                                 | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:48 PDT | Fri, 13 Aug 2021 13:21:48 PDT |

	|         | minikube-local-cache-test:functional-20210813131926-8053                    |                                |         |         |                               |                               |

	| cache   | delete k8s.gcr.io/pause:3.3                                                 | minikube                       | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:48 PDT | Fri, 13 Aug 2021 13:21:48 PDT |

	| cache   | list                                                                        | minikube                       | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:48 PDT | Fri, 13 Aug 2021 13:21:48 PDT |

	| -p      | functional-20210813131926-8053                                              | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:48 PDT | Fri, 13 Aug 2021 13:21:49 PDT |

	|         | ssh sudo crictl images                                                      |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                              | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:49 PDT | Fri, 13 Aug 2021 13:21:50 PDT |

	|         | ssh sudo docker rmi                                                         |                                |         |         |                               |                               |

	|         | k8s.gcr.io/pause:latest                                                     |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                              | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:50 PDT | Fri, 13 Aug 2021 13:21:52 PDT |

	|         | cache reload                                                                |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                              | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:52 PDT | Fri, 13 Aug 2021 13:21:53 PDT |

	|         | ssh sudo crictl inspecti                                                    |                                |         |         |                               |                               |

	|         | k8s.gcr.io/pause:latest                                                     |                                |         |         |                               |                               |

	| cache   | delete k8s.gcr.io/pause:3.1                                                 | minikube                       | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:53 PDT | Fri, 13 Aug 2021 13:21:53 PDT |

	| cache   | delete k8s.gcr.io/pause:latest                                              | minikube                       | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:53 PDT | Fri, 13 Aug 2021 13:21:53 PDT |

	| -p      | functional-20210813131926-8053                                              | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:53 PDT | Fri, 13 Aug 2021 13:21:53 PDT |

	|         | kubectl -- --context                                                        |                                |         |         |                               |                               |

	|         | functional-20210813131926-8053                                              |                                |         |         |                               |                               |

	|         | get pods                                                                    |                                |         |         |                               |                               |

	| kubectl | --profile=functional-20210813131926-8053                                    | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:54 PDT | Fri, 13 Aug 2021 13:21:54 PDT |

	|         | -- --context                                                                |                                |         |         |                               |                               |

	|         | functional-20210813131926-8053 get pods                                     |                                |         |         |                               |                               |

	|---------|-----------------------------------------------------------------------------|--------------------------------|---------|---------|-------------------------------|-------------------------------|

	* 

	* ==> Last Start <==

	* Log file created at: 2021/08/13 13:21:54

	Running on machine: 37309

	Binary: Built with gc go1.16.7 for darwin/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0813 13:21:54.281145    9787 out.go:298] Setting OutFile to fd 1 ...

	I0813 13:21:54.281275    9787 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0813 13:21:54.281277    9787 out.go:311] Setting ErrFile to fd 2...

	I0813 13:21:54.281279    9787 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0813 13:21:54.281354    9787 root.go:313] Updating PATH: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/bin

	I0813 13:21:54.281600    9787 out.go:305] Setting JSON to false

	I0813 13:21:54.299621    9787 start.go:111] hostinfo: {"hostname":"37309.local","uptime":4889,"bootTime":1628881225,"procs":312,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"11.2.3","kernelVersion":"20.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"c86236b2-4976-3542-80ca-74a6b8b4ba03"}

	W0813 13:21:54.299706    9787 start.go:119] gopshost.Virtualization returned error: not implemented yet

	I0813 13:21:54.326713    9787 out.go:177] * [functional-20210813131926-8053] minikube v1.22.0 on Darwin 11.2.3

	I0813 13:21:54.326846    9787 notify.go:169] Checking for updates...

	I0813 13:21:54.390409    9787 out.go:177]   - MINIKUBE_LOCATION=12230

	I0813 13:21:54.416142    9787 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/kubeconfig

	I0813 13:21:54.442299    9787 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64

	I0813 13:21:54.468300    9787 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube

	I0813 13:21:54.468666    9787 config.go:177] Loaded profile config "functional-20210813131926-8053": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.21.3

	I0813 13:21:54.468700    9787 driver.go:335] Setting default libvirt URI to qemu:///system

	I0813 13:21:54.567961    9787 docker.go:132] docker version: linux-20.10.6

	I0813 13:21:54.568092    9787 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I0813 13:21:54.749184    9787 info.go:263] docker info: {ID:43SM:MII3:NWBL:WJUG:JMKA:JL3W:EOOO:ZEGZ:7ZJH:ECYZ:GXPQ:XAL7 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:19 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:50 OomKillDisable:true NGoroutines:53 SystemTime:2021-08-13 20:21:54.680984807 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.25-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServer

Address:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6234726400 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.6 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05f951a3781f4f2c1911b05e61c160e9c30eaa8e Expected:05f951a3781f4f2c1911b05e61c160e9c30eaa8e} RuncCommit:{ID:12644e614e25b05da6fd08a38ffa0cfe1903fdec Expected:12644e614e25b05da6fd08a38ffa0cfe1903fdec} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=sec

comp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/local/lib/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Build with BuildKit Vendor:Docker Inc. Version:v0.5.1-docker] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:2.0.0-beta.1] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.8.0]] Warnings:<nil>}}

	I0813 13:21:54.775889    9787 out.go:177] * Using the docker driver based on existing profile

	I0813 13:21:54.775914    9787 start.go:278] selected driver: docker

	I0813 13:21:54.775919    9787 start.go:751] validating driver "docker" against &{Name:functional-20210813131926-8053 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.21.3 ClusterName:functional-20210813131926-8053 Namespace:default APIServerN

ame:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.21.3 ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false helm-tiller:false ingress:false ingress-dns:false istio:false istio-provisioner:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false] CustomAddon

Images:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0813 13:21:54.775984    9787 start.go:762] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}

	I0813 13:21:54.776188    9787 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I0813 13:21:54.961751    9787 info.go:263] docker info: {ID:43SM:MII3:NWBL:WJUG:JMKA:JL3W:EOOO:ZEGZ:7ZJH:ECYZ:GXPQ:XAL7 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:19 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:50 OomKillDisable:true NGoroutines:53 SystemTime:2021-08-13 20:21:54.893644183 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.25-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServer

Address:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6234726400 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.6 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05f951a3781f4f2c1911b05e61c160e9c30eaa8e Expected:05f951a3781f4f2c1911b05e61c160e9c30eaa8e} RuncCommit:{ID:12644e614e25b05da6fd08a38ffa0cfe1903fdec Expected:12644e614e25b05da6fd08a38ffa0cfe1903fdec} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=sec

comp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/local/lib/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Build with BuildKit Vendor:Docker Inc. Version:v0.5.1-docker] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:2.0.0-beta.1] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.8.0]] Warnings:<nil>}}

	I0813 13:21:54.964167    9787 start_flags.go:697] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0813 13:21:54.964195    9787 cni.go:93] Creating CNI manager for ""

	I0813 13:21:54.964201    9787 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I0813 13:21:54.964210    9787 start_flags.go:277] config:

	{Name:functional-20210813131926-8053 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.21.3 ClusterName:functional-20210813131926-8053 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Contain

erRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.21.3 ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false helm-tiller:false ingress:false ingress-dns:false istio:false istio-provisioner:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false] CustomAddonI

mages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0813 13:21:54.991369    9787 out.go:177] * Starting control plane node functional-20210813131926-8053 in cluster functional-20210813131926-8053

	I0813 13:21:54.991429    9787 cache.go:117] Beginning downloading kic base image for docker with docker

	I0813 13:21:55.059928    9787 out.go:177] * Pulling base image ...

	I0813 13:21:55.060060    9787 preload.go:131] Checking if preload exists for k8s version v1.21.3 and runtime docker

	I0813 13:21:55.060069    9787 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 in local docker daemon

	I0813 13:21:55.060163    9787 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.3-docker-overlay2-amd64.tar.lz4

	I0813 13:21:55.060181    9787 cache.go:56] Caching tarball of preloaded images

	I0813 13:21:55.060344    9787 preload.go:173] Found /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I0813 13:21:55.060355    9787 cache.go:59] Finished verifying existence of preloaded tar for  v1.21.3 on docker

	I0813 13:21:55.061830    9787 profile.go:148] Saving config to /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/functional-20210813131926-8053/config.json ...

	I0813 13:21:55.184646    9787 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 in local docker daemon, skipping pull

	I0813 13:21:55.184655    9787 cache.go:139] gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 exists in daemon, skipping load

	I0813 13:21:55.184665    9787 cache.go:205] Successfully downloaded all kic artifacts

	I0813 13:21:55.184720    9787 start.go:313] acquiring machines lock for functional-20210813131926-8053: {Name:mkc1b35540cb8690340beda05ed315b2f6e71bd5 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0813 13:21:55.184824    9787 start.go:317] acquired machines lock for "functional-20210813131926-8053" in 88.909µs

	I0813 13:21:55.184844    9787 start.go:93] Skipping create...Using existing machine configuration

	I0813 13:21:55.184850    9787 fix.go:55] fixHost starting: 

	I0813 13:21:55.185122    9787 cli_runner.go:115] Run: docker container inspect functional-20210813131926-8053 --format={{.State.Status}}

	I0813 13:21:55.302303    9787 fix.go:108] recreateIfNeeded on functional-20210813131926-8053: state=Running err=<nil>

	W0813 13:21:55.302324    9787 fix.go:134] unexpected machine state, will restart: <nil>

	I0813 13:21:55.329065    9787 out.go:177] * Updating the running docker "functional-20210813131926-8053" container ...

	I0813 13:21:55.329107    9787 machine.go:88] provisioning docker machine ...

	I0813 13:21:55.329153    9787 ubuntu.go:169] provisioning hostname "functional-20210813131926-8053"

	I0813 13:21:55.329300    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:55.448112    9787 main.go:130] libmachine: Using SSH client type: native

	I0813 13:21:55.448292    9787 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x13fa2e0] 0x13fa2a0 <nil>  [] 0s} 127.0.0.1 59731 <nil> <nil>}

	I0813 13:21:55.448311    9787 main.go:130] libmachine: About to run SSH command:

	sudo hostname functional-20210813131926-8053 && echo "functional-20210813131926-8053" | sudo tee /etc/hostname

	I0813 13:21:55.585147    9787 main.go:130] libmachine: SSH cmd err, output: <nil>: functional-20210813131926-8053

	I0813 13:21:55.585238    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:55.702492    9787 main.go:130] libmachine: Using SSH client type: native

	I0813 13:21:55.702674    9787 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x13fa2e0] 0x13fa2a0 <nil>  [] 0s} 127.0.0.1 59731 <nil> <nil>}

	I0813 13:21:55.702691    9787 main.go:130] libmachine: About to run SSH command:

			if ! grep -xq '.*\sfunctional-20210813131926-8053' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 functional-20210813131926-8053/g' /etc/hosts;

				else 

					echo '127.0.1.1 functional-20210813131926-8053' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0813 13:21:55.832252    9787 main.go:130] libmachine: SSH cmd err, output: <nil>: 

	I0813 13:21:55.832283    9787 ubuntu.go:175] set auth options {CertDir:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube CaCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/se

rver.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube}

	I0813 13:21:55.832316    9787 ubuntu.go:177] setting up certificates

	I0813 13:21:55.832332    9787 provision.go:83] configureAuth start

	I0813 13:21:55.832440    9787 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" functional-20210813131926-8053

	I0813 13:21:55.949496    9787 provision.go:138] copyHostCerts

	I0813 13:21:55.949586    9787 exec_runner.go:145] found /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.pem, removing ...

	I0813 13:21:55.949592    9787 exec_runner.go:190] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.pem

	I0813 13:21:55.949692    9787 exec_runner.go:152] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.pem (1082 bytes)

	I0813 13:21:55.949885    9787 exec_runner.go:145] found /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cert.pem, removing ...

	I0813 13:21:55.949892    9787 exec_runner.go:190] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cert.pem

	I0813 13:21:55.949956    9787 exec_runner.go:152] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cert.pem (1123 bytes)

	I0813 13:21:55.950102    9787 exec_runner.go:145] found /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/key.pem, removing ...

	I0813 13:21:55.950105    9787 exec_runner.go:190] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/key.pem

	I0813 13:21:55.950159    9787 exec_runner.go:152] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/key.pem (1675 bytes)

	I0813 13:21:55.950267    9787 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca-key.pem org=jenkins.functional-20210813131926-8053 san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube functional-20210813131926-8053]

	I0813 13:21:56.044777    9787 provision.go:172] copyRemoteCerts

	I0813 13:21:56.044832    9787 ssh_runner.go:149] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0813 13:21:56.044901    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:56.176574    9787 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:59731 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/functional-20210813131926-8053/id_rsa Username:docker}

	I0813 13:21:56.266936    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0813 13:21:56.285493    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server.pem --> /etc/docker/server.pem (1265 bytes)

	I0813 13:21:56.301792    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0813 13:21:56.318533    9787 provision.go:86] duration metric: configureAuth took 486.190467ms

	I0813 13:21:56.318541    9787 ubuntu.go:193] setting minikube options for container-runtime

	I0813 13:21:56.318718    9787 config.go:177] Loaded profile config "functional-20210813131926-8053": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.21.3

	I0813 13:21:56.318783    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:56.437674    9787 main.go:130] libmachine: Using SSH client type: native

	I0813 13:21:56.437827    9787 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x13fa2e0] 0x13fa2a0 <nil>  [] 0s} 127.0.0.1 59731 <nil> <nil>}

	I0813 13:21:56.437836    9787 main.go:130] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0813 13:21:56.563851    9787 main.go:130] libmachine: SSH cmd err, output: <nil>: overlay

	I0813 13:21:56.563864    9787 ubuntu.go:71] root file system type: overlay

	I0813 13:21:56.563998    9787 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I0813 13:21:56.564091    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:56.681639    9787 main.go:130] libmachine: Using SSH client type: native

	I0813 13:21:56.681807    9787 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x13fa2e0] 0x13fa2a0 <nil>  [] 0s} 127.0.0.1 59731 <nil> <nil>}

	I0813 13:21:56.681858    9787 main.go:130] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0813 13:21:56.819969    9787 main.go:130] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0813 13:21:56.820085    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:56.936161    9787 main.go:130] libmachine: Using SSH client type: native

	I0813 13:21:56.936301    9787 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x13fa2e0] 0x13fa2a0 <nil>  [] 0s} 127.0.0.1 59731 <nil> <nil>}

	I0813 13:21:56.936316    9787 main.go:130] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0813 13:21:57.070630    9787 main.go:130] libmachine: SSH cmd err, output: <nil>: 

	I0813 13:21:57.070642    9787 machine.go:91] provisioned docker machine in 1.741524027s

	I0813 13:21:57.070650    9787 start.go:267] post-start starting for "functional-20210813131926-8053" (driver="docker")

	I0813 13:21:57.070654    9787 start.go:277] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0813 13:21:57.070719    9787 ssh_runner.go:149] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0813 13:21:57.070786    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:57.185365    9787 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:59731 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/functional-20210813131926-8053/id_rsa Username:docker}

	I0813 13:21:57.278255    9787 ssh_runner.go:149] Run: cat /etc/os-release

	I0813 13:21:57.282084    9787 main.go:130] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found

	I0813 13:21:57.282094    9787 main.go:130] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found

	I0813 13:21:57.282099    9787 main.go:130] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found

	I0813 13:21:57.282104    9787 info.go:137] Remote host: Ubuntu 20.04.2 LTS

	I0813 13:21:57.282110    9787 filesync.go:126] Scanning /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/addons for local assets ...

	I0813 13:21:57.282205    9787 filesync.go:126] Scanning /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files for local assets ...

	I0813 13:21:57.282364    9787 filesync.go:149] local asset: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/80532.pem -> 80532.pem in /etc/ssl/certs

	I0813 13:21:57.282524    9787 filesync.go:149] local asset: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/test/nested/copy/8053/hosts -> hosts in /etc/test/nested/copy/8053

	I0813 13:21:57.282577    9787 ssh_runner.go:149] Run: sudo mkdir -p /etc/ssl/certs /etc/test/nested/copy/8053

	I0813 13:21:57.289648    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/80532.pem --> /etc/ssl/certs/80532.pem (1708 bytes)

	I0813 13:21:57.305812    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/test/nested/copy/8053/hosts --> /etc/test/nested/copy/8053/hosts (40 bytes)

	I0813 13:21:57.322252    9787 start.go:270] post-start completed in 251.592835ms

	I0813 13:21:57.322333    9787 ssh_runner.go:149] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0813 13:21:57.322390    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:57.441126    9787 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:59731 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/functional-20210813131926-8053/id_rsa Username:docker}

	I0813 13:21:57.530205    9787 fix.go:57] fixHost completed within 2.345344178s

	I0813 13:21:57.530220    9787 start.go:80] releasing machines lock for "functional-20210813131926-8053", held for 2.345384882s

	I0813 13:21:57.530368    9787 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" functional-20210813131926-8053

	I0813 13:21:57.649353    9787 ssh_runner.go:149] Run: curl -sS -m 2 https://k8s.gcr.io/

	I0813 13:21:57.649366    9787 ssh_runner.go:149] Run: systemctl --version

	I0813 13:21:57.649430    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:57.649444    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:57.779721    9787 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:59731 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/functional-20210813131926-8053/id_rsa Username:docker}

	I0813 13:21:57.779920    9787 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:59731 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/functional-20210813131926-8053/id_rsa Username:docker}

	I0813 13:21:57.870055    9787 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service containerd

	I0813 13:21:57.969894    9787 ssh_runner.go:149] Run: sudo systemctl cat docker.service

	I0813 13:21:57.979713    9787 cruntime.go:249] skipping containerd shutdown because we are bound to it

	I0813 13:21:57.979768    9787 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service crio

	I0813 13:21:57.989737    9787 ssh_runner.go:149] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/dockershim.sock

	image-endpoint: unix:///var/run/dockershim.sock

	" | sudo tee /etc/crictl.yaml"

	I0813 13:21:58.002260    9787 ssh_runner.go:149] Run: sudo systemctl unmask docker.service

	I0813 13:21:58.070268    9787 ssh_runner.go:149] Run: sudo systemctl enable docker.socket

	I0813 13:21:58.143885    9787 ssh_runner.go:149] Run: sudo systemctl cat docker.service

	I0813 13:21:58.153464    9787 ssh_runner.go:149] Run: sudo systemctl daemon-reload

	I0813 13:21:58.227112    9787 ssh_runner.go:149] Run: sudo systemctl start docker

	I0813 13:21:58.236571    9787 ssh_runner.go:149] Run: docker version --format {{.Server.Version}}

	I0813 13:21:58.275161    9787 ssh_runner.go:149] Run: docker version --format {{.Server.Version}}

	I0813 13:21:58.361792    9787 out.go:204] * Preparing Kubernetes v1.21.3 on Docker 20.10.8 ...

	I0813 13:21:58.361961    9787 cli_runner.go:115] Run: docker exec -t functional-20210813131926-8053 dig +short host.docker.internal

	I0813 13:21:58.547479    9787 network.go:69] got host ip for mount in container by digging dns: 192.168.65.2

	I0813 13:21:58.547597    9787 ssh_runner.go:149] Run: grep 192.168.65.2	host.minikube.internal$ /etc/hosts

	I0813 13:21:58.552110    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8441/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:58.698484    9787 out.go:177]   - apiserver.enable-admission-plugins=NamespaceAutoProvision

	I0813 13:21:58.698634    9787 preload.go:131] Checking if preload exists for k8s version v1.21.3 and runtime docker

	I0813 13:21:58.698805    9787 ssh_runner.go:149] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0813 13:21:58.729603    9787 docker.go:535] Got preloaded images: -- stdout --

	k8s.gcr.io/kube-apiserver:v1.21.3

	k8s.gcr.io/kube-scheduler:v1.21.3

	k8s.gcr.io/kube-proxy:v1.21.3

	k8s.gcr.io/kube-controller-manager:v1.21.3

	minikube-local-cache-test:functional-20210813131926-8053

	gcr.io/k8s-minikube/storage-provisioner:v5

	k8s.gcr.io/pause:3.4.1

	kubernetesui/dashboard:v2.1.0

	k8s.gcr.io/coredns/coredns:v1.8.0

	k8s.gcr.io/etcd:3.4.13-0

	k8s.gcr.io/pause:3.3

	kubernetesui/metrics-scraper:v1.0.4

	k8s.gcr.io/pause:3.1

	k8s.gcr.io/pause:latest

	-- /stdout --

	I0813 13:21:58.729614    9787 docker.go:466] Images already preloaded, skipping extraction

	I0813 13:21:58.729700    9787 ssh_runner.go:149] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0813 13:21:58.758863    9787 docker.go:535] Got preloaded images: -- stdout --

	k8s.gcr.io/kube-apiserver:v1.21.3

	k8s.gcr.io/kube-scheduler:v1.21.3

	k8s.gcr.io/kube-proxy:v1.21.3

	k8s.gcr.io/kube-controller-manager:v1.21.3

	minikube-local-cache-test:functional-20210813131926-8053

	gcr.io/k8s-minikube/storage-provisioner:v5

	k8s.gcr.io/pause:3.4.1

	kubernetesui/dashboard:v2.1.0

	k8s.gcr.io/coredns/coredns:v1.8.0

	k8s.gcr.io/etcd:3.4.13-0

	k8s.gcr.io/pause:3.3

	kubernetesui/metrics-scraper:v1.0.4

	k8s.gcr.io/pause:3.1

	k8s.gcr.io/pause:latest

	-- /stdout --

	I0813 13:21:58.758872    9787 cache_images.go:74] Images are preloaded, skipping loading

	I0813 13:21:58.758968    9787 ssh_runner.go:149] Run: docker info --format {{.CgroupDriver}}

	I0813 13:21:58.836165    9787 extraconfig.go:124] Overwriting default enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota with user provided enable-admission-plugins=NamespaceAutoProvision for component apiserver

	I0813 13:21:58.836186    9787 cni.go:93] Creating CNI manager for ""

	I0813 13:21:58.836195    9787 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I0813 13:21:58.836203    9787 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I0813 13:21:58.836216    9787 kubeadm.go:153] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8441 KubernetesVersion:v1.21.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:functional-20210813131926-8053 NodeName:functional-20210813131926-8053 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceAutoProvision] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}

	I0813 13:21:58.836321    9787 kubeadm.go:157] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.49.2

	  bindPort: 8441

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: /var/run/dockershim.sock

	  name: "functional-20210813131926-8053"

	  kubeletExtraArgs:

	    node-ip: 192.168.49.2

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceAutoProvision"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8441

	dns:

	  type: CoreDNS

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.21.3

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0813 13:21:58.836398    9787 kubeadm.go:909] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.21.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=functional-20210813131926-8053 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2

	[Install]

	 config:

	{KubernetesVersion:v1.21.3 ClusterName:functional-20210813131926-8053 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:}

	I0813 13:21:58.836468    9787 ssh_runner.go:149] Run: sudo ls /var/lib/minikube/binaries/v1.21.3

	I0813 13:21:58.843899    9787 binaries.go:44] Found k8s binaries, skipping transfer

	I0813 13:21:58.843961    9787 ssh_runner.go:149] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0813 13:21:58.850752    9787 ssh_runner.go:316] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (356 bytes)

	I0813 13:21:58.863434    9787 ssh_runner.go:316] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0813 13:21:58.875415    9787 ssh_runner.go:316] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (1923 bytes)

	I0813 13:21:58.887646    9787 ssh_runner.go:149] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts

	I0813 13:21:58.891653    9787 certs.go:52] Setting up /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/functional-20210813131926-8053 for IP: 192.168.49.2

	I0813 13:21:58.891733    9787 certs.go:179] skipping minikubeCA CA generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.key

	I0813 13:21:58.891764    9787 certs.go:179] skipping proxyClientCA CA generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.key

	I0813 13:21:58.891832    9787 certs.go:293] skipping minikube-user signed cert generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/functional-20210813131926-8053/client.key

	I0813 13:21:58.891864    9787 certs.go:293] skipping minikube signed cert generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/functional-20210813131926-8053/apiserver.key.dd3b5fb2

	I0813 13:21:58.891898    9787 certs.go:293] skipping aggregator signed cert generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/functional-20210813131926-8053/proxy-client.key

	I0813 13:21:58.892101    9787 certs.go:376] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/8053.pem (1338 bytes)

	W0813 13:21:58.892147    9787 certs.go:372] ignoring /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/8053_empty.pem, impossibly tiny 0 bytes

	I0813 13:21:58.892159    9787 certs.go:376] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca-key.pem (1675 bytes)

	I0813 13:21:58.892196    9787 certs.go:376] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem (1082 bytes)

	I0813 13:21:58.892231    9787 certs.go:376] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/cert.pem (1123 bytes)

	I0813 13:21:58.892268    9787 certs.go:376] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/key.pem (1675 bytes)

	I0813 13:21:58.892332    9787 certs.go:376] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/80532.pem (1708 bytes)

	I0813 13:21:58.893223    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/functional-20210813131926-8053/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I0813 13:21:58.909719    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/functional-20210813131926-8053/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0813 13:21:58.925905    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/functional-20210813131926-8053/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0813 13:21:58.942022    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/functional-20210813131926-8053/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0813 13:21:58.958623    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0813 13:21:58.975085    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I0813 13:21:58.991264    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0813 13:21:59.007328    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I0813 13:21:59.023488    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/8053.pem --> /usr/share/ca-certificates/8053.pem (1338 bytes)

	I0813 13:21:59.040270    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/80532.pem --> /usr/share/ca-certificates/80532.pem (1708 bytes)

	I0813 13:21:59.056327    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0813 13:21:59.072475    9787 ssh_runner.go:316] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0813 13:21:59.084536    9787 ssh_runner.go:149] Run: openssl version

	I0813 13:21:59.089935    9787 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/80532.pem && ln -fs /usr/share/ca-certificates/80532.pem /etc/ssl/certs/80532.pem"

	I0813 13:21:59.097684    9787 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/80532.pem

	I0813 13:21:59.101594    9787 certs.go:419] hashing: -rw-r--r-- 1 root root 1708 Aug 13 20:19 /usr/share/ca-certificates/80532.pem

	I0813 13:21:59.101643    9787 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/80532.pem

	I0813 13:21:59.107144    9787 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/80532.pem /etc/ssl/certs/3ec20f2e.0"

	I0813 13:21:59.114076    9787 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0813 13:21:59.121539    9787 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0813 13:21:59.125540    9787 certs.go:419] hashing: -rw-r--r-- 1 root root 1111 Aug 13 20:16 /usr/share/ca-certificates/minikubeCA.pem

	I0813 13:21:59.125584    9787 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0813 13:21:59.130700    9787 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0813 13:21:59.137797    9787 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/8053.pem && ln -fs /usr/share/ca-certificates/8053.pem /etc/ssl/certs/8053.pem"

	I0813 13:21:59.145736    9787 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/8053.pem

	I0813 13:21:59.149426    9787 certs.go:419] hashing: -rw-r--r-- 1 root root 1338 Aug 13 20:19 /usr/share/ca-certificates/8053.pem

	I0813 13:21:59.149475    9787 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/8053.pem

	I0813 13:21:59.154597    9787 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/8053.pem /etc/ssl/certs/51391683.0"

	I0813 13:21:59.161377    9787 kubeadm.go:390] StartCluster: {Name:functional-20210813131926-8053 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.21.3 ClusterName:functional-20210813131926-8053 Namespace:default APIServerName:minikubeCA APISe

rverNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.21.3 ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false helm-tiller:false ingress:false ingress-dns:false istio:false istio-provisioner:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-p

rovisioner-gluster:false volumesnapshots:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0813 13:21:59.161497    9787 ssh_runner.go:149] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0813 13:21:59.189545    9787 ssh_runner.go:149] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0813 13:21:59.198183    9787 kubeadm.go:401] found existing configuration files, will attempt cluster restart

	I0813 13:21:59.198193    9787 kubeadm.go:600] restartCluster start

	I0813 13:21:59.198243    9787 ssh_runner.go:149] Run: sudo test -d /data/minikube

	I0813 13:21:59.205178    9787 kubeadm.go:126] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1

	stdout:

	stderr:

	I0813 13:21:59.205256    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8441/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:59.324984    9787 kubeconfig.go:93] found "functional-20210813131926-8053" server: "https://127.0.0.1:59730"

	I0813 13:21:59.328207    9787 ssh_runner.go:149] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new

	I0813 13:21:59.336264    9787 kubeadm.go:568] needs reconfigure: configs differ:

	-- stdout --

	--- /var/tmp/minikube/kubeadm.yaml	2021-08-13 20:20:16.844537431 +0000

	+++ /var/tmp/minikube/kubeadm.yaml.new	2021-08-13 20:21:58.890702464 +0000

	@@ -22,7 +22,7 @@

	 apiServer:

	   certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]

	   extraArgs:

	-    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	+    enable-admission-plugins: "NamespaceAutoProvision"

	 controllerManager:

	   extraArgs:

	     allocate-node-cidrs: "true"

	-- /stdout --

	I0813 13:21:59.336273    9787 kubeadm.go:1032] stopping kube-system containers ...

	I0813 13:21:59.336353    9787 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0813 13:21:59.365803    9787 docker.go:367] Stopping containers: [c9cb7d5809d8 a775b806a61d cb9e8762e065 137cc83770ff d982e81551e9 0237d371d391 467412a75d20 52fbb2e72ccf 9d5404187c66 c4b0031b9346 60451e7f160d 474f32a18e0e 58a9c2f98763 2ec83ef7b889 d31f2fbd2084]

	I0813 13:21:59.365906    9787 ssh_runner.go:149] Run: docker stop c9cb7d5809d8 a775b806a61d cb9e8762e065 137cc83770ff d982e81551e9 0237d371d391 467412a75d20 52fbb2e72ccf 9d5404187c66 c4b0031b9346 60451e7f160d 474f32a18e0e 58a9c2f98763 2ec83ef7b889 d31f2fbd2084

	I0813 13:22:04.995080    9787 ssh_runner.go:189] Completed: docker stop c9cb7d5809d8 a775b806a61d cb9e8762e065 137cc83770ff d982e81551e9 0237d371d391 467412a75d20 52fbb2e72ccf 9d5404187c66 c4b0031b9346 60451e7f160d 474f32a18e0e 58a9c2f98763 2ec83ef7b889 d31f2fbd2084: (5.629129791s)

	I0813 13:22:04.995149    9787 ssh_runner.go:149] Run: sudo systemctl stop kubelet

	I0813 13:22:05.035150    9787 ssh_runner.go:149] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0813 13:22:05.043407    9787 kubeadm.go:154] found existing configuration files:

	-rw------- 1 root root 5639 Aug 13 20:20 /etc/kubernetes/admin.conf

	-rw------- 1 root root 5656 Aug 13 20:20 /etc/kubernetes/controller-manager.conf

	-rw------- 1 root root 2059 Aug 13 20:20 /etc/kubernetes/kubelet.conf

	-rw------- 1 root root 5604 Aug 13 20:20 /etc/kubernetes/scheduler.conf

	I0813 13:22:05.043464    9787 ssh_runner.go:149] Run: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/admin.conf

	I0813 13:22:05.051350    9787 ssh_runner.go:149] Run: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/kubelet.conf

	I0813 13:22:05.060114    9787 ssh_runner.go:149] Run: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/controller-manager.conf

	I0813 13:22:05.067525    9787 kubeadm.go:165] "https://control-plane.minikube.internal:8441" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/controller-manager.conf: Process exited with status 1

	stdout:

	stderr:

	I0813 13:22:05.067578    9787 ssh_runner.go:149] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I0813 13:22:05.075008    9787 ssh_runner.go:149] Run: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/scheduler.conf

	I0813 13:22:05.082906    9787 kubeadm.go:165] "https://control-plane.minikube.internal:8441" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/scheduler.conf: Process exited with status 1

	stdout:

	stderr:

	I0813 13:22:05.082967    9787 ssh_runner.go:149] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I0813 13:22:05.090012    9787 ssh_runner.go:149] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0813 13:22:05.098160    9787 kubeadm.go:676] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml

	I0813 13:22:05.098166    9787 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.3:$PATH kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"

	I0813 13:22:05.234978    9787 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.3:$PATH kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"

	I0813 13:22:06.121440    9787 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.3:$PATH kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"

	I0813 13:22:06.340305    9787 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.3:$PATH kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"

	I0813 13:22:06.503163    9787 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.3:$PATH kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"

	I0813 13:22:06.712462    9787 api_server.go:50] waiting for apiserver process to appear ...

	I0813 13:22:06.712527    9787 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 13:22:06.730332    9787 api_server.go:70] duration metric: took 17.874307ms to wait for apiserver process to appear ...

	I0813 13:22:06.730341    9787 api_server.go:86] waiting for apiserver healthz status ...

	I0813 13:22:06.730354    9787 api_server.go:239] Checking apiserver healthz at https://127.0.0.1:59730/healthz ...

	I0813 13:22:06.736407    9787 api_server.go:265] https://127.0.0.1:59730/healthz returned 200:

	ok

	I0813 13:22:06.743171    9787 api_server.go:139] control plane version: v1.21.3

	I0813 13:22:06.743179    9787 api_server.go:129] duration metric: took 12.83557ms to wait for apiserver health ...

	I0813 13:22:06.743183    9787 cni.go:93] Creating CNI manager for ""

	I0813 13:22:06.743191    9787 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I0813 13:22:06.743197    9787 system_pods.go:43] waiting for kube-system pods to appear ...

	I0813 13:22:06.753205    9787 system_pods.go:59] 7 kube-system pods found

	I0813 13:22:06.753216    9787 system_pods.go:61] "coredns-558bd4d5db-rhdvr" [5a622440-7ec5-4279-906a-dbb6df1293e4] Running

	I0813 13:22:06.753223    9787 system_pods.go:61] "etcd-functional-20210813131926-8053" [4f00bcab-aff3-43c8-acc0-58a4b8aabe25] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])

	I0813 13:22:06.753226    9787 system_pods.go:61] "kube-apiserver-functional-20210813131926-8053" [20ad3ec8-4b1e-4b0c-98d1-55d19db5ea62] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])

	I0813 13:22:06.753249    9787 system_pods.go:61] "kube-controller-manager-functional-20210813131926-8053" [dcbf1190-fbb7-47cc-8dc0-3e56e3c5edae] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])

	I0813 13:22:06.753254    9787 system_pods.go:61] "kube-proxy-kv9mv" [021b9666-4667-41cf-b041-7b8db53a4052] Running

	I0813 13:22:06.753257    9787 system_pods.go:61] "kube-scheduler-functional-20210813131926-8053" [afe411d1-6ad3-41a8-bb90-ff93ba88531c] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])

	I0813 13:22:06.753260    9787 system_pods.go:61] "storage-provisioner" [d75f1151-7edf-4dac-acd9-128a49223ff1] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])

	I0813 13:22:06.753263    9787 system_pods.go:74] duration metric: took 10.063476ms to wait for pod list to return data ...

	I0813 13:22:06.753267    9787 node_conditions.go:102] verifying NodePressure condition ...

	I0813 13:22:06.756805    9787 node_conditions.go:122] node storage ephemeral capacity is 123591232Ki

	I0813 13:22:06.756820    9787 node_conditions.go:123] node cpu capacity is 6

	I0813 13:22:06.756832    9787 node_conditions.go:105] duration metric: took 3.562026ms to run NodePressure ...

	I0813 13:22:06.756839    9787 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.3:$PATH kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"

	I0813 13:22:06.988642    9787 kubeadm.go:731] waiting for restarted kubelet to initialise ...

	I0813 13:22:06.992762    9787 kubeadm.go:746] kubelet initialised

	I0813 13:22:06.992768    9787 kubeadm.go:747] duration metric: took 4.11784ms waiting for restarted kubelet to initialise ...

	I0813 13:22:06.992772    9787 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0813 13:22:06.997055    9787 pod_ready.go:78] waiting up to 4m0s for pod "coredns-558bd4d5db-rhdvr" in "kube-system" namespace to be "Ready" ...

	I0813 13:22:07.004790    9787 pod_ready.go:92] pod "coredns-558bd4d5db-rhdvr" in "kube-system" namespace has status "Ready":"True"

	I0813 13:22:07.004795    9787 pod_ready.go:81] duration metric: took 7.730399ms waiting for pod "coredns-558bd4d5db-rhdvr" in "kube-system" namespace to be "Ready" ...

	I0813 13:22:07.004799    9787 pod_ready.go:78] waiting up to 4m0s for pod "etcd-functional-20210813131926-8053" in "kube-system" namespace to be "Ready" ...

	I0813 13:22:09.023880    9787 pod_ready.go:102] pod "etcd-functional-20210813131926-8053" in "kube-system" namespace has status "Ready":"False"

	I0813 13:22:11.523012    9787 pod_ready.go:97] node "functional-20210813131926-8053" hosting pod "etcd-functional-20210813131926-8053" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:11.523022    9787 pod_ready.go:81] duration metric: took 4.518205887s waiting for pod "etcd-functional-20210813131926-8053" in "kube-system" namespace to be "Ready" ...

	E0813 13:22:11.523028    9787 pod_ready.go:66] WaitExtra: waitPodCondition: node "functional-20210813131926-8053" hosting pod "etcd-functional-20210813131926-8053" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:11.523040    9787 pod_ready.go:78] waiting up to 4m0s for pod "kube-apiserver-functional-20210813131926-8053" in "kube-system" namespace to be "Ready" ...

	I0813 13:22:11.527525    9787 pod_ready.go:97] node "functional-20210813131926-8053" hosting pod "kube-apiserver-functional-20210813131926-8053" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:11.527531    9787 pod_ready.go:81] duration metric: took 4.486717ms waiting for pod "kube-apiserver-functional-20210813131926-8053" in "kube-system" namespace to be "Ready" ...

	E0813 13:22:11.527536    9787 pod_ready.go:66] WaitExtra: waitPodCondition: node "functional-20210813131926-8053" hosting pod "kube-apiserver-functional-20210813131926-8053" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:11.527544    9787 pod_ready.go:78] waiting up to 4m0s for pod "kube-controller-manager-functional-20210813131926-8053" in "kube-system" namespace to be "Ready" ...

	I0813 13:22:11.531857    9787 pod_ready.go:97] node "functional-20210813131926-8053" hosting pod "kube-controller-manager-functional-20210813131926-8053" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:11.531864    9787 pod_ready.go:81] duration metric: took 4.31653ms waiting for pod "kube-controller-manager-functional-20210813131926-8053" in "kube-system" namespace to be "Ready" ...

	E0813 13:22:11.531869    9787 pod_ready.go:66] WaitExtra: waitPodCondition: node "functional-20210813131926-8053" hosting pod "kube-controller-manager-functional-20210813131926-8053" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:11.531876    9787 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-kv9mv" in "kube-system" namespace to be "Ready" ...

	I0813 13:22:11.537017    9787 pod_ready.go:97] node "functional-20210813131926-8053" hosting pod "kube-proxy-kv9mv" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:11.537022    9787 pod_ready.go:81] duration metric: took 5.141983ms waiting for pod "kube-proxy-kv9mv" in "kube-system" namespace to be "Ready" ...

	E0813 13:22:11.537025    9787 pod_ready.go:66] WaitExtra: waitPodCondition: node "functional-20210813131926-8053" hosting pod "kube-proxy-kv9mv" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:11.537032    9787 pod_ready.go:78] waiting up to 4m0s for pod "kube-scheduler-functional-20210813131926-8053" in "kube-system" namespace to be "Ready" ...

	I0813 13:22:11.545827    9787 pod_ready.go:97] node "functional-20210813131926-8053" hosting pod "kube-scheduler-functional-20210813131926-8053" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:11.545836    9787 pod_ready.go:81] duration metric: took 8.799553ms waiting for pod "kube-scheduler-functional-20210813131926-8053" in "kube-system" namespace to be "Ready" ...

	E0813 13:22:11.545841    9787 pod_ready.go:66] WaitExtra: waitPodCondition: node "functional-20210813131926-8053" hosting pod "kube-scheduler-functional-20210813131926-8053" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:11.545851    9787 pod_ready.go:38] duration metric: took 4.553059995s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0813 13:22:11.545860    9787 ssh_runner.go:149] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0813 13:22:11.558301    9787 ops.go:34] apiserver oom_adj: -16

	I0813 13:22:11.558317    9787 kubeadm.go:604] restartCluster took 12.36008589s

	I0813 13:22:11.558321    9787 kubeadm.go:392] StartCluster complete in 12.39691792s

	I0813 13:22:11.558329    9787 settings.go:142] acquiring lock: {Name:mkea671a8cf1619d5bb0d33f936826680e87cf9b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 13:22:11.558414    9787 settings.go:150] Updating kubeconfig:  /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/kubeconfig

	I0813 13:22:11.558889    9787 lock.go:36] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/kubeconfig: {Name:mk2e9f304ce9a26dabf1dc11ded078755e07052d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 13:22:11.564907    9787 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "functional-20210813131926-8053" rescaled to 1

	I0813 13:22:11.564940    9787 ssh_runner.go:149] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.21.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0813 13:22:11.564936    9787 start.go:226] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.21.3 ControlPlane:true Worker:true}

	I0813 13:22:11.564966    9787 addons.go:342] enableAddons start: toEnable=map[ambassador:false auto-pause:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false helm-tiller:false ingress:false ingress-dns:false istio:false istio-provisioner:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false], additional=[]

	I0813 13:22:11.589685    9787 out.go:177] * Verifying Kubernetes components...

	I0813 13:22:11.565120    9787 config.go:177] Loaded profile config "functional-20210813131926-8053": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.21.3

	I0813 13:22:11.589733    9787 addons.go:59] Setting default-storageclass=true in profile "functional-20210813131926-8053"

	I0813 13:22:11.589735    9787 addons.go:59] Setting storage-provisioner=true in profile "functional-20210813131926-8053"

	I0813 13:22:11.589750    9787 addons.go:135] Setting addon storage-provisioner=true in "functional-20210813131926-8053"

	W0813 13:22:11.589756    9787 addons.go:147] addon storage-provisioner should already be in state true

	I0813 13:22:11.589756    9787 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "functional-20210813131926-8053"

	I0813 13:22:11.589762    9787 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service kubelet

	I0813 13:22:11.589779    9787 host.go:66] Checking if "functional-20210813131926-8053" exists ...

	I0813 13:22:11.590054    9787 cli_runner.go:115] Run: docker container inspect functional-20210813131926-8053 --format={{.State.Status}}

	I0813 13:22:11.591473    9787 cli_runner.go:115] Run: docker container inspect functional-20210813131926-8053 --format={{.State.Status}}

	I0813 13:22:11.640467    9787 start.go:708] CoreDNS already contains "host.minikube.internal" host record, skipping...

	I0813 13:22:11.640547    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8441/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:22:11.736998    9787 addons.go:135] Setting addon default-storageclass=true in "functional-20210813131926-8053"

	W0813 13:22:11.753928    9787 addons.go:147] addon default-storageclass should already be in state true

	I0813 13:22:11.753909    9787 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0813 13:22:11.753958    9787 host.go:66] Checking if "functional-20210813131926-8053" exists ...

	I0813 13:22:11.754030    9787 addons.go:275] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0813 13:22:11.754035    9787 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0813 13:22:11.754119    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:22:11.756650    9787 cli_runner.go:115] Run: docker container inspect functional-20210813131926-8053 --format={{.State.Status}}

	I0813 13:22:11.796607    9787 node_ready.go:35] waiting up to 6m0s for node "functional-20210813131926-8053" to be "Ready" ...

	I0813 13:22:11.883407    9787 addons.go:275] installing /etc/kubernetes/addons/storageclass.yaml

	I0813 13:22:11.883414    9787 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0813 13:22:11.883501    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:22:11.884664    9787 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:59731 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/functional-20210813131926-8053/id_rsa Username:docker}

	I0813 13:22:11.981485    9787 ssh_runner.go:149] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0813 13:22:12.002195    9787 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:59731 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/functional-20210813131926-8053/id_rsa Username:docker}

	I0813 13:22:12.100215    9787 ssh_runner.go:149] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0813 13:22:12.292911    9787 out.go:177] * Enabled addons: storage-provisioner, default-storageclass

	I0813 13:22:12.292941    9787 addons.go:344] enableAddons completed in 727.982788ms

	I0813 13:22:13.803981    9787 node_ready.go:58] node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:15.805967    9787 node_ready.go:58] node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:26.864663    9787 node_ready.go:53] error getting node "functional-20210813131926-8053": an error on the server ("") has prevented the request from succeeding (get nodes functional-20210813131926-8053)

	I0813 13:22:26.864673    9787 node_ready.go:38] duration metric: took 15.06800794s waiting for node "functional-20210813131926-8053" to be "Ready" ...

	* 

	* ==> Docker <==

	* -- Logs begin at Fri 2021-08-13 20:19:47 UTC, end at Fri 2021-08-13 20:22:42 UTC. --

	Aug 13 20:19:57 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:19:57.739595481Z" level=info msg="Loading containers: start."

	Aug 13 20:20:09 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:20:09.572986205Z" level=info msg="Default bridge (docker0) is assigned with an IP address 172.17.0.0/16. Daemon option --bip can be used to set a preferred IP address"

	Aug 13 20:20:14 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:20:14.249241573Z" level=info msg="Loading containers: done."

	Aug 13 20:20:14 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:20:14.265005649Z" level=info msg="Docker daemon" commit=75249d8 graphdriver(s)=overlay2 version=20.10.8

	Aug 13 20:20:14 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:20:14.265058384Z" level=info msg="Daemon has completed initialization"

	Aug 13 20:20:14 functional-20210813131926-8053 systemd[1]: Started Docker Application Container Engine.

	Aug 13 20:20:14 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:20:14.286785231Z" level=info msg="API listen on [::]:2376"

	Aug 13 20:20:14 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:20:14.292066078Z" level=info msg="API listen on /var/run/docker.sock"

	Aug 13 20:21:21 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:21:21.026577302Z" level=info msg="ignoring event" container=a775b806a61d92ff81657fcff4dc7acb2f83254a5bbbce0fe21c2184fc85199b module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 13 20:21:59 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:21:59.502385955Z" level=info msg="ignoring event" container=467412a75d20411362b568cec86e4b4db02ab69bcb0b2b1691ea34123a6e75a3 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 13 20:21:59 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:21:59.585617856Z" level=info msg="ignoring event" container=d982e81551e90a29c763ebd97f5815ddb483dfa4a0886ffeaf978f6306c51697 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 13 20:21:59 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:21:59.585653524Z" level=info msg="ignoring event" container=d31f2fbd2084dbd1309738fa6e4bae273881af99746ff1dbfe82d39a19926255 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 13 20:21:59 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:21:59.588265473Z" level=info msg="ignoring event" container=0237d371d39158fc0d1392d53fbee09365c43b8377065997bfc4d71f36c10680 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 13 20:21:59 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:21:59.592422684Z" level=info msg="ignoring event" container=60451e7f160dd81c0eff9a4778313edd9c2746f058fdf64aa7f07823d2cfe571 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 13 20:21:59 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:21:59.600839720Z" level=info msg="ignoring event" container=cb9e8762e065a69236fdcadaa417404d054baa95f844cff5dde6b591482a2066 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 13 20:21:59 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:21:59.600883866Z" level=info msg="ignoring event" container=52fbb2e72ccff7078ee98d2e624285077b55ddeecff8b6299848e8f273221a42 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 13 20:21:59 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:21:59.602610629Z" level=info msg="ignoring event" container=474f32a18e0ee39876105a4ceb25958ad0b33f3b0454ad8a1b12ac49b3cd5eed module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 13 20:21:59 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:21:59.665982297Z" level=info msg="ignoring event" container=58a9c2f98763845c127f300b14fd7daf436248b1b5a86ded1833419c451891ac module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 13 20:21:59 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:21:59.669152577Z" level=info msg="ignoring event" container=2ec83ef7b889312fa65d180a496979d05511e27ddf8152e99b54451a2dfd71d3 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 13 20:21:59 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:21:59.669220943Z" level=info msg="ignoring event" container=9d5404187c668a3ea33922b1d068a52703bfa98906ff3ee9547fd6dfb6cc8b62 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 13 20:21:59 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:21:59.671212944Z" level=info msg="ignoring event" container=c9cb7d5809d857b21669fb017f684054b46646eae2e905765a28a3a95f921556 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 13 20:21:59 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:21:59.968130509Z" level=info msg="ignoring event" container=c4b0031b934617be49e5493937ea15caac6b895e01e8b3e36dd52978278b018b module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 13 20:22:04 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:22:04.991899112Z" level=info msg="ignoring event" container=137cc83770ffa35f37f9c930bd210eb3fb6844777a24c1e27560855eccab5da6 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 13 20:22:15 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:22:15.359418052Z" level=info msg="ignoring event" container=3e9e7c3beb60cae3aa3ad0de2629c617a379493c98eb2aec8f12de03e30f8898 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 13 20:22:16 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:22:16.578206835Z" level=info msg="ignoring event" container=83fc53fcb046e52a6a02b2f2de4613942e95c75ddada33df73d84d63c79d8e2c module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	* 

	* ==> container status <==

	* CONTAINER           IMAGE               CREATED              STATE               NAME                      ATTEMPT             POD ID

	6d69afd52f8c3       3d174f00aa39e       7 seconds ago        Running             kube-apiserver            2                   d69f527d156d3

	83fc53fcb046e       3d174f00aa39e       26 seconds ago       Exited              kube-apiserver            1                   d69f527d156d3

	b2296fd0d1e96       6e38f40d628db       27 seconds ago       Running             storage-provisioner       2                   5e308be60a59b

	fd440add28af1       296a6d5035e2d       27 seconds ago       Running             coredns                   1                   f50593e11ff51

	38f92da530a9b       3d174f00aa39e       42 seconds ago       Running             kube-apiserver            1                   d66173141e7e0

	702cee73a40cb       6be0dc1302e30       42 seconds ago       Running             kube-scheduler            1                   07d2de00a97f8

	48d06bb7b7911       0369cf4303ffd       42 seconds ago       Running             etcd                      1                   d8b864d434486

	aca358fec1904       bc2bb319a7038       42 seconds ago       Running             kube-controller-manager   1                   bd0a7904b87eb

	a4dbf0c14cf56       adb2816ea823a       42 seconds ago       Running             kube-proxy                1                   d1f104a42b8d8

	c9cb7d5809d85       6e38f40d628db       About a minute ago   Exited              storage-provisioner       1                   cb9e8762e065a

	137cc83770ffa       296a6d5035e2d       About a minute ago   Exited              coredns                   0                   d982e81551e90

	0237d371d3915       adb2816ea823a       About a minute ago   Exited              kube-proxy                0                   467412a75d204

	52fbb2e72ccff       0369cf4303ffd       2 minutes ago        Exited              etcd                      0                   474f32a18e0ee

	9d5404187c668       6be0dc1302e30       2 minutes ago        Exited              kube-scheduler            0                   58a9c2f987638

	c4b0031b93461       3d174f00aa39e       2 minutes ago        Exited              kube-apiserver            0                   d31f2fbd2084d

	60451e7f160dd       bc2bb319a7038       2 minutes ago        Exited              kube-controller-manager   0                   2ec83ef7b8893

	* 

	* ==> coredns [137cc83770ff] <==

	* [INFO] plugin/ready: Still waiting on: "kubernetes"

	.:53

	[INFO] plugin/reload: Running configuration MD5 = db32ca3650231d74073ff4cf814959a7

	CoreDNS-1.8.0

	linux/amd64, go1.15.3, 054c9ae

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] Reloading

	[INFO] plugin/health: Going into lameduck mode for 5s

	[INFO] plugin/reload: Running configuration MD5 = c23ed519c17e71ee396ed052e6209e94

	[INFO] Reloading complete

	[INFO] SIGTERM: Shutting down servers then terminating

	[INFO] plugin/health: Going into lameduck mode for 5s

	I0813 20:21:20.439318       1 trace.go:205] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156 (13-Aug-2021 20:20:50.459) (total time: 30000ms):

	Trace[2019727887]: [30.000959061s] [30.000959061s] END

	E0813 20:21:20.439385       1 reflector.go:127] pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156: Failed to watch *v1.Endpoints: failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	I0813 20:21:20.439327       1 trace.go:205] Trace[1427131847]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156 (13-Aug-2021 20:20:50.459) (total time: 30000ms):

	Trace[1427131847]: [30.00091098s] [30.00091098s] END

	E0813 20:21:20.439411       1 reflector.go:127] pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	I0813 20:21:20.439589       1 trace.go:205] Trace[911902081]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156 (13-Aug-2021 20:20:50.459) (total time: 30001ms):

	Trace[911902081]: [30.001246144s] [30.001246144s] END

	E0813 20:21:20.439637       1 reflector.go:127] pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156: Failed to watch *v1.Namespace: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	* 

	* ==> coredns [fd440add28af] <==

	* .:53

	[INFO] plugin/reload: Running configuration MD5 = c23ed519c17e71ee396ed052e6209e94

	CoreDNS-1.8.0

	linux/amd64, go1.15.3, 054c9ae

	* 

	* ==> describe nodes <==

	* Name:               functional-20210813131926-8053

	Roles:              control-plane,master

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=functional-20210813131926-8053

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=852050cf77fe767e86d5a194bb91c06c4dc6c13c

	                    minikube.k8s.io/name=functional-20210813131926-8053

	                    minikube.k8s.io/updated_at=2021_08_13T13_20_35_0700

	                    minikube.k8s.io/version=v1.22.0

	                    node-role.kubernetes.io/control-plane=

	                    node-role.kubernetes.io/master=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /var/run/dockershim.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Fri, 13 Aug 2021 20:20:34 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  functional-20210813131926-8053

	  AcquireTime:     <unset>

	  RenewTime:       Fri, 13 Aug 2021 20:22:40 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Fri, 13 Aug 2021 20:22:41 +0000   Fri, 13 Aug 2021 20:20:34 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Fri, 13 Aug 2021 20:22:41 +0000   Fri, 13 Aug 2021 20:20:34 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Fri, 13 Aug 2021 20:22:41 +0000   Fri, 13 Aug 2021 20:20:34 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Fri, 13 Aug 2021 20:22:41 +0000   Fri, 13 Aug 2021 20:22:41 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.49.2

	  Hostname:    functional-20210813131926-8053

	Capacity:

	  cpu:                6

	  ephemeral-storage:  123591232Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  memory:             6088600Ki

	  pods:               110

	Allocatable:

	  cpu:                6

	  ephemeral-storage:  123591232Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  memory:             6088600Ki

	  pods:               110

	System Info:

	  Machine ID:                 dfc5def84a78402c9caa00a7cad25a86

	  System UUID:                c2a53005-c520-4b31-be6f-0d97f1736775

	  Boot ID:                    9c1335d8-2b93-45e8-96a7-e09bd9b095e5

	  Kernel Version:             5.10.25-linuxkit

	  OS Image:                   Ubuntu 20.04.2 LTS

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  docker://20.10.8

	  Kubelet Version:            v1.21.3

	  Kube-Proxy Version:         v1.21.3

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (7 in total)

	  Namespace                   Name                                                      CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                                      ------------  ----------  ---------------  -------------  ---

	  kube-system                 coredns-558bd4d5db-rhdvr                                  100m (1%!)(MISSING)     0 (0%!)(MISSING)      70Mi (1%!)(MISSING)        170Mi (2%!)(MISSING)     114s

	  kube-system                 etcd-functional-20210813131926-8053                       100m (1%!)(MISSING)     0 (0%!)(MISSING)      100Mi (1%!)(MISSING)       0 (0%!)(MISSING)         2m4s

	  kube-system                 kube-apiserver-functional-20210813131926-8053             250m (4%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         27s

	  kube-system                 kube-controller-manager-functional-20210813131926-8053    200m (3%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m4s

	  kube-system                 kube-proxy-kv9mv                                          0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         115s

	  kube-system                 kube-scheduler-functional-20210813131926-8053             100m (1%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m4s

	  kube-system                 storage-provisioner                                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         113s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (12%!)(MISSING)  0 (0%!)(MISSING)

	  memory             170Mi (2%!)(MISSING)  170Mi (2%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                    From        Message

	  ----    ------                   ----                   ----        -------

	  Normal  NodeHasNoDiskPressure    2m22s (x4 over 2m22s)  kubelet     Node functional-20210813131926-8053 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     2m22s (x4 over 2m22s)  kubelet     Node functional-20210813131926-8053 status is now: NodeHasSufficientPID

	  Normal  NodeHasSufficientMemory  2m21s (x5 over 2m22s)  kubelet     Node functional-20210813131926-8053 status is now: NodeHasSufficientMemory

	  Normal  Starting                 2m8s                   kubelet     Starting kubelet.

	  Normal  NodeHasSufficientMemory  2m7s                   kubelet     Node functional-20210813131926-8053 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    2m7s                   kubelet     Node functional-20210813131926-8053 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     2m7s                   kubelet     Node functional-20210813131926-8053 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  2m7s                   kubelet     Updated Node Allocatable limit across pods

	  Normal  NodeReady                117s                   kubelet     Node functional-20210813131926-8053 status is now: NodeReady

	  Normal  Starting                 111s                   kube-proxy  Starting kube-proxy.

	  Normal  Starting                 36s                    kube-proxy  Starting kube-proxy.

	  Normal  Starting                 33s                    kubelet     Starting kubelet.

	  Normal  NodeHasSufficientMemory  32s                    kubelet     Node functional-20210813131926-8053 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    32s                    kubelet     Node functional-20210813131926-8053 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     32s                    kubelet     Node functional-20210813131926-8053 status is now: NodeHasSufficientPID

	  Normal  NodeNotReady             32s                    kubelet     Node functional-20210813131926-8053 status is now: NodeNotReady

	  Normal  NodeAllocatableEnforced  32s                    kubelet     Updated Node Allocatable limit across pods

	  Normal  NodeReady                2s                     kubelet     Node functional-20210813131926-8053 status is now: NodeReady

	* 

	* ==> dmesg <==

	* [  +0.021913] bpfilter: read fail 0

	[  +0.032008] bpfilter: read fail 0

	[  +0.039236] bpfilter: read fail 0

	[  +0.028689] bpfilter: read fail 0

	[  +0.029250] bpfilter: read fail 0

	[  +0.031212] bpfilter: read fail 0

	[  +0.032872] bpfilter: read fail 0

	[  +0.027678] bpfilter: write fail -32

	[  +0.034754] bpfilter: read fail 0

	[  +0.035692] bpfilter: read fail 0

	[  +0.033624] bpfilter: write fail -32

	[  +0.037595] bpfilter: write fail -32

	[  +0.027367] bpfilter: read fail 0

	[  +0.031958] bpfilter: read fail 0

	[  +0.036157] bpfilter: read fail 0

	[  +0.031654] bpfilter: write fail -32

	[  +0.038529] bpfilter: read fail 0

	[  +0.035713] bpfilter: read fail 0

	[  +0.028531] bpfilter: read fail 0

	[  +0.032352] bpfilter: read fail 0

	[  +0.047412] bpfilter: write fail -32

	[  +0.028400] bpfilter: write fail -32

	[  +0.029103] bpfilter: read fail 0

	[  +0.030697] bpfilter: read fail 0

	[  +0.034649] bpfilter: write fail -32

	* 

	* ==> etcd [48d06bb7b791] <==

	* raft2021/08/13 20:22:00 INFO: aec36adc501070cc became follower at term 2

	raft2021/08/13 20:22:00 INFO: newRaft aec36adc501070cc [peers: [], term: 2, commit: 544, applied: 0, lastindex: 544, lastterm: 2]

	2021-08-13 20:22:00.593422 W | auth: simple token is not cryptographically signed

	2021-08-13 20:22:00.599020 I | etcdserver: starting server... [version: 3.4.13, cluster version: to_be_decided]

	raft2021/08/13 20:22:00 INFO: aec36adc501070cc switched to configuration voters=(12593026477526642892)

	2021-08-13 20:22:00.600638 I | embed: ClientTLS: cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = 

	2021-08-13 20:22:00.600776 I | embed: listening for metrics on http://127.0.0.1:2381

	2021-08-13 20:22:00.600797 I | etcdserver/membership: added member aec36adc501070cc [https://192.168.49.2:2380] to cluster fa54960ea34d58be

	2021-08-13 20:22:00.600889 I | embed: listening for peers on 192.168.49.2:2380

	2021-08-13 20:22:00.601005 N | etcdserver/membership: set the initial cluster version to 3.4

	2021-08-13 20:22:00.601028 I | etcdserver/api: enabled capabilities for version 3.4

	2021-08-13 20:22:00.603763 W | etcdserver: failed to apply request "header:<ID:8128006947343604284 > lease_revoke:<id:70cc7b412c5299f3>" with response "size:29" took (453.17µs) to execute, err is lease not found

	raft2021/08/13 20:22:02 INFO: aec36adc501070cc is starting a new election at term 2

	raft2021/08/13 20:22:02 INFO: aec36adc501070cc became candidate at term 3

	raft2021/08/13 20:22:02 INFO: aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 3

	raft2021/08/13 20:22:02 INFO: aec36adc501070cc became leader at term 3

	raft2021/08/13 20:22:02 INFO: raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 3

	2021-08-13 20:22:02.393654 I | etcdserver: published {Name:functional-20210813131926-8053 ClientURLs:[https://192.168.49.2:2379]} to cluster fa54960ea34d58be

	2021-08-13 20:22:02.393806 I | embed: ready to serve client requests

	2021-08-13 20:22:02.394009 I | embed: ready to serve client requests

	2021-08-13 20:22:02.395515 I | embed: serving client requests on 192.168.49.2:2379

	2021-08-13 20:22:02.395556 I | embed: serving client requests on 127.0.0.1:2379

	2021-08-13 20:22:23.486642 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:22:25.625948 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:22:35.624433 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	* 

	* ==> etcd [52fbb2e72ccf] <==

	* raft2021/08/13 20:20:29 INFO: aec36adc501070cc is starting a new election at term 1

	raft2021/08/13 20:20:29 INFO: aec36adc501070cc became candidate at term 2

	raft2021/08/13 20:20:29 INFO: aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2

	raft2021/08/13 20:20:29 INFO: aec36adc501070cc became leader at term 2

	raft2021/08/13 20:20:29 INFO: raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2

	2021-08-13 20:20:29.449928 I | etcdserver: published {Name:functional-20210813131926-8053 ClientURLs:[https://192.168.49.2:2379]} to cluster fa54960ea34d58be

	2021-08-13 20:20:29.449956 I | embed: ready to serve client requests

	2021-08-13 20:20:29.450201 I | embed: ready to serve client requests

	2021-08-13 20:20:29.451895 I | embed: serving client requests on 192.168.49.2:2379

	2021-08-13 20:20:29.452662 I | etcdserver: setting up the initial cluster version to 3.4

	2021-08-13 20:20:29.453525 N | etcdserver/membership: set the initial cluster version to 3.4

	2021-08-13 20:20:29.453720 I | etcdserver/api: enabled capabilities for version 3.4

	2021-08-13 20:20:29.453832 I | embed: serving client requests on 127.0.0.1:2379

	2021-08-13 20:20:40.277076 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:20:48.493155 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:20:50.276798 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:21:00.256457 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:21:10.255657 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:21:20.255420 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:21:30.234727 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:21:40.237560 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:21:50.233853 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:21:59.424601 N | pkg/osutil: received terminated signal, shutting down...

	WARNING: 2021/08/13 20:21:59 grpc: addrConn.createTransport failed to connect to {127.0.0.1:2379  <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...

	2021-08-13 20:21:59.469510 I | etcdserver: skipped leadership transfer for single voting member cluster

	* 

	* ==> kernel <==

	*  20:22:43 up 8 min,  0 users,  load average: 2.14, 1.48, 0.71

	Linux functional-20210813131926-8053 5.10.25-linuxkit #1 SMP Tue Mar 23 09:27:39 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux

	PRETTY_NAME="Ubuntu 20.04.2 LTS"

	* 

	* ==> kube-apiserver [38f92da530a9] <==

	* I0813 20:22:10.929672       1 controller.go:611] quota admission added evaluator for: leases.coordination.k8s.io

	I0813 20:22:16.633427       1 controller.go:89] Shutting down OpenAPI AggregationController

	I0813 20:22:16.633518       1 controller.go:181] Shutting down kubernetes service endpoint reconciler

	I0813 20:22:16.633525       1 apf_controller.go:303] Shutting down API Priority and Fairness config worker

	I0813 20:22:16.633531       1 customresource_discovery_controller.go:245] Shutting down DiscoveryController

	I0813 20:22:16.633534       1 crdregistration_controller.go:142] Shutting down crd-autoregister controller

	I0813 20:22:16.633541       1 cluster_authentication_trust_controller.go:463] Shutting down cluster_authentication_trust_controller controller

	I0813 20:22:16.633546       1 autoregister_controller.go:165] Shutting down autoregister controller

	I0813 20:22:16.633546       1 apiservice_controller.go:131] Shutting down APIServiceRegistrationController

	I0813 20:22:16.633549       1 available_controller.go:487] Shutting down AvailableConditionController

	I0813 20:22:16.633589       1 controller.go:123] Shutting down OpenAPI controller

	I0813 20:22:16.633593       1 naming_controller.go:302] Shutting down NamingConditionController

	I0813 20:22:16.633597       1 apiapproval_controller.go:198] Shutting down KubernetesAPIApprovalPolicyConformantConditionController

	I0813 20:22:16.633595       1 dynamic_cafile_content.go:182] Shutting down request-header::/var/lib/minikube/certs/front-proxy-ca.crt

	I0813 20:22:16.633600       1 nonstructuralschema_controller.go:204] Shutting down NonStructuralSchemaConditionController

	I0813 20:22:16.633603       1 establishing_controller.go:87] Shutting down EstablishingController

	I0813 20:22:16.633605       1 crd_finalizer.go:278] Shutting down CRDFinalizer

	I0813 20:22:16.633616       1 tlsconfig.go:255] Shutting down DynamicServingCertificateController

	I0813 20:22:16.633623       1 dynamic_cafile_content.go:182] Shutting down client-ca-bundle::/var/lib/minikube/certs/ca.crt

	I0813 20:22:16.633628       1 dynamic_cafile_content.go:182] Shutting down request-header::/var/lib/minikube/certs/front-proxy-ca.crt

	I0813 20:22:16.633684       1 dynamic_serving_content.go:145] Shutting down serving-cert::/var/lib/minikube/certs/apiserver.crt::/var/lib/minikube/certs/apiserver.key

	I0813 20:22:16.633693       1 dynamic_cafile_content.go:182] Shutting down client-ca-bundle::/var/lib/minikube/certs/ca.crt

	I0813 20:22:16.633704       1 dynamic_serving_content.go:145] Shutting down aggregator-proxy-cert::/var/lib/minikube/certs/front-proxy-client.crt::/var/lib/minikube/certs/front-proxy-client.key

	I0813 20:22:16.634110       1 secure_serving.go:241] Stopped listening on [::]:8441

	E0813 20:22:16.636853       1 controller.go:184] Get "https://localhost:8441/api/v1/namespaces/default/endpoints/kubernetes": dial tcp 127.0.0.1:8441: connect: connection refused

	* 

	* ==> kube-apiserver [6d69afd52f8c] <==

	* I0813 20:22:38.318585       1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller

	I0813 20:22:38.318609       1 autoregister_controller.go:141] Starting autoregister controller

	I0813 20:22:38.318661       1 cache.go:32] Waiting for caches to sync for autoregister controller

	E0813 20:22:38.321680       1 controller.go:152] Unable to remove old endpoints from kubernetes service: StorageError: key not found, Code: 1, Key: /registry/masterleases/192.168.49.2, ResourceVersion: 0, AdditionalErrorMsg: 

	I0813 20:22:38.321857       1 crdregistration_controller.go:111] Starting crd-autoregister controller

	I0813 20:22:38.321914       1 shared_informer.go:240] Waiting for caches to sync for crd-autoregister

	I0813 20:22:38.332958       1 controller.go:86] Starting OpenAPI controller

	I0813 20:22:38.342152       1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController

	I0813 20:22:38.342183       1 naming_controller.go:291] Starting NamingConditionController

	I0813 20:22:38.342191       1 establishing_controller.go:76] Starting EstablishingController

	I0813 20:22:38.342170       1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController

	I0813 20:22:38.342176       1 crd_finalizer.go:266] Starting CRDFinalizer

	I0813 20:22:38.345261       1 controller.go:611] quota admission added evaluator for: endpoints

	I0813 20:22:38.416442       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller

	I0813 20:22:38.416576       1 shared_informer.go:247] Caches are synced for cluster_authentication_trust_controller 

	I0813 20:22:38.416715       1 apf_controller.go:299] Running API Priority and Fairness config worker

	I0813 20:22:38.416803       1 shared_informer.go:247] Caches are synced for node_authorizer 

	I0813 20:22:38.419529       1 cache.go:39] Caches are synced for autoregister controller

	I0813 20:22:38.419578       1 cache.go:39] Caches are synced for AvailableConditionController controller

	I0813 20:22:38.422193       1 shared_informer.go:247] Caches are synced for crd-autoregister 

	I0813 20:22:39.315114       1 controller.go:132] OpenAPI AggregationController: action for item : Nothing (removed from the queue).

	I0813 20:22:39.315170       1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).

	I0813 20:22:39.320787       1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.

	I0813 20:22:39.598302       1 controller.go:611] quota admission added evaluator for: endpointslices.discovery.k8s.io

	I0813 20:22:40.675450       1 controller.go:611] quota admission added evaluator for: leases.coordination.k8s.io

	* 

	* ==> kube-apiserver [83fc53fcb046] <==

	* Flag --insecure-port has been deprecated, This flag has no effect now and will be removed in v1.24.

	I0813 20:22:16.559861       1 server.go:629] external host was not specified, using 192.168.49.2

	I0813 20:22:16.560215       1 server.go:181] Version: v1.21.3

	Error: failed to create listener: failed to listen on 0.0.0.0:8441: listen tcp 0.0.0.0:8441: bind: address already in use

	* 

	* ==> kube-apiserver [c4b0031b9346] <==

	* I0813 20:21:59.469261       1 clientconn.go:897] blockingPicker: the picked transport is not ready, loop back to repick

	W0813 20:21:59.470190       1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:2379  <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...

	I0813 20:21:59.490093       1 dynamic_cafile_content.go:182] Shutting down request-header::/var/lib/minikube/certs/front-proxy-ca.crt

	I0813 20:21:59.490179       1 dynamic_cafile_content.go:182] Shutting down request-header::/var/lib/minikube/certs/front-proxy-ca.crt

	I0813 20:21:59.490186       1 dynamic_cafile_content.go:182] Shutting down client-ca-bundle::/var/lib/minikube/certs/ca.crt

	I0813 20:21:59.490250       1 controller.go:89] Shutting down OpenAPI AggregationController

	I0813 20:21:59.490257       1 dynamic_serving_content.go:145] Shutting down aggregator-proxy-cert::/var/lib/minikube/certs/front-proxy-client.crt::/var/lib/minikube/certs/front-proxy-client.key

	I0813 20:21:59.490306       1 secure_serving.go:241] Stopped listening on [::]:8441

	I0813 20:21:59.490310       1 tlsconfig.go:255] Shutting down DynamicServingCertificateController

	I0813 20:21:59.490318       1 dynamic_serving_content.go:145] Shutting down serving-cert::/var/lib/minikube/certs/apiserver.crt::/var/lib/minikube/certs/apiserver.key

	I0813 20:21:59.490349       1 dynamic_cafile_content.go:182] Shutting down client-ca-bundle::/var/lib/minikube/certs/ca.crt

	I0813 20:21:59.490114       1 controller.go:181] Shutting down kubernetes service endpoint reconciler

	I0813 20:21:59.490643       1 controller.go:123] Shutting down OpenAPI controller

	I0813 20:21:59.490654       1 crdregistration_controller.go:142] Shutting down crd-autoregister controller

	I0813 20:21:59.490662       1 cluster_authentication_trust_controller.go:463] Shutting down cluster_authentication_trust_controller controller

	I0813 20:21:59.490667       1 apiapproval_controller.go:198] Shutting down KubernetesAPIApprovalPolicyConformantConditionController

	I0813 20:21:59.490673       1 nonstructuralschema_controller.go:204] Shutting down NonStructuralSchemaConditionController

	I0813 20:21:59.490677       1 establishing_controller.go:87] Shutting down EstablishingController

	I0813 20:21:59.490682       1 naming_controller.go:302] Shutting down NamingConditionController

	I0813 20:21:59.490688       1 customresource_discovery_controller.go:245] Shutting down DiscoveryController

	I0813 20:21:59.490696       1 apiservice_controller.go:131] Shutting down APIServiceRegistrationController

	I0813 20:21:59.490722       1 crd_finalizer.go:278] Shutting down CRDFinalizer

	I0813 20:21:59.490728       1 autoregister_controller.go:165] Shutting down autoregister controller

	I0813 20:21:59.490735       1 available_controller.go:487] Shutting down AvailableConditionController

	I0813 20:21:59.490743       1 apf_controller.go:303] Shutting down API Priority and Fairness config worker

	* 

	* ==> kube-controller-manager [60451e7f160d] <==

	* I0813 20:20:48.273552       1 shared_informer.go:247] Caches are synced for job 

	I0813 20:20:48.282298       1 shared_informer.go:247] Caches are synced for deployment 

	I0813 20:20:48.293694       1 shared_informer.go:247] Caches are synced for endpoint 

	I0813 20:20:48.305431       1 shared_informer.go:247] Caches are synced for persistent volume 

	I0813 20:20:48.305477       1 shared_informer.go:247] Caches are synced for ReplicaSet 

	I0813 20:20:48.306702       1 shared_informer.go:247] Caches are synced for PVC protection 

	I0813 20:20:48.306734       1 shared_informer.go:247] Caches are synced for daemon sets 

	I0813 20:20:48.306739       1 shared_informer.go:247] Caches are synced for ReplicationController 

	I0813 20:20:48.354976       1 shared_informer.go:247] Caches are synced for taint 

	I0813 20:20:48.355035       1 node_lifecycle_controller.go:1398] Initializing eviction metric for zone: 

	W0813 20:20:48.355070       1 node_lifecycle_controller.go:1013] Missing timestamp for Node functional-20210813131926-8053. Assuming now as a timestamp.

	I0813 20:20:48.355090       1 node_lifecycle_controller.go:1214] Controller detected that zone  is now in state Normal.

	I0813 20:20:48.355287       1 taint_manager.go:187] "Starting NoExecuteTaintManager"

	I0813 20:20:48.355539       1 event.go:291] "Event occurred" object="functional-20210813131926-8053" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node functional-20210813131926-8053 event: Registered Node functional-20210813131926-8053 in Controller"

	I0813 20:20:48.363710       1 shared_informer.go:247] Caches are synced for resource quota 

	I0813 20:20:48.459455       1 shared_informer.go:247] Caches are synced for resource quota 

	I0813 20:20:48.813595       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-558bd4d5db to 2"

	I0813 20:20:48.865824       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-558bd4d5db to 1"

	I0813 20:20:48.867323       1 shared_informer.go:247] Caches are synced for garbage collector 

	I0813 20:20:48.867334       1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage

	I0813 20:20:48.878039       1 shared_informer.go:247] Caches are synced for garbage collector 

	I0813 20:20:48.914893       1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-kv9mv"

	I0813 20:20:49.013282       1 event.go:291] "Event occurred" object="kube-system/coredns-558bd4d5db" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-558bd4d5db-v2mbz"

	I0813 20:20:49.019258       1 event.go:291] "Event occurred" object="kube-system/coredns-558bd4d5db" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-558bd4d5db-rhdvr"

	I0813 20:20:49.030463       1 event.go:291] "Event occurred" object="kube-system/coredns-558bd4d5db" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-558bd4d5db-v2mbz"

	* 

	* ==> kube-controller-manager [aca358fec190] <==

	* I0813 20:22:39.355289       1 shared_informer.go:247] Caches are synced for node 

	I0813 20:22:39.355331       1 range_allocator.go:172] Starting range CIDR allocator

	I0813 20:22:39.355334       1 shared_informer.go:240] Waiting for caches to sync for cidrallocator

	I0813 20:22:39.355337       1 shared_informer.go:247] Caches are synced for cidrallocator 

	I0813 20:22:39.365263       1 shared_informer.go:247] Caches are synced for GC 

	I0813 20:22:39.381011       1 shared_informer.go:247] Caches are synced for persistent volume 

	I0813 20:22:39.382157       1 shared_informer.go:247] Caches are synced for endpoint_slice 

	I0813 20:22:39.385673       1 shared_informer.go:247] Caches are synced for daemon sets 

	I0813 20:22:39.385742       1 shared_informer.go:247] Caches are synced for TTL 

	I0813 20:22:39.392583       1 shared_informer.go:247] Caches are synced for disruption 

	I0813 20:22:39.392613       1 disruption.go:371] Sending events to api server.

	I0813 20:22:39.470556       1 shared_informer.go:247] Caches are synced for attach detach 

	I0813 20:22:39.502015       1 shared_informer.go:247] Caches are synced for resource quota 

	I0813 20:22:39.578946       1 shared_informer.go:247] Caches are synced for taint 

	I0813 20:22:39.579027       1 node_lifecycle_controller.go:1398] Initializing eviction metric for zone: 

	W0813 20:22:39.579072       1 node_lifecycle_controller.go:1013] Missing timestamp for Node functional-20210813131926-8053. Assuming now as a timestamp.

	I0813 20:22:39.579127       1 node_lifecycle_controller.go:1164] Controller detected that all Nodes are not-Ready. Entering master disruption mode.

	I0813 20:22:39.579329       1 taint_manager.go:187] "Starting NoExecuteTaintManager"

	I0813 20:22:39.579508       1 event.go:291] "Event occurred" object="functional-20210813131926-8053" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node functional-20210813131926-8053 event: Registered Node functional-20210813131926-8053 in Controller"

	I0813 20:22:39.585516       1 event.go:291] "Event occurred" object="kube-system/coredns-558bd4d5db-rhdvr" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"

	I0813 20:22:39.587057       1 event.go:291] "Event occurred" object="kube-system/kube-proxy-kv9mv" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"

	I0813 20:22:39.594768       1 shared_informer.go:247] Caches are synced for resource quota 

	I0813 20:22:39.960552       1 shared_informer.go:247] Caches are synced for garbage collector 

	I0813 20:22:39.960608       1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage

	I0813 20:22:40.005112       1 shared_informer.go:247] Caches are synced for garbage collector 

	* 

	* ==> kube-proxy [0237d371d391] <==

	* I0813 20:20:49.964466       1 node.go:172] Successfully retrieved node IP: 192.168.49.2

	I0813 20:20:49.964521       1 server_others.go:140] Detected node IP 192.168.49.2

	W0813 20:20:49.964567       1 server_others.go:598] Unknown proxy mode "", assuming iptables proxy

	I0813 20:20:52.244100       1 server_others.go:206] kube-proxy running in dual-stack mode, IPv4-primary

	I0813 20:20:52.244135       1 server_others.go:212] Using iptables Proxier.

	I0813 20:20:52.244143       1 server_others.go:219] creating dualStackProxier for iptables.

	W0813 20:20:52.244150       1 server_others.go:512] detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6

	I0813 20:20:52.244421       1 server.go:643] Version: v1.21.3

	I0813 20:20:52.244978       1 config.go:315] Starting service config controller

	I0813 20:20:52.245004       1 shared_informer.go:240] Waiting for caches to sync for service config

	I0813 20:20:52.245304       1 config.go:224] Starting endpoint slice config controller

	I0813 20:20:52.245329       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config

	W0813 20:20:52.248097       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	W0813 20:20:52.249674       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	I0813 20:20:52.345268       1 shared_informer.go:247] Caches are synced for service config 

	I0813 20:20:52.346418       1 shared_informer.go:247] Caches are synced for endpoint slice config 

	I0813 20:21:06.307240       1 trace.go:205] Trace[128053735]: "iptables restore" (13-Aug-2021 20:21:04.237) (total time: 2070ms):

	Trace[128053735]: [2.070087345s] [2.070087345s] END

	I0813 20:21:16.207178       1 trace.go:205] Trace[1148819465]: "iptables restore" (13-Aug-2021 20:21:14.011) (total time: 2195ms):

	Trace[1148819465]: [2.195338087s] [2.195338087s] END

	I0813 20:21:39.273178       1 trace.go:205] Trace[1324115582]: "iptables restore" (13-Aug-2021 20:21:36.931) (total time: 2341ms):

	Trace[1324115582]: [2.341227915s] [2.341227915s] END

	* 

	* ==> kube-proxy [a4dbf0c14cf5] <==

	* E0813 20:22:00.692301       1 node.go:161] Failed to retrieve node info: Get "https://control-plane.minikube.internal:8441/api/v1/nodes/functional-20210813131926-8053": dial tcp 192.168.49.2:8441: connect: connection refused

	I0813 20:22:04.764901       1 node.go:172] Successfully retrieved node IP: 192.168.49.2

	I0813 20:22:04.765017       1 server_others.go:140] Detected node IP 192.168.49.2

	W0813 20:22:04.765060       1 server_others.go:598] Unknown proxy mode "", assuming iptables proxy

	I0813 20:22:07.101758       1 server_others.go:206] kube-proxy running in dual-stack mode, IPv4-primary

	I0813 20:22:07.101850       1 server_others.go:212] Using iptables Proxier.

	I0813 20:22:07.101859       1 server_others.go:219] creating dualStackProxier for iptables.

	W0813 20:22:07.101866       1 server_others.go:512] detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6

	I0813 20:22:07.102184       1 server.go:643] Version: v1.21.3

	I0813 20:22:07.102649       1 config.go:224] Starting endpoint slice config controller

	I0813 20:22:07.102742       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config

	I0813 20:22:07.102831       1 config.go:315] Starting service config controller

	I0813 20:22:07.102858       1 shared_informer.go:240] Waiting for caches to sync for service config

	W0813 20:22:07.108215       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	W0813 20:22:07.108883       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	I0813 20:22:07.203497       1 shared_informer.go:247] Caches are synced for endpoint slice config 

	I0813 20:22:07.203527       1 shared_informer.go:247] Caches are synced for service config 

	* 

	* ==> kube-scheduler [702cee73a40c] <==

	* I0813 20:22:01.509672       1 serving.go:347] Generated self-signed cert in-memory

	W0813 20:22:04.723419       1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'

	W0813 20:22:04.723453       1 authentication.go:337] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"

	W0813 20:22:04.723459       1 authentication.go:338] Continuing without authentication configuration. This may treat all requests as anonymous.

	W0813 20:22:04.723462       1 authentication.go:339] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false

	I0813 20:22:04.775715       1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0813 20:22:04.775753       1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0813 20:22:04.775897       1 secure_serving.go:197] Serving securely on 127.0.0.1:10259

	I0813 20:22:04.775954       1 tlsconfig.go:240] Starting DynamicServingCertificateController

	I0813 20:22:04.876958       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 

	* 

	* ==> kube-scheduler [9d5404187c66] <==

	* W0813 20:20:32.597185       1 authentication.go:337] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"

	W0813 20:20:32.597203       1 authentication.go:338] Continuing without authentication configuration. This may treat all requests as anonymous.

	W0813 20:20:32.597209       1 authentication.go:339] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false

	I0813 20:20:32.636201       1 secure_serving.go:197] Serving securely on 127.0.0.1:10259

	I0813 20:20:32.636276       1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0813 20:20:32.636280       1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0813 20:20:32.636287       1 tlsconfig.go:240] Starting DynamicServingCertificateController

	E0813 20:20:32.638772       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0813 20:20:32.639124       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0813 20:20:32.639163       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0813 20:20:32.639717       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0813 20:20:32.639970       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0813 20:20:32.639991       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0813 20:20:32.639972       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0813 20:20:32.640465       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.CSIStorageCapacity: failed to list *v1beta1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0813 20:20:32.640478       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E0813 20:20:32.641351       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0813 20:20:32.641376       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E0813 20:20:32.641817       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E0813 20:20:32.642227       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0813 20:20:32.643414       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0813 20:20:33.468213       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0813 20:20:33.582738       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0813 20:20:33.719031       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	I0813 20:20:33.936406       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 

	* 

	* ==> kubelet <==

	* -- Logs begin at Fri 2021-08-13 20:19:47 UTC, end at Fri 2021-08-13 20:22:44 UTC. --

	Aug 13 20:22:23 functional-20210813131926-8053 kubelet[6370]: I0813 20:22:23.986209    6370 status_manager.go:566] "Failed to get status for pod" podUID=a167fed55ab8e696561f106c712b5471 pod="kube-system/kube-controller-manager-functional-20210813131926-8053" error="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/kube-controller-manager-functional-20210813131926-8053\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Aug 13 20:22:24 functional-20210813131926-8053 kubelet[6370]: E0813 20:22:24.068711    6370 controller.go:144] failed to ensure lease exists, will retry in 3.2s, error: Get "https://control-plane.minikube.internal:8441/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/functional-20210813131926-8053?timeout=10s": dial tcp 192.168.49.2:8441: connect: connection refused

	Aug 13 20:22:24 functional-20210813131926-8053 kubelet[6370]: I0813 20:22:24.592809    6370 status_manager.go:566] "Failed to get status for pod" podUID=9920347a8ff803b04ba09db0db41daaa pod="kube-system/kube-scheduler-functional-20210813131926-8053" error="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/kube-scheduler-functional-20210813131926-8053\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Aug 13 20:22:24 functional-20210813131926-8053 kubelet[6370]: I0813 20:22:24.593519    6370 status_manager.go:566] "Failed to get status for pod" podUID=a167fed55ab8e696561f106c712b5471 pod="kube-system/kube-controller-manager-functional-20210813131926-8053" error="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/kube-controller-manager-functional-20210813131926-8053\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Aug 13 20:22:24 functional-20210813131926-8053 kubelet[6370]: I0813 20:22:24.594022    6370 status_manager.go:566] "Failed to get status for pod" podUID=0e2a05e9d5f62a76b6deb0dd5ab4d463 pod="kube-system/etcd-functional-20210813131926-8053" error="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/etcd-functional-20210813131926-8053\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Aug 13 20:22:24 functional-20210813131926-8053 kubelet[6370]: I0813 20:22:24.594390    6370 status_manager.go:566] "Failed to get status for pod" podUID=d75f1151-7edf-4dac-acd9-128a49223ff1 pod="kube-system/storage-provisioner" error="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/storage-provisioner\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Aug 13 20:22:24 functional-20210813131926-8053 kubelet[6370]: I0813 20:22:24.594745    6370 status_manager.go:566] "Failed to get status for pod" podUID=5a622440-7ec5-4279-906a-dbb6df1293e4 pod="kube-system/coredns-558bd4d5db-rhdvr" error="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/coredns-558bd4d5db-rhdvr\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Aug 13 20:22:24 functional-20210813131926-8053 kubelet[6370]: I0813 20:22:24.594991    6370 status_manager.go:566] "Failed to get status for pod" podUID=99734e2c0a10537dcc22706974d552e2 pod="kube-system/kube-apiserver-functional-20210813131926-8053" error="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/kube-apiserver-functional-20210813131926-8053\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Aug 13 20:22:24 functional-20210813131926-8053 kubelet[6370]: I0813 20:22:24.726443    6370 status_manager.go:566] "Failed to get status for pod" podUID=a167fed55ab8e696561f106c712b5471 pod="kube-system/kube-controller-manager-functional-20210813131926-8053" error="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/kube-controller-manager-functional-20210813131926-8053\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Aug 13 20:22:27 functional-20210813131926-8053 kubelet[6370]: E0813 20:22:27.269636    6370 controller.go:144] failed to ensure lease exists, will retry in 6.4s, error: Get "https://control-plane.minikube.internal:8441/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/functional-20210813131926-8053?timeout=10s": dial tcp 192.168.49.2:8441: connect: connection refused

	Aug 13 20:22:27 functional-20210813131926-8053 kubelet[6370]: E0813 20:22:27.938014    6370 event.go:273] Unable to write event: '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kube-apiserver-functional-20210813131926-8053.169af74fa4ad3b05", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Pod", Namespace:"kube-system", Name:"kube-apiserver-functional-20210813131926-8053", UID:"99734e2c0a10537dcc22706974d552e2", APIVersion:"v1", ResourceVersion:"", FieldPath:"spec.containers{kube-apiserver}"}, Reason:"BackOff", Message:"B

ack-off restarting failed container", Source:v1.EventSource{Component:"kubelet", Host:"functional-20210813131926-8053"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc03dd2fe28d68b05, ext:10334646829, loc:(*time.Location)(0x74c3600)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc03dd2fe28d68b05, ext:10334646829, loc:(*time.Location)(0x74c3600)}}, Count:1, Type:"Warning", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'Post "https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/events": dial tcp 192.168.49.2:8441: connect: connection refused'(may retry after sleeping)

	Aug 13 20:22:31 functional-20210813131926-8053 kubelet[6370]: E0813 20:22:31.099159    6370 kubelet_node_status.go:470] "Error updating node status, will retry" err="error getting node \"functional-20210813131926-8053\": Get \"https://control-plane.minikube.internal:8441/api/v1/nodes/functional-20210813131926-8053?resourceVersion=0&timeout=10s\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Aug 13 20:22:31 functional-20210813131926-8053 kubelet[6370]: E0813 20:22:31.099566    6370 kubelet_node_status.go:470] "Error updating node status, will retry" err="error getting node \"functional-20210813131926-8053\": Get \"https://control-plane.minikube.internal:8441/api/v1/nodes/functional-20210813131926-8053?timeout=10s\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Aug 13 20:22:31 functional-20210813131926-8053 kubelet[6370]: E0813 20:22:31.099850    6370 kubelet_node_status.go:470] "Error updating node status, will retry" err="error getting node \"functional-20210813131926-8053\": Get \"https://control-plane.minikube.internal:8441/api/v1/nodes/functional-20210813131926-8053?timeout=10s\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Aug 13 20:22:31 functional-20210813131926-8053 kubelet[6370]: E0813 20:22:31.100137    6370 kubelet_node_status.go:470] "Error updating node status, will retry" err="error getting node \"functional-20210813131926-8053\": Get \"https://control-plane.minikube.internal:8441/api/v1/nodes/functional-20210813131926-8053?timeout=10s\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Aug 13 20:22:31 functional-20210813131926-8053 kubelet[6370]: E0813 20:22:31.100310    6370 kubelet_node_status.go:470] "Error updating node status, will retry" err="error getting node \"functional-20210813131926-8053\": Get \"https://control-plane.minikube.internal:8441/api/v1/nodes/functional-20210813131926-8053?timeout=10s\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Aug 13 20:22:31 functional-20210813131926-8053 kubelet[6370]: E0813 20:22:31.100355    6370 kubelet_node_status.go:457] "Unable to update node status" err="update node status exceeds retry count"

	Aug 13 20:22:33 functional-20210813131926-8053 kubelet[6370]: E0813 20:22:33.671273    6370 controller.go:144] failed to ensure lease exists, will retry in 7s, error: Get "https://control-plane.minikube.internal:8441/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/functional-20210813131926-8053?timeout=10s": dial tcp 192.168.49.2:8441: connect: connection refused

	Aug 13 20:22:34 functional-20210813131926-8053 kubelet[6370]: I0813 20:22:34.593321    6370 status_manager.go:566] "Failed to get status for pod" podUID=a167fed55ab8e696561f106c712b5471 pod="kube-system/kube-controller-manager-functional-20210813131926-8053" error="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/kube-controller-manager-functional-20210813131926-8053\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Aug 13 20:22:34 functional-20210813131926-8053 kubelet[6370]: I0813 20:22:34.593738    6370 status_manager.go:566] "Failed to get status for pod" podUID=0e2a05e9d5f62a76b6deb0dd5ab4d463 pod="kube-system/etcd-functional-20210813131926-8053" error="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/etcd-functional-20210813131926-8053\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Aug 13 20:22:34 functional-20210813131926-8053 kubelet[6370]: I0813 20:22:34.594143    6370 status_manager.go:566] "Failed to get status for pod" podUID=d75f1151-7edf-4dac-acd9-128a49223ff1 pod="kube-system/storage-provisioner" error="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/storage-provisioner\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Aug 13 20:22:34 functional-20210813131926-8053 kubelet[6370]: I0813 20:22:34.594538    6370 status_manager.go:566] "Failed to get status for pod" podUID=5a622440-7ec5-4279-906a-dbb6df1293e4 pod="kube-system/coredns-558bd4d5db-rhdvr" error="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/coredns-558bd4d5db-rhdvr\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Aug 13 20:22:34 functional-20210813131926-8053 kubelet[6370]: I0813 20:22:34.594971    6370 status_manager.go:566] "Failed to get status for pod" podUID=99734e2c0a10537dcc22706974d552e2 pod="kube-system/kube-apiserver-functional-20210813131926-8053" error="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/kube-apiserver-functional-20210813131926-8053\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Aug 13 20:22:34 functional-20210813131926-8053 kubelet[6370]: I0813 20:22:34.595333    6370 status_manager.go:566] "Failed to get status for pod" podUID=9920347a8ff803b04ba09db0db41daaa pod="kube-system/kube-scheduler-functional-20210813131926-8053" error="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/kube-scheduler-functional-20210813131926-8053\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Aug 13 20:22:35 functional-20210813131926-8053 kubelet[6370]: I0813 20:22:35.593232    6370 scope.go:111] "RemoveContainer" containerID="83fc53fcb046e52a6a02b2f2de4613942e95c75ddada33df73d84d63c79d8e2c"

	* 

	* ==> storage-provisioner [b2296fd0d1e9] <==

	* I0813 20:22:16.010598       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0813 20:22:16.019564       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0813 20:22:16.019654       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	E0813 20:22:19.475117       1 leaderelection.go:325] error retrieving resource lock kube-system/k8s.io-minikube-hostpath: Get "https://10.96.0.1:443/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath": dial tcp 10.96.0.1:443: connect: connection refused

	E0813 20:22:23.712008       1 leaderelection.go:325] error retrieving resource lock kube-system/k8s.io-minikube-hostpath: Get "https://10.96.0.1:443/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath": dial tcp 10.96.0.1:443: connect: connection refused

	E0813 20:22:27.307605       1 leaderelection.go:325] error retrieving resource lock kube-system/k8s.io-minikube-hostpath: Get "https://10.96.0.1:443/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath": dial tcp 10.96.0.1:443: connect: connection refused

	E0813 20:22:30.359555       1 leaderelection.go:325] error retrieving resource lock kube-system/k8s.io-minikube-hostpath: Get "https://10.96.0.1:443/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath": dial tcp 10.96.0.1:443: connect: connection refused

	E0813 20:22:33.380137       1 leaderelection.go:325] error retrieving resource lock kube-system/k8s.io-minikube-hostpath: Get "https://10.96.0.1:443/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath": dial tcp 10.96.0.1:443: connect: connection refused

	I0813 20:22:38.347369       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0813 20:22:38.347493       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_functional-20210813131926-8053_281ee2df-bf55-432e-9ac9-afb821b0ef0f!

	I0813 20:22:38.347810       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"f3924885-42ee-4404-b92b-18e2b80efef1", APIVersion:"v1", ResourceVersion:"551", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' functional-20210813131926-8053_281ee2df-bf55-432e-9ac9-afb821b0ef0f became leader

	I0813 20:22:38.448501       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_functional-20210813131926-8053_281ee2df-bf55-432e-9ac9-afb821b0ef0f!

	* 

	* ==> storage-provisioner [c9cb7d5809d8] <==

	* I0813 20:21:21.763366       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0813 20:21:21.770235       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0813 20:21:21.770261       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I0813 20:21:21.783492       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0813 20:21:21.783642       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_functional-20210813131926-8053_89caf2fd-c393-4aa5-aa11-ee255d4b4c7a!

	I0813 20:21:21.783642       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"f3924885-42ee-4404-b92b-18e2b80efef1", APIVersion:"v1", ResourceVersion:"479", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' functional-20210813131926-8053_89caf2fd-c393-4aa5-aa11-ee255d4b4c7a became leader

	I0813 20:21:21.885038       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_functional-20210813131926-8053_89caf2fd-c393-4aa5-aa11-ee255d4b4c7a!

-- /stdout --

helpers_test.go:255: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.APIServer}} -p functional-20210813131926-8053 -n functional-20210813131926-8053

helpers_test.go:262: (dbg) Run:  kubectl --context functional-20210813131926-8053 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:271: non-running pods: 

helpers_test.go:273: ======> post-mortem[TestFunctional/serial/ExtraConfig]: describe non-running pods <======

helpers_test.go:276: (dbg) Run:  kubectl --context functional-20210813131926-8053 describe pod 

helpers_test.go:276: (dbg) Non-zero exit: kubectl --context functional-20210813131926-8053 describe pod : exit status 1 (42.979113ms)

** stderr ** 

	error: resource name may not be empty

** /stderr **

helpers_test.go:278: kubectl --context functional-20210813131926-8053 describe pod : exit status 1

--- FAIL: TestFunctional/serial/ExtraConfig (51.58s)

=== RUN   TestFunctional/serial/ComponentHealth

functional_test.go:766: (dbg) Run:  kubectl --context functional-20210813131926-8053 get po -l tier=control-plane -n kube-system -o=json

functional_test.go:780: etcd phase: Running

functional_test.go:790: etcd status: Ready

functional_test.go:780: kube-apiserver phase: Running

functional_test.go:788: kube-apiserver is not Ready: {Phase:Running Conditions:[{Type:Initialized Status:True} {Type:Ready Status:False} {Type:ContainersReady Status:False} {Type:PodScheduled Status:True}] Message: Reason: HostIP:192.168.49.2 PodIP:192.168.49.2 StartTime:2021-08-13 13:20:39 -0700 PDT ContainerStatuses:[{Name:kube-apiserver State:{Waiting:<nil> Running:0xc00010e9a8 Terminated:<nil>} LastTerminationState:{Waiting:<nil> Running:<nil> Terminated:0xc0002500e0} Ready:false RestartCount:2 Image:k8s.gcr.io/kube-apiserver:v1.21.3 ImageID:docker-pullable://k8s.gcr.io/kube-apiserver@sha256:7950be952e1bf5fea24bd8deb79dd871b92d7f2ae02751467670ed9e54fa27c2 ContainerID:docker://6d69afd52f8c34c707293b9aa279b6ceaf30e3218a80668dbb2377beca35159a}]}

functional_test.go:780: kube-controller-manager phase: Running

functional_test.go:790: kube-controller-manager status: Ready

functional_test.go:780: kube-scheduler phase: Running

functional_test.go:790: kube-scheduler status: Ready

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:231: ======>  post-mortem[TestFunctional/serial/ComponentHealth]: docker inspect <======

helpers_test.go:232: (dbg) Run:  docker inspect functional-20210813131926-8053

helpers_test.go:236: (dbg) docker inspect functional-20210813131926-8053:

-- stdout --

	[

	    {

	        "Id": "bd6d952ddeb5f310f9e68d0a941d3ceea9f8bcc59b82fe82663073652312e7bf",

	        "Created": "2021-08-13T20:19:33.443339625Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

	        ],

	        "State": {

	            "Status": "running",

	            "Running": true,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 19884,

	            "ExitCode": 0,

	            "Error": "",

	            "StartedAt": "2021-08-13T20:19:45.440445983Z",

	            "FinishedAt": "0001-01-01T00:00:00Z"

	        },

	        "Image": "sha256:965ebc74cb435c5d73c204fcd638e9daa526ad4ce3ec7f76be1149f30a789fab",

	        "ResolvConfPath": "/var/lib/docker/containers/bd6d952ddeb5f310f9e68d0a941d3ceea9f8bcc59b82fe82663073652312e7bf/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/bd6d952ddeb5f310f9e68d0a941d3ceea9f8bcc59b82fe82663073652312e7bf/hostname",

	        "HostsPath": "/var/lib/docker/containers/bd6d952ddeb5f310f9e68d0a941d3ceea9f8bcc59b82fe82663073652312e7bf/hosts",

	        "LogPath": "/var/lib/docker/containers/bd6d952ddeb5f310f9e68d0a941d3ceea9f8bcc59b82fe82663073652312e7bf/bd6d952ddeb5f310f9e68d0a941d3ceea9f8bcc59b82fe82663073652312e7bf-json.log",

	        "Name": "/functional-20210813131926-8053",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "/lib/modules:/lib/modules:ro",

	                "functional-20210813131926-8053:/var"

	            ],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

	            },

	            "NetworkMode": "functional-20210813131926-8053",

	            "PortBindings": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "8441/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ]

	            },

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

	            },

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "CapAdd": null,

	            "CapDrop": null,

	            "CgroupnsMode": "host",

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

	            ],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

	            },

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "ConsoleSize": [

	                0,

	                0

	            ],

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 4194304000,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": null,

	            "BlkioDeviceWriteBps": null,

	            "BlkioDeviceReadIOps": null,

	            "BlkioDeviceWriteIOps": null,

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "KernelMemory": 0,

	            "KernelMemoryTCP": 0,

	            "MemoryReservation": 0,

	            "MemorySwap": 4194304000,

	            "MemorySwappiness": null,

	            "OomKillDisable": false,

	            "PidsLimit": null,

	            "Ulimits": null,

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

	        },

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/3e4f101879c21cc86d3a345e84686ecfb0097ad0ef90e43949ac1917b277a31e-init/diff:/var/lib/docker/overlay2/b54d50d9722d23fb9637685b11892fb665fc20ba78ef431e07ed0ddfa868f7a1/diff:/var/lib/docker/overlay2/1ae49b54a8b23aaf60a7e9c9307ca333358576bae3a785f52751cdad083df982/diff:/var/lib/docker/overlay2/ea6c3052036e679f2d58c32269d4ea3143a3fc6f94abfc4e49173b050ea86a8b/diff:/var/lib/docker/overlay2/2a2dd58c96ee8d28d6328f3dc040dba105ab05a3a180db9efc72ab81c4f2dea8/diff:/var/lib/docker/overlay2/9b983e97e9a66172cc09d2798bfaa346d9fd6426e616339301e3bb8123e0e4f8/diff:/var/lib/docker/overlay2/dfeb06e54a5cea59763125a281a2a6800cd59c816b67601654af91996c53b0e9/diff:/var/lib/docker/overlay2/c9d50722d4822ee84b54a4086271aaa76449764ccee5cd9b3107efe20362db77/diff:/var/lib/docker/overlay2/7146eb1978a4f01c8661964f9a7e8e6900a73759e6d7f926784135a8c3675a0e/diff:/var/lib/docker/overlay2/6bcc532777a8b16bf0a8d49f5eba5dce2dad7acf9dd5d76a36fe91e4865df73c/diff:/var/lib/docker/overlay2/14de3b

84777e6d4bcd5b959be54fc67048ed8595b21548c2cb72c44e5bab5411/diff:/var/lib/docker/overlay2/f1ddefd3cddc8a76bb8102eba187352b3597d4a313ab8481788107dc17bb30be/diff:/var/lib/docker/overlay2/2be5ff1c0f18fc355d3d429c9a258aa1be9e5ebd0dd9b444f05aace4cc7acfea/diff:/var/lib/docker/overlay2/d1937ecc380ba5be5a64d9961a07aa0fa09d55136209e276d6ab5a08a2a5ce3c/diff:/var/lib/docker/overlay2/4b9bb8d1431c5ac321918e64797c008658b5e0db3587b9e7f484d00192b5a4be/diff:/var/lib/docker/overlay2/f9e7584420f2143a3affbe57ddd381ed9799067270b57d06e1af337987563637/diff:/var/lib/docker/overlay2/1ae74edd645de1296fe2ff40ac0d7659d56c4af7676d1e2b7077666f5cb598c4/diff:/var/lib/docker/overlay2/33df86dfa679c1be13df61855de34c224815a39320b3ee12131540df41ef4561/diff:/var/lib/docker/overlay2/eb8b1800e30954e5cf6fc67fbfa89db41d615ee50103aa0589446907b8c7ac49/diff:/var/lib/docker/overlay2/5c052f8924308a6f0fe3ae4941882e4b909ed1aeb01123b9e2faa7df2696de93/diff:/var/lib/docker/overlay2/69b433d87c6a506c3d510619bb41e8737b7e3d06bac5eb128be3e00efb740b98/diff:/var/lib/d

ocker/overlay2/c07998bd533865848849c722ed55cfa571f9562726f3fdb9bfd15f7b5936a8e6/diff:/var/lib/docker/overlay2/3df1a883fd0d44918646d29788faa76a5e7aaaf4b46a6ea2240c9d4b8bd4dc09/diff:/var/lib/docker/overlay2/9f2a07552f95e43119898b9bbe1e61d165ecd9eb3e862730a04a643bcc53a8c6/diff:/var/lib/docker/overlay2/fd2df25ca7e6b268f819b2fb38bbab50fbd5c6c8a4a2b4778f3917e567c64b8b/diff:/var/lib/docker/overlay2/a4639cb93382ebf39584a53948b6816dc6aa8e7011f2474b82320e09565c40ee/diff:/var/lib/docker/overlay2/16f320558e9c6c23b229f8b4dcf6f5c61670fa7b6513b707c1ceee8ff53ab012/diff:/var/lib/docker/overlay2/efde92a54c645d3d214babfea86fe173c88681a9a8bf1ee4c66f406eac0ce1f3/diff:/var/lib/docker/overlay2/67c175358f08a90e727cc2e59d3dc3f243bf98721348962ca80cedaa946e11e5/diff:/var/lib/docker/overlay2/abce6c2b52def112a2855b7240dfeb6e7ce8747ff80ae82b8c90df4358b5499f/diff:/var/lib/docker/overlay2/04adc9448565c768e00d76ed848aec196d92c4bcb1ba0268162b97accedfe7c0/diff:/var/lib/docker/overlay2/785c77e0f49a7d75d4a92bd8febab1b2a23633cd8c7be0e16fc628afb34

bcd83/diff:/var/lib/docker/overlay2/6716a51894c949d720d02845ebfc34f1d9f2431f04ffc2521d1b4fdf617ba172/diff:/var/lib/docker/overlay2/f7a3d7b89f4cc68fc5e0dd1756a2ae6260c2f0f5ab4bc40c3ce6b1b4d6ef0004/diff:/var/lib/docker/overlay2/91b9a991885a072e8afd1908c183be7e860cef03f6b3fbb173e06fdc90db2527/diff:/var/lib/docker/overlay2/8f4a011cc74f93ad854a02453507ef603a3da67ee7a766dfca38d3a46f5cdfb9/diff:/var/lib/docker/overlay2/b26e3ade0d328d23c224932591c878b90768d1c5e7058ccb26382021520bd343/diff",

	                "MergedDir": "/var/lib/docker/overlay2/3e4f101879c21cc86d3a345e84686ecfb0097ad0ef90e43949ac1917b277a31e/merged",

	                "UpperDir": "/var/lib/docker/overlay2/3e4f101879c21cc86d3a345e84686ecfb0097ad0ef90e43949ac1917b277a31e/diff",

	                "WorkDir": "/var/lib/docker/overlay2/3e4f101879c21cc86d3a345e84686ecfb0097ad0ef90e43949ac1917b277a31e/work"

	            },

	            "Name": "overlay2"

	        },

	        "Mounts": [

	            {

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

	            },

	            {

	                "Type": "volume",

	                "Name": "functional-20210813131926-8053",

	                "Source": "/var/lib/docker/volumes/functional-20210813131926-8053/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

	            }

	        ],

	        "Config": {

	            "Hostname": "functional-20210813131926-8053",

	            "Domainname": "",

	            "User": "root",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8441/tcp": {}

	            },

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

	            ],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6",

	            "Volumes": null,

	            "WorkingDir": "",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

	            ],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "functional-20210813131926-8053",

	                "name.minikube.sigs.k8s.io": "functional-20210813131926-8053",

	                "role.minikube.sigs.k8s.io": ""

	            },

	            "StopSignal": "SIGRTMIN+3"

	        },

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "fffc56d9ef4e71afae913f074fc77456290700b22c27c1f9874cc15c0358d2a3",

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "Ports": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "59731"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "59727"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "59728"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "59729"

	                    }

	                ],

	                "8441/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "59730"

	                    }

	                ]

	            },

	            "SandboxKey": "/var/run/docker/netns/fffc56d9ef4e",

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "functional-20210813131926-8053": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.49.2"

	                    },

	                    "Links": null,

	                    "Aliases": [

	                        "bd6d952ddeb5",

	                        "functional-20210813131926-8053"

	                    ],

	                    "NetworkID": "743ef3df7ddcc98a6822c8028d2b77ac28e2e76e3cc13ccd232db1d778dce820",

	                    "EndpointID": "9696b4dcace8ca7aad9efa41f1202a5fb2b54319373b4ef9628f151b3d732e54",

	                    "Gateway": "192.168.49.1",

	                    "IPAddress": "192.168.49.2",

	                    "IPPrefixLen": 24,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "MacAddress": "02:42:c0:a8:31:02",

	                    "DriverOpts": null

	                }

	            }

	        }

	    }

	]

-- /stdout --

helpers_test.go:240: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-20210813131926-8053 -n functional-20210813131926-8053

helpers_test.go:245: <<< TestFunctional/serial/ComponentHealth FAILED: start of post-mortem logs <<<

helpers_test.go:246: ======>  post-mortem[TestFunctional/serial/ComponentHealth]: minikube logs <======

helpers_test.go:248: (dbg) Run:  out/minikube-darwin-amd64 -p functional-20210813131926-8053 logs -n 25

helpers_test.go:248: (dbg) Done: out/minikube-darwin-amd64 -p functional-20210813131926-8053 logs -n 25: (3.285069466s)

helpers_test.go:253: TestFunctional/serial/ComponentHealth logs: 

-- stdout --

	* 

	* ==> Audit <==

	* |---------|-----------------------------------------------------------------------------|--------------------------------|---------|---------|-------------------------------|-------------------------------|

	| Command |                                    Args                                     |            Profile             |  User   | Version |          Start Time           |           End Time            |

	|---------|-----------------------------------------------------------------------------|--------------------------------|---------|---------|-------------------------------|-------------------------------|

	| -p      | nospam-20210813131728-8053 --log_dir                                        | nospam-20210813131728-8053     | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:18:59 PDT | Fri, 13 Aug 2021 13:18:59 PDT |

	|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-20210813131728-8053 |                                |         |         |                               |                               |

	|         | unpause                                                                     |                                |         |         |                               |                               |

	| -p      | nospam-20210813131728-8053 --log_dir                                        | nospam-20210813131728-8053     | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:18:59 PDT | Fri, 13 Aug 2021 13:19:00 PDT |

	|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-20210813131728-8053 |                                |         |         |                               |                               |

	|         | unpause                                                                     |                                |         |         |                               |                               |

	| -p      | nospam-20210813131728-8053 --log_dir                                        | nospam-20210813131728-8053     | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:19:00 PDT | Fri, 13 Aug 2021 13:19:01 PDT |

	|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-20210813131728-8053 |                                |         |         |                               |                               |

	|         | unpause                                                                     |                                |         |         |                               |                               |

	| -p      | nospam-20210813131728-8053 --log_dir                                        | nospam-20210813131728-8053     | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:19:01 PDT | Fri, 13 Aug 2021 13:19:18 PDT |

	|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-20210813131728-8053 |                                |         |         |                               |                               |

	|         | stop                                                                        |                                |         |         |                               |                               |

	| -p      | nospam-20210813131728-8053 --log_dir                                        | nospam-20210813131728-8053     | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:19:18 PDT | Fri, 13 Aug 2021 13:19:19 PDT |

	|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-20210813131728-8053 |                                |         |         |                               |                               |

	|         | stop                                                                        |                                |         |         |                               |                               |

	| -p      | nospam-20210813131728-8053 --log_dir                                        | nospam-20210813131728-8053     | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:19:19 PDT | Fri, 13 Aug 2021 13:19:19 PDT |

	|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-20210813131728-8053 |                                |         |         |                               |                               |

	|         | stop                                                                        |                                |         |         |                               |                               |

	| delete  | -p nospam-20210813131728-8053                                               | nospam-20210813131728-8053     | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:19:19 PDT | Fri, 13 Aug 2021 13:19:25 PDT |

	| start   | -p                                                                          | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:19:26 PDT | Fri, 13 Aug 2021 13:21:30 PDT |

	|         | functional-20210813131926-8053                                              |                                |         |         |                               |                               |

	|         | --memory=4000                                                               |                                |         |         |                               |                               |

	|         | --apiserver-port=8441                                                       |                                |         |         |                               |                               |

	|         | --wait=all --driver=docker                                                  |                                |         |         |                               |                               |

	| start   | -p                                                                          | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:30 PDT | Fri, 13 Aug 2021 13:21:38 PDT |

	|         | functional-20210813131926-8053                                              |                                |         |         |                               |                               |

	|         | --alsologtostderr -v=8                                                      |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                              | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:40 PDT | Fri, 13 Aug 2021 13:21:41 PDT |

	|         | cache add k8s.gcr.io/pause:3.1                                              |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                              | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:41 PDT | Fri, 13 Aug 2021 13:21:44 PDT |

	|         | cache add k8s.gcr.io/pause:3.3                                              |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                              | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:44 PDT | Fri, 13 Aug 2021 13:21:46 PDT |

	|         | cache add                                                                   |                                |         |         |                               |                               |

	|         | k8s.gcr.io/pause:latest                                                     |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053 cache add                                    | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:46 PDT | Fri, 13 Aug 2021 13:21:48 PDT |

	|         | minikube-local-cache-test:functional-20210813131926-8053                    |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053 cache delete                                 | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:48 PDT | Fri, 13 Aug 2021 13:21:48 PDT |

	|         | minikube-local-cache-test:functional-20210813131926-8053                    |                                |         |         |                               |                               |

	| cache   | delete k8s.gcr.io/pause:3.3                                                 | minikube                       | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:48 PDT | Fri, 13 Aug 2021 13:21:48 PDT |

	| cache   | list                                                                        | minikube                       | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:48 PDT | Fri, 13 Aug 2021 13:21:48 PDT |

	| -p      | functional-20210813131926-8053                                              | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:48 PDT | Fri, 13 Aug 2021 13:21:49 PDT |

	|         | ssh sudo crictl images                                                      |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                              | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:49 PDT | Fri, 13 Aug 2021 13:21:50 PDT |

	|         | ssh sudo docker rmi                                                         |                                |         |         |                               |                               |

	|         | k8s.gcr.io/pause:latest                                                     |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                              | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:50 PDT | Fri, 13 Aug 2021 13:21:52 PDT |

	|         | cache reload                                                                |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                              | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:52 PDT | Fri, 13 Aug 2021 13:21:53 PDT |

	|         | ssh sudo crictl inspecti                                                    |                                |         |         |                               |                               |

	|         | k8s.gcr.io/pause:latest                                                     |                                |         |         |                               |                               |

	| cache   | delete k8s.gcr.io/pause:3.1                                                 | minikube                       | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:53 PDT | Fri, 13 Aug 2021 13:21:53 PDT |

	| cache   | delete k8s.gcr.io/pause:latest                                              | minikube                       | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:53 PDT | Fri, 13 Aug 2021 13:21:53 PDT |

	| -p      | functional-20210813131926-8053                                              | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:53 PDT | Fri, 13 Aug 2021 13:21:53 PDT |

	|         | kubectl -- --context                                                        |                                |         |         |                               |                               |

	|         | functional-20210813131926-8053                                              |                                |         |         |                               |                               |

	|         | get pods                                                                    |                                |         |         |                               |                               |

	| kubectl | --profile=functional-20210813131926-8053                                    | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:54 PDT | Fri, 13 Aug 2021 13:21:54 PDT |

	|         | -- --context                                                                |                                |         |         |                               |                               |

	|         | functional-20210813131926-8053 get pods                                     |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                              | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:22:41 PDT | Fri, 13 Aug 2021 13:22:45 PDT |

	|         | logs -n 25                                                                  |                                |         |         |                               |                               |

	|---------|-----------------------------------------------------------------------------|--------------------------------|---------|---------|-------------------------------|-------------------------------|

	* 

	* ==> Last Start <==

	* Log file created at: 2021/08/13 13:21:54

	Running on machine: 37309

	Binary: Built with gc go1.16.7 for darwin/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0813 13:21:54.281145    9787 out.go:298] Setting OutFile to fd 1 ...

	I0813 13:21:54.281275    9787 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0813 13:21:54.281277    9787 out.go:311] Setting ErrFile to fd 2...

	I0813 13:21:54.281279    9787 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0813 13:21:54.281354    9787 root.go:313] Updating PATH: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/bin

	I0813 13:21:54.281600    9787 out.go:305] Setting JSON to false

	I0813 13:21:54.299621    9787 start.go:111] hostinfo: {"hostname":"37309.local","uptime":4889,"bootTime":1628881225,"procs":312,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"11.2.3","kernelVersion":"20.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"c86236b2-4976-3542-80ca-74a6b8b4ba03"}

	W0813 13:21:54.299706    9787 start.go:119] gopshost.Virtualization returned error: not implemented yet

	I0813 13:21:54.326713    9787 out.go:177] * [functional-20210813131926-8053] minikube v1.22.0 on Darwin 11.2.3

	I0813 13:21:54.326846    9787 notify.go:169] Checking for updates...

	I0813 13:21:54.390409    9787 out.go:177]   - MINIKUBE_LOCATION=12230

	I0813 13:21:54.416142    9787 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/kubeconfig

	I0813 13:21:54.442299    9787 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64

	I0813 13:21:54.468300    9787 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube

	I0813 13:21:54.468666    9787 config.go:177] Loaded profile config "functional-20210813131926-8053": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.21.3

	I0813 13:21:54.468700    9787 driver.go:335] Setting default libvirt URI to qemu:///system

	I0813 13:21:54.567961    9787 docker.go:132] docker version: linux-20.10.6

	I0813 13:21:54.568092    9787 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I0813 13:21:54.749184    9787 info.go:263] docker info: {ID:43SM:MII3:NWBL:WJUG:JMKA:JL3W:EOOO:ZEGZ:7ZJH:ECYZ:GXPQ:XAL7 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:19 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:50 OomKillDisable:true NGoroutines:53 SystemTime:2021-08-13 20:21:54.680984807 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.25-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServer

Address:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6234726400 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.6 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05f951a3781f4f2c1911b05e61c160e9c30eaa8e Expected:05f951a3781f4f2c1911b05e61c160e9c30eaa8e} RuncCommit:{ID:12644e614e25b05da6fd08a38ffa0cfe1903fdec Expected:12644e614e25b05da6fd08a38ffa0cfe1903fdec} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=sec

comp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/local/lib/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Build with BuildKit Vendor:Docker Inc. Version:v0.5.1-docker] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:2.0.0-beta.1] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.8.0]] Warnings:<nil>}}

	I0813 13:21:54.775889    9787 out.go:177] * Using the docker driver based on existing profile

	I0813 13:21:54.775914    9787 start.go:278] selected driver: docker

	I0813 13:21:54.775919    9787 start.go:751] validating driver "docker" against &{Name:functional-20210813131926-8053 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.21.3 ClusterName:functional-20210813131926-8053 Namespace:default APIServerN

ame:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.21.3 ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false helm-tiller:false ingress:false ingress-dns:false istio:false istio-provisioner:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false] CustomAddon

Images:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0813 13:21:54.775984    9787 start.go:762] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}

	I0813 13:21:54.776188    9787 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I0813 13:21:54.961751    9787 info.go:263] docker info: {ID:43SM:MII3:NWBL:WJUG:JMKA:JL3W:EOOO:ZEGZ:7ZJH:ECYZ:GXPQ:XAL7 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:19 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:50 OomKillDisable:true NGoroutines:53 SystemTime:2021-08-13 20:21:54.893644183 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.25-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServer

Address:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6234726400 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.6 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05f951a3781f4f2c1911b05e61c160e9c30eaa8e Expected:05f951a3781f4f2c1911b05e61c160e9c30eaa8e} RuncCommit:{ID:12644e614e25b05da6fd08a38ffa0cfe1903fdec Expected:12644e614e25b05da6fd08a38ffa0cfe1903fdec} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=sec

comp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/local/lib/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Build with BuildKit Vendor:Docker Inc. Version:v0.5.1-docker] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:2.0.0-beta.1] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.8.0]] Warnings:<nil>}}

	I0813 13:21:54.964167    9787 start_flags.go:697] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0813 13:21:54.964195    9787 cni.go:93] Creating CNI manager for ""

	I0813 13:21:54.964201    9787 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I0813 13:21:54.964210    9787 start_flags.go:277] config:

	{Name:functional-20210813131926-8053 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.21.3 ClusterName:functional-20210813131926-8053 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Contain

erRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.21.3 ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false helm-tiller:false ingress:false ingress-dns:false istio:false istio-provisioner:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false] CustomAddonI

mages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0813 13:21:54.991369    9787 out.go:177] * Starting control plane node functional-20210813131926-8053 in cluster functional-20210813131926-8053

	I0813 13:21:54.991429    9787 cache.go:117] Beginning downloading kic base image for docker with docker

	I0813 13:21:55.059928    9787 out.go:177] * Pulling base image ...

	I0813 13:21:55.060060    9787 preload.go:131] Checking if preload exists for k8s version v1.21.3 and runtime docker

	I0813 13:21:55.060069    9787 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 in local docker daemon

	I0813 13:21:55.060163    9787 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.3-docker-overlay2-amd64.tar.lz4

	I0813 13:21:55.060181    9787 cache.go:56] Caching tarball of preloaded images

	I0813 13:21:55.060344    9787 preload.go:173] Found /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I0813 13:21:55.060355    9787 cache.go:59] Finished verifying existence of preloaded tar for  v1.21.3 on docker

	I0813 13:21:55.061830    9787 profile.go:148] Saving config to /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/functional-20210813131926-8053/config.json ...

	I0813 13:21:55.184646    9787 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 in local docker daemon, skipping pull

	I0813 13:21:55.184655    9787 cache.go:139] gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 exists in daemon, skipping load

	I0813 13:21:55.184665    9787 cache.go:205] Successfully downloaded all kic artifacts

	I0813 13:21:55.184720    9787 start.go:313] acquiring machines lock for functional-20210813131926-8053: {Name:mkc1b35540cb8690340beda05ed315b2f6e71bd5 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0813 13:21:55.184824    9787 start.go:317] acquired machines lock for "functional-20210813131926-8053" in 88.909µs

	I0813 13:21:55.184844    9787 start.go:93] Skipping create...Using existing machine configuration

	I0813 13:21:55.184850    9787 fix.go:55] fixHost starting: 

	I0813 13:21:55.185122    9787 cli_runner.go:115] Run: docker container inspect functional-20210813131926-8053 --format={{.State.Status}}

	I0813 13:21:55.302303    9787 fix.go:108] recreateIfNeeded on functional-20210813131926-8053: state=Running err=<nil>

	W0813 13:21:55.302324    9787 fix.go:134] unexpected machine state, will restart: <nil>

	I0813 13:21:55.329065    9787 out.go:177] * Updating the running docker "functional-20210813131926-8053" container ...

	I0813 13:21:55.329107    9787 machine.go:88] provisioning docker machine ...

	I0813 13:21:55.329153    9787 ubuntu.go:169] provisioning hostname "functional-20210813131926-8053"

	I0813 13:21:55.329300    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:55.448112    9787 main.go:130] libmachine: Using SSH client type: native

	I0813 13:21:55.448292    9787 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x13fa2e0] 0x13fa2a0 <nil>  [] 0s} 127.0.0.1 59731 <nil> <nil>}

	I0813 13:21:55.448311    9787 main.go:130] libmachine: About to run SSH command:

	sudo hostname functional-20210813131926-8053 && echo "functional-20210813131926-8053" | sudo tee /etc/hostname

	I0813 13:21:55.585147    9787 main.go:130] libmachine: SSH cmd err, output: <nil>: functional-20210813131926-8053

	I0813 13:21:55.585238    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:55.702492    9787 main.go:130] libmachine: Using SSH client type: native

	I0813 13:21:55.702674    9787 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x13fa2e0] 0x13fa2a0 <nil>  [] 0s} 127.0.0.1 59731 <nil> <nil>}

	I0813 13:21:55.702691    9787 main.go:130] libmachine: About to run SSH command:

			if ! grep -xq '.*\sfunctional-20210813131926-8053' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 functional-20210813131926-8053/g' /etc/hosts;

				else 

					echo '127.0.1.1 functional-20210813131926-8053' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0813 13:21:55.832252    9787 main.go:130] libmachine: SSH cmd err, output: <nil>: 

	I0813 13:21:55.832283    9787 ubuntu.go:175] set auth options {CertDir:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube CaCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/se

rver.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube}

	I0813 13:21:55.832316    9787 ubuntu.go:177] setting up certificates

	I0813 13:21:55.832332    9787 provision.go:83] configureAuth start

	I0813 13:21:55.832440    9787 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" functional-20210813131926-8053

	I0813 13:21:55.949496    9787 provision.go:138] copyHostCerts

	I0813 13:21:55.949586    9787 exec_runner.go:145] found /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.pem, removing ...

	I0813 13:21:55.949592    9787 exec_runner.go:190] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.pem

	I0813 13:21:55.949692    9787 exec_runner.go:152] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.pem (1082 bytes)

	I0813 13:21:55.949885    9787 exec_runner.go:145] found /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cert.pem, removing ...

	I0813 13:21:55.949892    9787 exec_runner.go:190] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cert.pem

	I0813 13:21:55.949956    9787 exec_runner.go:152] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cert.pem (1123 bytes)

	I0813 13:21:55.950102    9787 exec_runner.go:145] found /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/key.pem, removing ...

	I0813 13:21:55.950105    9787 exec_runner.go:190] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/key.pem

	I0813 13:21:55.950159    9787 exec_runner.go:152] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/key.pem (1675 bytes)

	I0813 13:21:55.950267    9787 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca-key.pem org=jenkins.functional-20210813131926-8053 san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube functional-20210813131926-8053]

	I0813 13:21:56.044777    9787 provision.go:172] copyRemoteCerts

	I0813 13:21:56.044832    9787 ssh_runner.go:149] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0813 13:21:56.044901    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:56.176574    9787 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:59731 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/functional-20210813131926-8053/id_rsa Username:docker}

	I0813 13:21:56.266936    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0813 13:21:56.285493    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server.pem --> /etc/docker/server.pem (1265 bytes)

	I0813 13:21:56.301792    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0813 13:21:56.318533    9787 provision.go:86] duration metric: configureAuth took 486.190467ms

	I0813 13:21:56.318541    9787 ubuntu.go:193] setting minikube options for container-runtime

	I0813 13:21:56.318718    9787 config.go:177] Loaded profile config "functional-20210813131926-8053": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.21.3

	I0813 13:21:56.318783    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:56.437674    9787 main.go:130] libmachine: Using SSH client type: native

	I0813 13:21:56.437827    9787 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x13fa2e0] 0x13fa2a0 <nil>  [] 0s} 127.0.0.1 59731 <nil> <nil>}

	I0813 13:21:56.437836    9787 main.go:130] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0813 13:21:56.563851    9787 main.go:130] libmachine: SSH cmd err, output: <nil>: overlay

	I0813 13:21:56.563864    9787 ubuntu.go:71] root file system type: overlay

	I0813 13:21:56.563998    9787 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I0813 13:21:56.564091    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:56.681639    9787 main.go:130] libmachine: Using SSH client type: native

	I0813 13:21:56.681807    9787 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x13fa2e0] 0x13fa2a0 <nil>  [] 0s} 127.0.0.1 59731 <nil> <nil>}

	I0813 13:21:56.681858    9787 main.go:130] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0813 13:21:56.819969    9787 main.go:130] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0813 13:21:56.820085    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:56.936161    9787 main.go:130] libmachine: Using SSH client type: native

	I0813 13:21:56.936301    9787 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x13fa2e0] 0x13fa2a0 <nil>  [] 0s} 127.0.0.1 59731 <nil> <nil>}

	I0813 13:21:56.936316    9787 main.go:130] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0813 13:21:57.070630    9787 main.go:130] libmachine: SSH cmd err, output: <nil>: 

	I0813 13:21:57.070642    9787 machine.go:91] provisioned docker machine in 1.741524027s

	I0813 13:21:57.070650    9787 start.go:267] post-start starting for "functional-20210813131926-8053" (driver="docker")

	I0813 13:21:57.070654    9787 start.go:277] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0813 13:21:57.070719    9787 ssh_runner.go:149] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0813 13:21:57.070786    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:57.185365    9787 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:59731 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/functional-20210813131926-8053/id_rsa Username:docker}

	I0813 13:21:57.278255    9787 ssh_runner.go:149] Run: cat /etc/os-release

	I0813 13:21:57.282084    9787 main.go:130] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found

	I0813 13:21:57.282094    9787 main.go:130] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found

	I0813 13:21:57.282099    9787 main.go:130] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found

	I0813 13:21:57.282104    9787 info.go:137] Remote host: Ubuntu 20.04.2 LTS

	I0813 13:21:57.282110    9787 filesync.go:126] Scanning /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/addons for local assets ...

	I0813 13:21:57.282205    9787 filesync.go:126] Scanning /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files for local assets ...

	I0813 13:21:57.282364    9787 filesync.go:149] local asset: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/80532.pem -> 80532.pem in /etc/ssl/certs

	I0813 13:21:57.282524    9787 filesync.go:149] local asset: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/test/nested/copy/8053/hosts -> hosts in /etc/test/nested/copy/8053

	I0813 13:21:57.282577    9787 ssh_runner.go:149] Run: sudo mkdir -p /etc/ssl/certs /etc/test/nested/copy/8053

	I0813 13:21:57.289648    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/80532.pem --> /etc/ssl/certs/80532.pem (1708 bytes)

	I0813 13:21:57.305812    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/test/nested/copy/8053/hosts --> /etc/test/nested/copy/8053/hosts (40 bytes)

	I0813 13:21:57.322252    9787 start.go:270] post-start completed in 251.592835ms

	I0813 13:21:57.322333    9787 ssh_runner.go:149] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0813 13:21:57.322390    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:57.441126    9787 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:59731 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/functional-20210813131926-8053/id_rsa Username:docker}

	I0813 13:21:57.530205    9787 fix.go:57] fixHost completed within 2.345344178s

	I0813 13:21:57.530220    9787 start.go:80] releasing machines lock for "functional-20210813131926-8053", held for 2.345384882s

	I0813 13:21:57.530368    9787 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" functional-20210813131926-8053

	I0813 13:21:57.649353    9787 ssh_runner.go:149] Run: curl -sS -m 2 https://k8s.gcr.io/

	I0813 13:21:57.649366    9787 ssh_runner.go:149] Run: systemctl --version

	I0813 13:21:57.649430    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:57.649444    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:57.779721    9787 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:59731 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/functional-20210813131926-8053/id_rsa Username:docker}

	I0813 13:21:57.779920    9787 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:59731 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/functional-20210813131926-8053/id_rsa Username:docker}

	I0813 13:21:57.870055    9787 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service containerd

	I0813 13:21:57.969894    9787 ssh_runner.go:149] Run: sudo systemctl cat docker.service

	I0813 13:21:57.979713    9787 cruntime.go:249] skipping containerd shutdown because we are bound to it

	I0813 13:21:57.979768    9787 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service crio

	I0813 13:21:57.989737    9787 ssh_runner.go:149] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/dockershim.sock

	image-endpoint: unix:///var/run/dockershim.sock

	" | sudo tee /etc/crictl.yaml"

	I0813 13:21:58.002260    9787 ssh_runner.go:149] Run: sudo systemctl unmask docker.service

	I0813 13:21:58.070268    9787 ssh_runner.go:149] Run: sudo systemctl enable docker.socket

	I0813 13:21:58.143885    9787 ssh_runner.go:149] Run: sudo systemctl cat docker.service

	I0813 13:21:58.153464    9787 ssh_runner.go:149] Run: sudo systemctl daemon-reload

	I0813 13:21:58.227112    9787 ssh_runner.go:149] Run: sudo systemctl start docker

	I0813 13:21:58.236571    9787 ssh_runner.go:149] Run: docker version --format {{.Server.Version}}

	I0813 13:21:58.275161    9787 ssh_runner.go:149] Run: docker version --format {{.Server.Version}}

	I0813 13:21:58.361792    9787 out.go:204] * Preparing Kubernetes v1.21.3 on Docker 20.10.8 ...

	I0813 13:21:58.361961    9787 cli_runner.go:115] Run: docker exec -t functional-20210813131926-8053 dig +short host.docker.internal

	I0813 13:21:58.547479    9787 network.go:69] got host ip for mount in container by digging dns: 192.168.65.2

	I0813 13:21:58.547597    9787 ssh_runner.go:149] Run: grep 192.168.65.2	host.minikube.internal$ /etc/hosts

	I0813 13:21:58.552110    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8441/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:58.698484    9787 out.go:177]   - apiserver.enable-admission-plugins=NamespaceAutoProvision

	I0813 13:21:58.698634    9787 preload.go:131] Checking if preload exists for k8s version v1.21.3 and runtime docker

	I0813 13:21:58.698805    9787 ssh_runner.go:149] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0813 13:21:58.729603    9787 docker.go:535] Got preloaded images: -- stdout --

	k8s.gcr.io/kube-apiserver:v1.21.3

	k8s.gcr.io/kube-scheduler:v1.21.3

	k8s.gcr.io/kube-proxy:v1.21.3

	k8s.gcr.io/kube-controller-manager:v1.21.3

	minikube-local-cache-test:functional-20210813131926-8053

	gcr.io/k8s-minikube/storage-provisioner:v5

	k8s.gcr.io/pause:3.4.1

	kubernetesui/dashboard:v2.1.0

	k8s.gcr.io/coredns/coredns:v1.8.0

	k8s.gcr.io/etcd:3.4.13-0

	k8s.gcr.io/pause:3.3

	kubernetesui/metrics-scraper:v1.0.4

	k8s.gcr.io/pause:3.1

	k8s.gcr.io/pause:latest

	-- /stdout --

	I0813 13:21:58.729614    9787 docker.go:466] Images already preloaded, skipping extraction

	I0813 13:21:58.729700    9787 ssh_runner.go:149] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0813 13:21:58.758863    9787 docker.go:535] Got preloaded images: -- stdout --

	k8s.gcr.io/kube-apiserver:v1.21.3

	k8s.gcr.io/kube-scheduler:v1.21.3

	k8s.gcr.io/kube-proxy:v1.21.3

	k8s.gcr.io/kube-controller-manager:v1.21.3

	minikube-local-cache-test:functional-20210813131926-8053

	gcr.io/k8s-minikube/storage-provisioner:v5

	k8s.gcr.io/pause:3.4.1

	kubernetesui/dashboard:v2.1.0

	k8s.gcr.io/coredns/coredns:v1.8.0

	k8s.gcr.io/etcd:3.4.13-0

	k8s.gcr.io/pause:3.3

	kubernetesui/metrics-scraper:v1.0.4

	k8s.gcr.io/pause:3.1

	k8s.gcr.io/pause:latest

	-- /stdout --

	I0813 13:21:58.758872    9787 cache_images.go:74] Images are preloaded, skipping loading

	I0813 13:21:58.758968    9787 ssh_runner.go:149] Run: docker info --format {{.CgroupDriver}}

	I0813 13:21:58.836165    9787 extraconfig.go:124] Overwriting default enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota with user provided enable-admission-plugins=NamespaceAutoProvision for component apiserver

	I0813 13:21:58.836186    9787 cni.go:93] Creating CNI manager for ""

	I0813 13:21:58.836195    9787 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I0813 13:21:58.836203    9787 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I0813 13:21:58.836216    9787 kubeadm.go:153] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8441 KubernetesVersion:v1.21.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:functional-20210813131926-8053 NodeName:functional-20210813131926-8053 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceAutoProvision] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}

	I0813 13:21:58.836321    9787 kubeadm.go:157] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.49.2

	  bindPort: 8441

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: /var/run/dockershim.sock

	  name: "functional-20210813131926-8053"

	  kubeletExtraArgs:

	    node-ip: 192.168.49.2

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceAutoProvision"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8441

	dns:

	  type: CoreDNS

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.21.3

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0813 13:21:58.836398    9787 kubeadm.go:909] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.21.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=functional-20210813131926-8053 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2

	[Install]

	 config:

	{KubernetesVersion:v1.21.3 ClusterName:functional-20210813131926-8053 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:}

	I0813 13:21:58.836468    9787 ssh_runner.go:149] Run: sudo ls /var/lib/minikube/binaries/v1.21.3

	I0813 13:21:58.843899    9787 binaries.go:44] Found k8s binaries, skipping transfer

	I0813 13:21:58.843961    9787 ssh_runner.go:149] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0813 13:21:58.850752    9787 ssh_runner.go:316] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (356 bytes)

	I0813 13:21:58.863434    9787 ssh_runner.go:316] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0813 13:21:58.875415    9787 ssh_runner.go:316] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (1923 bytes)

	I0813 13:21:58.887646    9787 ssh_runner.go:149] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts

	I0813 13:21:58.891653    9787 certs.go:52] Setting up /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/functional-20210813131926-8053 for IP: 192.168.49.2

	I0813 13:21:58.891733    9787 certs.go:179] skipping minikubeCA CA generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.key

	I0813 13:21:58.891764    9787 certs.go:179] skipping proxyClientCA CA generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.key

	I0813 13:21:58.891832    9787 certs.go:293] skipping minikube-user signed cert generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/functional-20210813131926-8053/client.key

	I0813 13:21:58.891864    9787 certs.go:293] skipping minikube signed cert generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/functional-20210813131926-8053/apiserver.key.dd3b5fb2

	I0813 13:21:58.891898    9787 certs.go:293] skipping aggregator signed cert generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/functional-20210813131926-8053/proxy-client.key

	I0813 13:21:58.892101    9787 certs.go:376] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/8053.pem (1338 bytes)

	W0813 13:21:58.892147    9787 certs.go:372] ignoring /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/8053_empty.pem, impossibly tiny 0 bytes

	I0813 13:21:58.892159    9787 certs.go:376] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca-key.pem (1675 bytes)

	I0813 13:21:58.892196    9787 certs.go:376] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem (1082 bytes)

	I0813 13:21:58.892231    9787 certs.go:376] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/cert.pem (1123 bytes)

	I0813 13:21:58.892268    9787 certs.go:376] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/key.pem (1675 bytes)

	I0813 13:21:58.892332    9787 certs.go:376] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/80532.pem (1708 bytes)

	I0813 13:21:58.893223    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/functional-20210813131926-8053/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I0813 13:21:58.909719    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/functional-20210813131926-8053/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0813 13:21:58.925905    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/functional-20210813131926-8053/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0813 13:21:58.942022    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/functional-20210813131926-8053/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0813 13:21:58.958623    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0813 13:21:58.975085    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I0813 13:21:58.991264    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0813 13:21:59.007328    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I0813 13:21:59.023488    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/8053.pem --> /usr/share/ca-certificates/8053.pem (1338 bytes)

	I0813 13:21:59.040270    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/80532.pem --> /usr/share/ca-certificates/80532.pem (1708 bytes)

	I0813 13:21:59.056327    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0813 13:21:59.072475    9787 ssh_runner.go:316] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0813 13:21:59.084536    9787 ssh_runner.go:149] Run: openssl version

	I0813 13:21:59.089935    9787 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/80532.pem && ln -fs /usr/share/ca-certificates/80532.pem /etc/ssl/certs/80532.pem"

	I0813 13:21:59.097684    9787 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/80532.pem

	I0813 13:21:59.101594    9787 certs.go:419] hashing: -rw-r--r-- 1 root root 1708 Aug 13 20:19 /usr/share/ca-certificates/80532.pem

	I0813 13:21:59.101643    9787 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/80532.pem

	I0813 13:21:59.107144    9787 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/80532.pem /etc/ssl/certs/3ec20f2e.0"

	I0813 13:21:59.114076    9787 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0813 13:21:59.121539    9787 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0813 13:21:59.125540    9787 certs.go:419] hashing: -rw-r--r-- 1 root root 1111 Aug 13 20:16 /usr/share/ca-certificates/minikubeCA.pem

	I0813 13:21:59.125584    9787 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0813 13:21:59.130700    9787 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0813 13:21:59.137797    9787 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/8053.pem && ln -fs /usr/share/ca-certificates/8053.pem /etc/ssl/certs/8053.pem"

	I0813 13:21:59.145736    9787 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/8053.pem

	I0813 13:21:59.149426    9787 certs.go:419] hashing: -rw-r--r-- 1 root root 1338 Aug 13 20:19 /usr/share/ca-certificates/8053.pem

	I0813 13:21:59.149475    9787 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/8053.pem

	I0813 13:21:59.154597    9787 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/8053.pem /etc/ssl/certs/51391683.0"

	I0813 13:21:59.161377    9787 kubeadm.go:390] StartCluster: {Name:functional-20210813131926-8053 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.21.3 ClusterName:functional-20210813131926-8053 Namespace:default APIServerName:minikubeCA APISe

rverNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.21.3 ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false helm-tiller:false ingress:false ingress-dns:false istio:false istio-provisioner:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-p

rovisioner-gluster:false volumesnapshots:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0813 13:21:59.161497    9787 ssh_runner.go:149] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0813 13:21:59.189545    9787 ssh_runner.go:149] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0813 13:21:59.198183    9787 kubeadm.go:401] found existing configuration files, will attempt cluster restart

	I0813 13:21:59.198193    9787 kubeadm.go:600] restartCluster start

	I0813 13:21:59.198243    9787 ssh_runner.go:149] Run: sudo test -d /data/minikube

	I0813 13:21:59.205178    9787 kubeadm.go:126] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1

	stdout:

	stderr:

	I0813 13:21:59.205256    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8441/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:59.324984    9787 kubeconfig.go:93] found "functional-20210813131926-8053" server: "https://127.0.0.1:59730"

	I0813 13:21:59.328207    9787 ssh_runner.go:149] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new

	I0813 13:21:59.336264    9787 kubeadm.go:568] needs reconfigure: configs differ:

	-- stdout --

	--- /var/tmp/minikube/kubeadm.yaml	2021-08-13 20:20:16.844537431 +0000

	+++ /var/tmp/minikube/kubeadm.yaml.new	2021-08-13 20:21:58.890702464 +0000

	@@ -22,7 +22,7 @@

	 apiServer:

	   certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]

	   extraArgs:

	-    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	+    enable-admission-plugins: "NamespaceAutoProvision"

	 controllerManager:

	   extraArgs:

	     allocate-node-cidrs: "true"

	-- /stdout --

	I0813 13:21:59.336273    9787 kubeadm.go:1032] stopping kube-system containers ...

	I0813 13:21:59.336353    9787 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0813 13:21:59.365803    9787 docker.go:367] Stopping containers: [c9cb7d5809d8 a775b806a61d cb9e8762e065 137cc83770ff d982e81551e9 0237d371d391 467412a75d20 52fbb2e72ccf 9d5404187c66 c4b0031b9346 60451e7f160d 474f32a18e0e 58a9c2f98763 2ec83ef7b889 d31f2fbd2084]

	I0813 13:21:59.365906    9787 ssh_runner.go:149] Run: docker stop c9cb7d5809d8 a775b806a61d cb9e8762e065 137cc83770ff d982e81551e9 0237d371d391 467412a75d20 52fbb2e72ccf 9d5404187c66 c4b0031b9346 60451e7f160d 474f32a18e0e 58a9c2f98763 2ec83ef7b889 d31f2fbd2084

	I0813 13:22:04.995080    9787 ssh_runner.go:189] Completed: docker stop c9cb7d5809d8 a775b806a61d cb9e8762e065 137cc83770ff d982e81551e9 0237d371d391 467412a75d20 52fbb2e72ccf 9d5404187c66 c4b0031b9346 60451e7f160d 474f32a18e0e 58a9c2f98763 2ec83ef7b889 d31f2fbd2084: (5.629129791s)

	I0813 13:22:04.995149    9787 ssh_runner.go:149] Run: sudo systemctl stop kubelet

	I0813 13:22:05.035150    9787 ssh_runner.go:149] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0813 13:22:05.043407    9787 kubeadm.go:154] found existing configuration files:

	-rw------- 1 root root 5639 Aug 13 20:20 /etc/kubernetes/admin.conf

	-rw------- 1 root root 5656 Aug 13 20:20 /etc/kubernetes/controller-manager.conf

	-rw------- 1 root root 2059 Aug 13 20:20 /etc/kubernetes/kubelet.conf

	-rw------- 1 root root 5604 Aug 13 20:20 /etc/kubernetes/scheduler.conf

	I0813 13:22:05.043464    9787 ssh_runner.go:149] Run: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/admin.conf

	I0813 13:22:05.051350    9787 ssh_runner.go:149] Run: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/kubelet.conf

	I0813 13:22:05.060114    9787 ssh_runner.go:149] Run: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/controller-manager.conf

	I0813 13:22:05.067525    9787 kubeadm.go:165] "https://control-plane.minikube.internal:8441" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/controller-manager.conf: Process exited with status 1

	stdout:

	stderr:

	I0813 13:22:05.067578    9787 ssh_runner.go:149] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I0813 13:22:05.075008    9787 ssh_runner.go:149] Run: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/scheduler.conf

	I0813 13:22:05.082906    9787 kubeadm.go:165] "https://control-plane.minikube.internal:8441" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/scheduler.conf: Process exited with status 1

	stdout:

	stderr:

	I0813 13:22:05.082967    9787 ssh_runner.go:149] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I0813 13:22:05.090012    9787 ssh_runner.go:149] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0813 13:22:05.098160    9787 kubeadm.go:676] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml

	I0813 13:22:05.098166    9787 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.3:$PATH kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"

	I0813 13:22:05.234978    9787 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.3:$PATH kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"

	I0813 13:22:06.121440    9787 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.3:$PATH kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"

	I0813 13:22:06.340305    9787 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.3:$PATH kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"

	I0813 13:22:06.503163    9787 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.3:$PATH kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"

	I0813 13:22:06.712462    9787 api_server.go:50] waiting for apiserver process to appear ...

	I0813 13:22:06.712527    9787 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 13:22:06.730332    9787 api_server.go:70] duration metric: took 17.874307ms to wait for apiserver process to appear ...

	I0813 13:22:06.730341    9787 api_server.go:86] waiting for apiserver healthz status ...

	I0813 13:22:06.730354    9787 api_server.go:239] Checking apiserver healthz at https://127.0.0.1:59730/healthz ...

	I0813 13:22:06.736407    9787 api_server.go:265] https://127.0.0.1:59730/healthz returned 200:

	ok

	I0813 13:22:06.743171    9787 api_server.go:139] control plane version: v1.21.3

	I0813 13:22:06.743179    9787 api_server.go:129] duration metric: took 12.83557ms to wait for apiserver health ...

	I0813 13:22:06.743183    9787 cni.go:93] Creating CNI manager for ""

	I0813 13:22:06.743191    9787 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I0813 13:22:06.743197    9787 system_pods.go:43] waiting for kube-system pods to appear ...

	I0813 13:22:06.753205    9787 system_pods.go:59] 7 kube-system pods found

	I0813 13:22:06.753216    9787 system_pods.go:61] "coredns-558bd4d5db-rhdvr" [5a622440-7ec5-4279-906a-dbb6df1293e4] Running

	I0813 13:22:06.753223    9787 system_pods.go:61] "etcd-functional-20210813131926-8053" [4f00bcab-aff3-43c8-acc0-58a4b8aabe25] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])

	I0813 13:22:06.753226    9787 system_pods.go:61] "kube-apiserver-functional-20210813131926-8053" [20ad3ec8-4b1e-4b0c-98d1-55d19db5ea62] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])

	I0813 13:22:06.753249    9787 system_pods.go:61] "kube-controller-manager-functional-20210813131926-8053" [dcbf1190-fbb7-47cc-8dc0-3e56e3c5edae] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])

	I0813 13:22:06.753254    9787 system_pods.go:61] "kube-proxy-kv9mv" [021b9666-4667-41cf-b041-7b8db53a4052] Running

	I0813 13:22:06.753257    9787 system_pods.go:61] "kube-scheduler-functional-20210813131926-8053" [afe411d1-6ad3-41a8-bb90-ff93ba88531c] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])

	I0813 13:22:06.753260    9787 system_pods.go:61] "storage-provisioner" [d75f1151-7edf-4dac-acd9-128a49223ff1] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])

	I0813 13:22:06.753263    9787 system_pods.go:74] duration metric: took 10.063476ms to wait for pod list to return data ...

	I0813 13:22:06.753267    9787 node_conditions.go:102] verifying NodePressure condition ...

	I0813 13:22:06.756805    9787 node_conditions.go:122] node storage ephemeral capacity is 123591232Ki

	I0813 13:22:06.756820    9787 node_conditions.go:123] node cpu capacity is 6

	I0813 13:22:06.756832    9787 node_conditions.go:105] duration metric: took 3.562026ms to run NodePressure ...

	I0813 13:22:06.756839    9787 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.3:$PATH kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"

	I0813 13:22:06.988642    9787 kubeadm.go:731] waiting for restarted kubelet to initialise ...

	I0813 13:22:06.992762    9787 kubeadm.go:746] kubelet initialised

	I0813 13:22:06.992768    9787 kubeadm.go:747] duration metric: took 4.11784ms waiting for restarted kubelet to initialise ...

	I0813 13:22:06.992772    9787 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0813 13:22:06.997055    9787 pod_ready.go:78] waiting up to 4m0s for pod "coredns-558bd4d5db-rhdvr" in "kube-system" namespace to be "Ready" ...

	I0813 13:22:07.004790    9787 pod_ready.go:92] pod "coredns-558bd4d5db-rhdvr" in "kube-system" namespace has status "Ready":"True"

	I0813 13:22:07.004795    9787 pod_ready.go:81] duration metric: took 7.730399ms waiting for pod "coredns-558bd4d5db-rhdvr" in "kube-system" namespace to be "Ready" ...

	I0813 13:22:07.004799    9787 pod_ready.go:78] waiting up to 4m0s for pod "etcd-functional-20210813131926-8053" in "kube-system" namespace to be "Ready" ...

	I0813 13:22:09.023880    9787 pod_ready.go:102] pod "etcd-functional-20210813131926-8053" in "kube-system" namespace has status "Ready":"False"

	I0813 13:22:11.523012    9787 pod_ready.go:97] node "functional-20210813131926-8053" hosting pod "etcd-functional-20210813131926-8053" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:11.523022    9787 pod_ready.go:81] duration metric: took 4.518205887s waiting for pod "etcd-functional-20210813131926-8053" in "kube-system" namespace to be "Ready" ...

	E0813 13:22:11.523028    9787 pod_ready.go:66] WaitExtra: waitPodCondition: node "functional-20210813131926-8053" hosting pod "etcd-functional-20210813131926-8053" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:11.523040    9787 pod_ready.go:78] waiting up to 4m0s for pod "kube-apiserver-functional-20210813131926-8053" in "kube-system" namespace to be "Ready" ...

	I0813 13:22:11.527525    9787 pod_ready.go:97] node "functional-20210813131926-8053" hosting pod "kube-apiserver-functional-20210813131926-8053" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:11.527531    9787 pod_ready.go:81] duration metric: took 4.486717ms waiting for pod "kube-apiserver-functional-20210813131926-8053" in "kube-system" namespace to be "Ready" ...

	E0813 13:22:11.527536    9787 pod_ready.go:66] WaitExtra: waitPodCondition: node "functional-20210813131926-8053" hosting pod "kube-apiserver-functional-20210813131926-8053" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:11.527544    9787 pod_ready.go:78] waiting up to 4m0s for pod "kube-controller-manager-functional-20210813131926-8053" in "kube-system" namespace to be "Ready" ...

	I0813 13:22:11.531857    9787 pod_ready.go:97] node "functional-20210813131926-8053" hosting pod "kube-controller-manager-functional-20210813131926-8053" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:11.531864    9787 pod_ready.go:81] duration metric: took 4.31653ms waiting for pod "kube-controller-manager-functional-20210813131926-8053" in "kube-system" namespace to be "Ready" ...

	E0813 13:22:11.531869    9787 pod_ready.go:66] WaitExtra: waitPodCondition: node "functional-20210813131926-8053" hosting pod "kube-controller-manager-functional-20210813131926-8053" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:11.531876    9787 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-kv9mv" in "kube-system" namespace to be "Ready" ...

	I0813 13:22:11.537017    9787 pod_ready.go:97] node "functional-20210813131926-8053" hosting pod "kube-proxy-kv9mv" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:11.537022    9787 pod_ready.go:81] duration metric: took 5.141983ms waiting for pod "kube-proxy-kv9mv" in "kube-system" namespace to be "Ready" ...

	E0813 13:22:11.537025    9787 pod_ready.go:66] WaitExtra: waitPodCondition: node "functional-20210813131926-8053" hosting pod "kube-proxy-kv9mv" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:11.537032    9787 pod_ready.go:78] waiting up to 4m0s for pod "kube-scheduler-functional-20210813131926-8053" in "kube-system" namespace to be "Ready" ...

	I0813 13:22:11.545827    9787 pod_ready.go:97] node "functional-20210813131926-8053" hosting pod "kube-scheduler-functional-20210813131926-8053" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:11.545836    9787 pod_ready.go:81] duration metric: took 8.799553ms waiting for pod "kube-scheduler-functional-20210813131926-8053" in "kube-system" namespace to be "Ready" ...

	E0813 13:22:11.545841    9787 pod_ready.go:66] WaitExtra: waitPodCondition: node "functional-20210813131926-8053" hosting pod "kube-scheduler-functional-20210813131926-8053" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:11.545851    9787 pod_ready.go:38] duration metric: took 4.553059995s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0813 13:22:11.545860    9787 ssh_runner.go:149] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0813 13:22:11.558301    9787 ops.go:34] apiserver oom_adj: -16

	I0813 13:22:11.558317    9787 kubeadm.go:604] restartCluster took 12.36008589s

	I0813 13:22:11.558321    9787 kubeadm.go:392] StartCluster complete in 12.39691792s

	I0813 13:22:11.558329    9787 settings.go:142] acquiring lock: {Name:mkea671a8cf1619d5bb0d33f936826680e87cf9b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 13:22:11.558414    9787 settings.go:150] Updating kubeconfig:  /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/kubeconfig

	I0813 13:22:11.558889    9787 lock.go:36] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/kubeconfig: {Name:mk2e9f304ce9a26dabf1dc11ded078755e07052d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 13:22:11.564907    9787 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "functional-20210813131926-8053" rescaled to 1

	I0813 13:22:11.564940    9787 ssh_runner.go:149] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.21.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0813 13:22:11.564936    9787 start.go:226] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.21.3 ControlPlane:true Worker:true}

	I0813 13:22:11.564966    9787 addons.go:342] enableAddons start: toEnable=map[ambassador:false auto-pause:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false helm-tiller:false ingress:false ingress-dns:false istio:false istio-provisioner:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false], additional=[]

	I0813 13:22:11.589685    9787 out.go:177] * Verifying Kubernetes components...

	I0813 13:22:11.565120    9787 config.go:177] Loaded profile config "functional-20210813131926-8053": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.21.3

	I0813 13:22:11.589733    9787 addons.go:59] Setting default-storageclass=true in profile "functional-20210813131926-8053"

	I0813 13:22:11.589735    9787 addons.go:59] Setting storage-provisioner=true in profile "functional-20210813131926-8053"

	I0813 13:22:11.589750    9787 addons.go:135] Setting addon storage-provisioner=true in "functional-20210813131926-8053"

	W0813 13:22:11.589756    9787 addons.go:147] addon storage-provisioner should already be in state true

	I0813 13:22:11.589756    9787 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "functional-20210813131926-8053"

	I0813 13:22:11.589762    9787 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service kubelet

	I0813 13:22:11.589779    9787 host.go:66] Checking if "functional-20210813131926-8053" exists ...

	I0813 13:22:11.590054    9787 cli_runner.go:115] Run: docker container inspect functional-20210813131926-8053 --format={{.State.Status}}

	I0813 13:22:11.591473    9787 cli_runner.go:115] Run: docker container inspect functional-20210813131926-8053 --format={{.State.Status}}

	I0813 13:22:11.640467    9787 start.go:708] CoreDNS already contains "host.minikube.internal" host record, skipping...

	I0813 13:22:11.640547    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8441/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:22:11.736998    9787 addons.go:135] Setting addon default-storageclass=true in "functional-20210813131926-8053"

	W0813 13:22:11.753928    9787 addons.go:147] addon default-storageclass should already be in state true

	I0813 13:22:11.753909    9787 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0813 13:22:11.753958    9787 host.go:66] Checking if "functional-20210813131926-8053" exists ...

	I0813 13:22:11.754030    9787 addons.go:275] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0813 13:22:11.754035    9787 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0813 13:22:11.754119    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:22:11.756650    9787 cli_runner.go:115] Run: docker container inspect functional-20210813131926-8053 --format={{.State.Status}}

	I0813 13:22:11.796607    9787 node_ready.go:35] waiting up to 6m0s for node "functional-20210813131926-8053" to be "Ready" ...

	I0813 13:22:11.883407    9787 addons.go:275] installing /etc/kubernetes/addons/storageclass.yaml

	I0813 13:22:11.883414    9787 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0813 13:22:11.883501    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:22:11.884664    9787 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:59731 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/functional-20210813131926-8053/id_rsa Username:docker}

	I0813 13:22:11.981485    9787 ssh_runner.go:149] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0813 13:22:12.002195    9787 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:59731 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/functional-20210813131926-8053/id_rsa Username:docker}

	I0813 13:22:12.100215    9787 ssh_runner.go:149] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0813 13:22:12.292911    9787 out.go:177] * Enabled addons: storage-provisioner, default-storageclass

	I0813 13:22:12.292941    9787 addons.go:344] enableAddons completed in 727.982788ms

	I0813 13:22:13.803981    9787 node_ready.go:58] node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:15.805967    9787 node_ready.go:58] node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:26.864663    9787 node_ready.go:53] error getting node "functional-20210813131926-8053": an error on the server ("") has prevented the request from succeeding (get nodes functional-20210813131926-8053)

	I0813 13:22:26.864673    9787 node_ready.go:38] duration metric: took 15.06800794s waiting for node "functional-20210813131926-8053" to be "Ready" ...

	* 

	* ==> Docker <==

	* -- Logs begin at Fri 2021-08-13 20:19:47 UTC, end at Fri 2021-08-13 20:22:47 UTC. --

	Aug 13 20:20:14 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:20:14.265005649Z" level=info msg="Docker daemon" commit=75249d8 graphdriver(s)=overlay2 version=20.10.8

	Aug 13 20:20:14 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:20:14.265058384Z" level=info msg="Daemon has completed initialization"

	Aug 13 20:20:14 functional-20210813131926-8053 systemd[1]: Started Docker Application Container Engine.

	Aug 13 20:20:14 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:20:14.286785231Z" level=info msg="API listen on [::]:2376"

	Aug 13 20:20:14 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:20:14.292066078Z" level=info msg="API listen on /var/run/docker.sock"

	Aug 13 20:21:21 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:21:21.026577302Z" level=info msg="ignoring event" container=a775b806a61d92ff81657fcff4dc7acb2f83254a5bbbce0fe21c2184fc85199b module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 13 20:21:59 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:21:59.502385955Z" level=info msg="ignoring event" container=467412a75d20411362b568cec86e4b4db02ab69bcb0b2b1691ea34123a6e75a3 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 13 20:21:59 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:21:59.585617856Z" level=info msg="ignoring event" container=d982e81551e90a29c763ebd97f5815ddb483dfa4a0886ffeaf978f6306c51697 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 13 20:21:59 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:21:59.585653524Z" level=info msg="ignoring event" container=d31f2fbd2084dbd1309738fa6e4bae273881af99746ff1dbfe82d39a19926255 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 13 20:21:59 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:21:59.588265473Z" level=info msg="ignoring event" container=0237d371d39158fc0d1392d53fbee09365c43b8377065997bfc4d71f36c10680 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 13 20:21:59 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:21:59.592422684Z" level=info msg="ignoring event" container=60451e7f160dd81c0eff9a4778313edd9c2746f058fdf64aa7f07823d2cfe571 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 13 20:21:59 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:21:59.600839720Z" level=info msg="ignoring event" container=cb9e8762e065a69236fdcadaa417404d054baa95f844cff5dde6b591482a2066 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 13 20:21:59 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:21:59.600883866Z" level=info msg="ignoring event" container=52fbb2e72ccff7078ee98d2e624285077b55ddeecff8b6299848e8f273221a42 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 13 20:21:59 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:21:59.602610629Z" level=info msg="ignoring event" container=474f32a18e0ee39876105a4ceb25958ad0b33f3b0454ad8a1b12ac49b3cd5eed module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 13 20:21:59 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:21:59.665982297Z" level=info msg="ignoring event" container=58a9c2f98763845c127f300b14fd7daf436248b1b5a86ded1833419c451891ac module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 13 20:21:59 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:21:59.669152577Z" level=info msg="ignoring event" container=2ec83ef7b889312fa65d180a496979d05511e27ddf8152e99b54451a2dfd71d3 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 13 20:21:59 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:21:59.669220943Z" level=info msg="ignoring event" container=9d5404187c668a3ea33922b1d068a52703bfa98906ff3ee9547fd6dfb6cc8b62 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 13 20:21:59 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:21:59.671212944Z" level=info msg="ignoring event" container=c9cb7d5809d857b21669fb017f684054b46646eae2e905765a28a3a95f921556 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 13 20:21:59 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:21:59.968130509Z" level=info msg="ignoring event" container=c4b0031b934617be49e5493937ea15caac6b895e01e8b3e36dd52978278b018b module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 13 20:22:04 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:22:04.991899112Z" level=info msg="ignoring event" container=137cc83770ffa35f37f9c930bd210eb3fb6844777a24c1e27560855eccab5da6 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 13 20:22:15 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:22:15.359418052Z" level=info msg="ignoring event" container=3e9e7c3beb60cae3aa3ad0de2629c617a379493c98eb2aec8f12de03e30f8898 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 13 20:22:16 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:22:16.578206835Z" level=info msg="ignoring event" container=83fc53fcb046e52a6a02b2f2de4613942e95c75ddada33df73d84d63c79d8e2c module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 13 20:22:46 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:22:46.616905951Z" level=info msg="Container 38f92da530a9b5620eb122c45ea3881ec54541e143273db89aa5f348f74e0e62 failed to exit within 30 seconds of signal 15 - using the force"

	Aug 13 20:22:46 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:22:46.693604598Z" level=info msg="ignoring event" container=38f92da530a9b5620eb122c45ea3881ec54541e143273db89aa5f348f74e0e62 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Aug 13 20:22:46 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:22:46.762481023Z" level=info msg="ignoring event" container=d66173141e7e00bf44b4bf409e9d8859c54e5e6d92d0f390f5fa506807eaa66e module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	* 

	* ==> container status <==

	* CONTAINER           IMAGE               CREATED              STATE               NAME                      ATTEMPT             POD ID

	6d69afd52f8c3       3d174f00aa39e       12 seconds ago       Running             kube-apiserver            2                   d69f527d156d3

	83fc53fcb046e       3d174f00aa39e       31 seconds ago       Exited              kube-apiserver            1                   d69f527d156d3

	b2296fd0d1e96       6e38f40d628db       32 seconds ago       Running             storage-provisioner       2                   5e308be60a59b

	fd440add28af1       296a6d5035e2d       32 seconds ago       Running             coredns                   1                   f50593e11ff51

	a4dbf0c14cf56       adb2816ea823a       47 seconds ago       Running             kube-proxy                1                   d1f104a42b8d8

	38f92da530a9b       3d174f00aa39e       47 seconds ago       Exited              kube-apiserver            1                   d66173141e7e0

	702cee73a40cb       6be0dc1302e30       47 seconds ago       Running             kube-scheduler            1                   07d2de00a97f8

	48d06bb7b7911       0369cf4303ffd       47 seconds ago       Running             etcd                      1                   d8b864d434486

	aca358fec1904       bc2bb319a7038       47 seconds ago       Running             kube-controller-manager   1                   bd0a7904b87eb

	c9cb7d5809d85       6e38f40d628db       About a minute ago   Exited              storage-provisioner       1                   cb9e8762e065a

	137cc83770ffa       296a6d5035e2d       About a minute ago   Exited              coredns                   0                   d982e81551e90

	0237d371d3915       adb2816ea823a       About a minute ago   Exited              kube-proxy                0                   467412a75d204

	52fbb2e72ccff       0369cf4303ffd       2 minutes ago        Exited              etcd                      0                   474f32a18e0ee

	9d5404187c668       6be0dc1302e30       2 minutes ago        Exited              kube-scheduler            0                   58a9c2f987638

	60451e7f160dd       bc2bb319a7038       2 minutes ago        Exited              kube-controller-manager   0                   2ec83ef7b8893

	* 

	* ==> coredns [137cc83770ff] <==

	* [INFO] plugin/ready: Still waiting on: "kubernetes"

	.:53

	[INFO] plugin/reload: Running configuration MD5 = db32ca3650231d74073ff4cf814959a7

	CoreDNS-1.8.0

	linux/amd64, go1.15.3, 054c9ae

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] Reloading

	[INFO] plugin/health: Going into lameduck mode for 5s

	[INFO] plugin/reload: Running configuration MD5 = c23ed519c17e71ee396ed052e6209e94

	[INFO] Reloading complete

	[INFO] SIGTERM: Shutting down servers then terminating

	[INFO] plugin/health: Going into lameduck mode for 5s

	I0813 20:21:20.439318       1 trace.go:205] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156 (13-Aug-2021 20:20:50.459) (total time: 30000ms):

	Trace[2019727887]: [30.000959061s] [30.000959061s] END

	E0813 20:21:20.439385       1 reflector.go:127] pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156: Failed to watch *v1.Endpoints: failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	I0813 20:21:20.439327       1 trace.go:205] Trace[1427131847]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156 (13-Aug-2021 20:20:50.459) (total time: 30000ms):

	Trace[1427131847]: [30.00091098s] [30.00091098s] END

	E0813 20:21:20.439411       1 reflector.go:127] pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	I0813 20:21:20.439589       1 trace.go:205] Trace[911902081]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156 (13-Aug-2021 20:20:50.459) (total time: 30001ms):

	Trace[911902081]: [30.001246144s] [30.001246144s] END

	E0813 20:21:20.439637       1 reflector.go:127] pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156: Failed to watch *v1.Namespace: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	* 

	* ==> coredns [fd440add28af] <==

	* .:53

	[INFO] plugin/reload: Running configuration MD5 = c23ed519c17e71ee396ed052e6209e94

	CoreDNS-1.8.0

	linux/amd64, go1.15.3, 054c9ae

	* 

	* ==> describe nodes <==

	* Name:               functional-20210813131926-8053

	Roles:              control-plane,master

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=functional-20210813131926-8053

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=852050cf77fe767e86d5a194bb91c06c4dc6c13c

	                    minikube.k8s.io/name=functional-20210813131926-8053

	                    minikube.k8s.io/updated_at=2021_08_13T13_20_35_0700

	                    minikube.k8s.io/version=v1.22.0

	                    node-role.kubernetes.io/control-plane=

	                    node-role.kubernetes.io/master=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /var/run/dockershim.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Fri, 13 Aug 2021 20:20:34 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  functional-20210813131926-8053

	  AcquireTime:     <unset>

	  RenewTime:       Fri, 13 Aug 2021 20:22:40 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Fri, 13 Aug 2021 20:22:41 +0000   Fri, 13 Aug 2021 20:20:34 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Fri, 13 Aug 2021 20:22:41 +0000   Fri, 13 Aug 2021 20:20:34 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Fri, 13 Aug 2021 20:22:41 +0000   Fri, 13 Aug 2021 20:20:34 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Fri, 13 Aug 2021 20:22:41 +0000   Fri, 13 Aug 2021 20:22:41 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.49.2

	  Hostname:    functional-20210813131926-8053

	Capacity:

	  cpu:                6

	  ephemeral-storage:  123591232Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  memory:             6088600Ki

	  pods:               110

	Allocatable:

	  cpu:                6

	  ephemeral-storage:  123591232Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  memory:             6088600Ki

	  pods:               110

	System Info:

	  Machine ID:                 dfc5def84a78402c9caa00a7cad25a86

	  System UUID:                c2a53005-c520-4b31-be6f-0d97f1736775

	  Boot ID:                    9c1335d8-2b93-45e8-96a7-e09bd9b095e5

	  Kernel Version:             5.10.25-linuxkit

	  OS Image:                   Ubuntu 20.04.2 LTS

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  docker://20.10.8

	  Kubelet Version:            v1.21.3

	  Kube-Proxy Version:         v1.21.3

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (7 in total)

	  Namespace                   Name                                                      CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                                      ------------  ----------  ---------------  -------------  ---

	  kube-system                 coredns-558bd4d5db-rhdvr                                  100m (1%!)(MISSING)     0 (0%!)(MISSING)      70Mi (1%!)(MISSING)        170Mi (2%!)(MISSING)     119s

	  kube-system                 etcd-functional-20210813131926-8053                       100m (1%!)(MISSING)     0 (0%!)(MISSING)      100Mi (1%!)(MISSING)       0 (0%!)(MISSING)         2m9s

	  kube-system                 kube-apiserver-functional-20210813131926-8053             250m (4%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         32s

	  kube-system                 kube-controller-manager-functional-20210813131926-8053    200m (3%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m9s

	  kube-system                 kube-proxy-kv9mv                                          0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m

	  kube-system                 kube-scheduler-functional-20210813131926-8053             100m (1%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m9s

	  kube-system                 storage-provisioner                                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         118s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (12%!)(MISSING)  0 (0%!)(MISSING)

	  memory             170Mi (2%!)(MISSING)  170Mi (2%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                    From        Message

	  ----    ------                   ----                   ----        -------

	  Normal  NodeHasNoDiskPressure    2m27s (x4 over 2m27s)  kubelet     Node functional-20210813131926-8053 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     2m27s (x4 over 2m27s)  kubelet     Node functional-20210813131926-8053 status is now: NodeHasSufficientPID

	  Normal  NodeHasSufficientMemory  2m26s (x5 over 2m27s)  kubelet     Node functional-20210813131926-8053 status is now: NodeHasSufficientMemory

	  Normal  Starting                 2m13s                  kubelet     Starting kubelet.

	  Normal  NodeHasSufficientMemory  2m12s                  kubelet     Node functional-20210813131926-8053 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    2m12s                  kubelet     Node functional-20210813131926-8053 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     2m12s                  kubelet     Node functional-20210813131926-8053 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  2m12s                  kubelet     Updated Node Allocatable limit across pods

	  Normal  NodeReady                2m2s                   kubelet     Node functional-20210813131926-8053 status is now: NodeReady

	  Normal  Starting                 116s                   kube-proxy  Starting kube-proxy.

	  Normal  Starting                 41s                    kube-proxy  Starting kube-proxy.

	  Normal  Starting                 38s                    kubelet     Starting kubelet.

	  Normal  NodeHasSufficientMemory  37s                    kubelet     Node functional-20210813131926-8053 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    37s                    kubelet     Node functional-20210813131926-8053 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     37s                    kubelet     Node functional-20210813131926-8053 status is now: NodeHasSufficientPID

	  Normal  NodeNotReady             37s                    kubelet     Node functional-20210813131926-8053 status is now: NodeNotReady

	  Normal  NodeAllocatableEnforced  37s                    kubelet     Updated Node Allocatable limit across pods

	  Normal  NodeReady                7s                     kubelet     Node functional-20210813131926-8053 status is now: NodeReady

	* 

	* ==> dmesg <==

	* [  +0.032687] bpfilter: read fail 0

	[  +0.038264] bpfilter: read fail 0

	[  +0.034951] bpfilter: read fail 0

	[  +0.031924] bpfilter: read fail 0

	[  +0.035935] bpfilter: write fail -32

	[  +0.036917] bpfilter: read fail 0

	[  +0.034016] bpfilter: read fail 0

	[  +0.033575] bpfilter: read fail 0

	[  +0.029274] bpfilter: write fail -32

	[  +0.036611] bpfilter: write fail -32

	[  +0.028468] bpfilter: write fail -32

	[  +0.037565] bpfilter: read fail 0

	[  +0.034696] bpfilter: read fail 0

	[  +0.039888] bpfilter: write fail -32

	[  +0.029652] bpfilter: write fail -32

	[  +0.028421] bpfilter: write fail -32

	[  +0.033022] bpfilter: read fail 0

	[  +0.026494] bpfilter: read fail 0

	[  +0.030954] bpfilter: write fail -32

	[  +0.031264] bpfilter: read fail 0

	[  +0.032808] bpfilter: read fail 0

	[  +0.023412] bpfilter: read fail 0

	[  +0.035794] bpfilter: write fail -32

	[  +0.030696] bpfilter: read fail 0

	[  +0.033418] bpfilter: read fail 0

	* 

	* ==> etcd [48d06bb7b791] <==

	* raft2021/08/13 20:22:00 INFO: newRaft aec36adc501070cc [peers: [], term: 2, commit: 544, applied: 0, lastindex: 544, lastterm: 2]

	2021-08-13 20:22:00.593422 W | auth: simple token is not cryptographically signed

	2021-08-13 20:22:00.599020 I | etcdserver: starting server... [version: 3.4.13, cluster version: to_be_decided]

	raft2021/08/13 20:22:00 INFO: aec36adc501070cc switched to configuration voters=(12593026477526642892)

	2021-08-13 20:22:00.600638 I | embed: ClientTLS: cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = 

	2021-08-13 20:22:00.600776 I | embed: listening for metrics on http://127.0.0.1:2381

	2021-08-13 20:22:00.600797 I | etcdserver/membership: added member aec36adc501070cc [https://192.168.49.2:2380] to cluster fa54960ea34d58be

	2021-08-13 20:22:00.600889 I | embed: listening for peers on 192.168.49.2:2380

	2021-08-13 20:22:00.601005 N | etcdserver/membership: set the initial cluster version to 3.4

	2021-08-13 20:22:00.601028 I | etcdserver/api: enabled capabilities for version 3.4

	2021-08-13 20:22:00.603763 W | etcdserver: failed to apply request "header:<ID:8128006947343604284 > lease_revoke:<id:70cc7b412c5299f3>" with response "size:29" took (453.17µs) to execute, err is lease not found

	raft2021/08/13 20:22:02 INFO: aec36adc501070cc is starting a new election at term 2

	raft2021/08/13 20:22:02 INFO: aec36adc501070cc became candidate at term 3

	raft2021/08/13 20:22:02 INFO: aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 3

	raft2021/08/13 20:22:02 INFO: aec36adc501070cc became leader at term 3

	raft2021/08/13 20:22:02 INFO: raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 3

	2021-08-13 20:22:02.393654 I | etcdserver: published {Name:functional-20210813131926-8053 ClientURLs:[https://192.168.49.2:2379]} to cluster fa54960ea34d58be

	2021-08-13 20:22:02.393806 I | embed: ready to serve client requests

	2021-08-13 20:22:02.394009 I | embed: ready to serve client requests

	2021-08-13 20:22:02.395515 I | embed: serving client requests on 192.168.49.2:2379

	2021-08-13 20:22:02.395556 I | embed: serving client requests on 127.0.0.1:2379

	2021-08-13 20:22:23.486642 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:22:25.625948 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:22:35.624433 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:22:45.625459 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	* 

	* ==> etcd [52fbb2e72ccf] <==

	* raft2021/08/13 20:20:29 INFO: aec36adc501070cc is starting a new election at term 1

	raft2021/08/13 20:20:29 INFO: aec36adc501070cc became candidate at term 2

	raft2021/08/13 20:20:29 INFO: aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2

	raft2021/08/13 20:20:29 INFO: aec36adc501070cc became leader at term 2

	raft2021/08/13 20:20:29 INFO: raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2

	2021-08-13 20:20:29.449928 I | etcdserver: published {Name:functional-20210813131926-8053 ClientURLs:[https://192.168.49.2:2379]} to cluster fa54960ea34d58be

	2021-08-13 20:20:29.449956 I | embed: ready to serve client requests

	2021-08-13 20:20:29.450201 I | embed: ready to serve client requests

	2021-08-13 20:20:29.451895 I | embed: serving client requests on 192.168.49.2:2379

	2021-08-13 20:20:29.452662 I | etcdserver: setting up the initial cluster version to 3.4

	2021-08-13 20:20:29.453525 N | etcdserver/membership: set the initial cluster version to 3.4

	2021-08-13 20:20:29.453720 I | etcdserver/api: enabled capabilities for version 3.4

	2021-08-13 20:20:29.453832 I | embed: serving client requests on 127.0.0.1:2379

	2021-08-13 20:20:40.277076 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:20:48.493155 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:20:50.276798 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:21:00.256457 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:21:10.255657 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:21:20.255420 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:21:30.234727 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:21:40.237560 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:21:50.233853 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:21:59.424601 N | pkg/osutil: received terminated signal, shutting down...

	WARNING: 2021/08/13 20:21:59 grpc: addrConn.createTransport failed to connect to {127.0.0.1:2379  <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...

	2021-08-13 20:21:59.469510 I | etcdserver: skipped leadership transfer for single voting member cluster

	* 

	* ==> kernel <==

	*  20:22:48 up 8 min,  0 users,  load average: 2.13, 1.49, 0.72

	Linux functional-20210813131926-8053 5.10.25-linuxkit #1 SMP Tue Mar 23 09:27:39 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux

	PRETTY_NAME="Ubuntu 20.04.2 LTS"

	* 

	* ==> kube-apiserver [38f92da530a9] <==

	* I0813 20:22:16.633525       1 apf_controller.go:303] Shutting down API Priority and Fairness config worker

	I0813 20:22:16.633531       1 customresource_discovery_controller.go:245] Shutting down DiscoveryController

	I0813 20:22:16.633534       1 crdregistration_controller.go:142] Shutting down crd-autoregister controller

	I0813 20:22:16.633541       1 cluster_authentication_trust_controller.go:463] Shutting down cluster_authentication_trust_controller controller

	I0813 20:22:16.633546       1 autoregister_controller.go:165] Shutting down autoregister controller

	I0813 20:22:16.633546       1 apiservice_controller.go:131] Shutting down APIServiceRegistrationController

	I0813 20:22:16.633549       1 available_controller.go:487] Shutting down AvailableConditionController

	I0813 20:22:16.633589       1 controller.go:123] Shutting down OpenAPI controller

	I0813 20:22:16.633593       1 naming_controller.go:302] Shutting down NamingConditionController

	I0813 20:22:16.633597       1 apiapproval_controller.go:198] Shutting down KubernetesAPIApprovalPolicyConformantConditionController

	I0813 20:22:16.633595       1 dynamic_cafile_content.go:182] Shutting down request-header::/var/lib/minikube/certs/front-proxy-ca.crt

	I0813 20:22:16.633600       1 nonstructuralschema_controller.go:204] Shutting down NonStructuralSchemaConditionController

	I0813 20:22:16.633603       1 establishing_controller.go:87] Shutting down EstablishingController

	I0813 20:22:16.633605       1 crd_finalizer.go:278] Shutting down CRDFinalizer

	I0813 20:22:16.633616       1 tlsconfig.go:255] Shutting down DynamicServingCertificateController

	I0813 20:22:16.633623       1 dynamic_cafile_content.go:182] Shutting down client-ca-bundle::/var/lib/minikube/certs/ca.crt

	I0813 20:22:16.633628       1 dynamic_cafile_content.go:182] Shutting down request-header::/var/lib/minikube/certs/front-proxy-ca.crt

	I0813 20:22:16.633684       1 dynamic_serving_content.go:145] Shutting down serving-cert::/var/lib/minikube/certs/apiserver.crt::/var/lib/minikube/certs/apiserver.key

	I0813 20:22:16.633693       1 dynamic_cafile_content.go:182] Shutting down client-ca-bundle::/var/lib/minikube/certs/ca.crt

	I0813 20:22:16.633704       1 dynamic_serving_content.go:145] Shutting down aggregator-proxy-cert::/var/lib/minikube/certs/front-proxy-client.crt::/var/lib/minikube/certs/front-proxy-client.key

	I0813 20:22:16.634110       1 secure_serving.go:241] Stopped listening on [::]:8441

	E0813 20:22:16.636853       1 controller.go:184] Get "https://localhost:8441/api/v1/namespaces/default/endpoints/kubernetes": dial tcp 127.0.0.1:8441: connect: connection refused

	I0813 20:22:45.006638       1 client.go:360] parsed scheme: "passthrough"

	I0813 20:22:45.006681       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I0813 20:22:45.006688       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	* 

	* ==> kube-apiserver [6d69afd52f8c] <==

	* I0813 20:22:38.318585       1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller

	I0813 20:22:38.318609       1 autoregister_controller.go:141] Starting autoregister controller

	I0813 20:22:38.318661       1 cache.go:32] Waiting for caches to sync for autoregister controller

	E0813 20:22:38.321680       1 controller.go:152] Unable to remove old endpoints from kubernetes service: StorageError: key not found, Code: 1, Key: /registry/masterleases/192.168.49.2, ResourceVersion: 0, AdditionalErrorMsg: 

	I0813 20:22:38.321857       1 crdregistration_controller.go:111] Starting crd-autoregister controller

	I0813 20:22:38.321914       1 shared_informer.go:240] Waiting for caches to sync for crd-autoregister

	I0813 20:22:38.332958       1 controller.go:86] Starting OpenAPI controller

	I0813 20:22:38.342152       1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController

	I0813 20:22:38.342183       1 naming_controller.go:291] Starting NamingConditionController

	I0813 20:22:38.342191       1 establishing_controller.go:76] Starting EstablishingController

	I0813 20:22:38.342170       1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController

	I0813 20:22:38.342176       1 crd_finalizer.go:266] Starting CRDFinalizer

	I0813 20:22:38.345261       1 controller.go:611] quota admission added evaluator for: endpoints

	I0813 20:22:38.416442       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller

	I0813 20:22:38.416576       1 shared_informer.go:247] Caches are synced for cluster_authentication_trust_controller 

	I0813 20:22:38.416715       1 apf_controller.go:299] Running API Priority and Fairness config worker

	I0813 20:22:38.416803       1 shared_informer.go:247] Caches are synced for node_authorizer 

	I0813 20:22:38.419529       1 cache.go:39] Caches are synced for autoregister controller

	I0813 20:22:38.419578       1 cache.go:39] Caches are synced for AvailableConditionController controller

	I0813 20:22:38.422193       1 shared_informer.go:247] Caches are synced for crd-autoregister 

	I0813 20:22:39.315114       1 controller.go:132] OpenAPI AggregationController: action for item : Nothing (removed from the queue).

	I0813 20:22:39.315170       1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).

	I0813 20:22:39.320787       1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.

	I0813 20:22:39.598302       1 controller.go:611] quota admission added evaluator for: endpointslices.discovery.k8s.io

	I0813 20:22:40.675450       1 controller.go:611] quota admission added evaluator for: leases.coordination.k8s.io

	* 

	* ==> kube-apiserver [83fc53fcb046] <==

	* Flag --insecure-port has been deprecated, This flag has no effect now and will be removed in v1.24.

	I0813 20:22:16.559861       1 server.go:629] external host was not specified, using 192.168.49.2

	I0813 20:22:16.560215       1 server.go:181] Version: v1.21.3

	Error: failed to create listener: failed to listen on 0.0.0.0:8441: listen tcp 0.0.0.0:8441: bind: address already in use

	* 

	* ==> kube-controller-manager [60451e7f160d] <==

	* I0813 20:20:48.273552       1 shared_informer.go:247] Caches are synced for job 

	I0813 20:20:48.282298       1 shared_informer.go:247] Caches are synced for deployment 

	I0813 20:20:48.293694       1 shared_informer.go:247] Caches are synced for endpoint 

	I0813 20:20:48.305431       1 shared_informer.go:247] Caches are synced for persistent volume 

	I0813 20:20:48.305477       1 shared_informer.go:247] Caches are synced for ReplicaSet 

	I0813 20:20:48.306702       1 shared_informer.go:247] Caches are synced for PVC protection 

	I0813 20:20:48.306734       1 shared_informer.go:247] Caches are synced for daemon sets 

	I0813 20:20:48.306739       1 shared_informer.go:247] Caches are synced for ReplicationController 

	I0813 20:20:48.354976       1 shared_informer.go:247] Caches are synced for taint 

	I0813 20:20:48.355035       1 node_lifecycle_controller.go:1398] Initializing eviction metric for zone: 

	W0813 20:20:48.355070       1 node_lifecycle_controller.go:1013] Missing timestamp for Node functional-20210813131926-8053. Assuming now as a timestamp.

	I0813 20:20:48.355090       1 node_lifecycle_controller.go:1214] Controller detected that zone  is now in state Normal.

	I0813 20:20:48.355287       1 taint_manager.go:187] "Starting NoExecuteTaintManager"

	I0813 20:20:48.355539       1 event.go:291] "Event occurred" object="functional-20210813131926-8053" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node functional-20210813131926-8053 event: Registered Node functional-20210813131926-8053 in Controller"

	I0813 20:20:48.363710       1 shared_informer.go:247] Caches are synced for resource quota 

	I0813 20:20:48.459455       1 shared_informer.go:247] Caches are synced for resource quota 

	I0813 20:20:48.813595       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-558bd4d5db to 2"

	I0813 20:20:48.865824       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-558bd4d5db to 1"

	I0813 20:20:48.867323       1 shared_informer.go:247] Caches are synced for garbage collector 

	I0813 20:20:48.867334       1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage

	I0813 20:20:48.878039       1 shared_informer.go:247] Caches are synced for garbage collector 

	I0813 20:20:48.914893       1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-kv9mv"

	I0813 20:20:49.013282       1 event.go:291] "Event occurred" object="kube-system/coredns-558bd4d5db" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-558bd4d5db-v2mbz"

	I0813 20:20:49.019258       1 event.go:291] "Event occurred" object="kube-system/coredns-558bd4d5db" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-558bd4d5db-rhdvr"

	I0813 20:20:49.030463       1 event.go:291] "Event occurred" object="kube-system/coredns-558bd4d5db" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-558bd4d5db-v2mbz"

	* 

	* ==> kube-controller-manager [aca358fec190] <==

	* I0813 20:22:39.355331       1 range_allocator.go:172] Starting range CIDR allocator

	I0813 20:22:39.355334       1 shared_informer.go:240] Waiting for caches to sync for cidrallocator

	I0813 20:22:39.355337       1 shared_informer.go:247] Caches are synced for cidrallocator 

	I0813 20:22:39.365263       1 shared_informer.go:247] Caches are synced for GC 

	I0813 20:22:39.381011       1 shared_informer.go:247] Caches are synced for persistent volume 

	I0813 20:22:39.382157       1 shared_informer.go:247] Caches are synced for endpoint_slice 

	I0813 20:22:39.385673       1 shared_informer.go:247] Caches are synced for daemon sets 

	I0813 20:22:39.385742       1 shared_informer.go:247] Caches are synced for TTL 

	I0813 20:22:39.392583       1 shared_informer.go:247] Caches are synced for disruption 

	I0813 20:22:39.392613       1 disruption.go:371] Sending events to api server.

	I0813 20:22:39.470556       1 shared_informer.go:247] Caches are synced for attach detach 

	I0813 20:22:39.502015       1 shared_informer.go:247] Caches are synced for resource quota 

	I0813 20:22:39.578946       1 shared_informer.go:247] Caches are synced for taint 

	I0813 20:22:39.579027       1 node_lifecycle_controller.go:1398] Initializing eviction metric for zone: 

	W0813 20:22:39.579072       1 node_lifecycle_controller.go:1013] Missing timestamp for Node functional-20210813131926-8053. Assuming now as a timestamp.

	I0813 20:22:39.579127       1 node_lifecycle_controller.go:1164] Controller detected that all Nodes are not-Ready. Entering master disruption mode.

	I0813 20:22:39.579329       1 taint_manager.go:187] "Starting NoExecuteTaintManager"

	I0813 20:22:39.579508       1 event.go:291] "Event occurred" object="functional-20210813131926-8053" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node functional-20210813131926-8053 event: Registered Node functional-20210813131926-8053 in Controller"

	I0813 20:22:39.585516       1 event.go:291] "Event occurred" object="kube-system/coredns-558bd4d5db-rhdvr" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"

	I0813 20:22:39.587057       1 event.go:291] "Event occurred" object="kube-system/kube-proxy-kv9mv" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"

	I0813 20:22:39.594768       1 shared_informer.go:247] Caches are synced for resource quota 

	I0813 20:22:39.960552       1 shared_informer.go:247] Caches are synced for garbage collector 

	I0813 20:22:39.960608       1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage

	I0813 20:22:40.005112       1 shared_informer.go:247] Caches are synced for garbage collector 

	I0813 20:22:44.579703       1 node_lifecycle_controller.go:1191] Controller detected that some Nodes are Ready. Exiting master disruption mode.

	* 

	* ==> kube-proxy [0237d371d391] <==

	* I0813 20:20:49.964466       1 node.go:172] Successfully retrieved node IP: 192.168.49.2

	I0813 20:20:49.964521       1 server_others.go:140] Detected node IP 192.168.49.2

	W0813 20:20:49.964567       1 server_others.go:598] Unknown proxy mode "", assuming iptables proxy

	I0813 20:20:52.244100       1 server_others.go:206] kube-proxy running in dual-stack mode, IPv4-primary

	I0813 20:20:52.244135       1 server_others.go:212] Using iptables Proxier.

	I0813 20:20:52.244143       1 server_others.go:219] creating dualStackProxier for iptables.

	W0813 20:20:52.244150       1 server_others.go:512] detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6

	I0813 20:20:52.244421       1 server.go:643] Version: v1.21.3

	I0813 20:20:52.244978       1 config.go:315] Starting service config controller

	I0813 20:20:52.245004       1 shared_informer.go:240] Waiting for caches to sync for service config

	I0813 20:20:52.245304       1 config.go:224] Starting endpoint slice config controller

	I0813 20:20:52.245329       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config

	W0813 20:20:52.248097       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	W0813 20:20:52.249674       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	I0813 20:20:52.345268       1 shared_informer.go:247] Caches are synced for service config 

	I0813 20:20:52.346418       1 shared_informer.go:247] Caches are synced for endpoint slice config 

	I0813 20:21:06.307240       1 trace.go:205] Trace[128053735]: "iptables restore" (13-Aug-2021 20:21:04.237) (total time: 2070ms):

	Trace[128053735]: [2.070087345s] [2.070087345s] END

	I0813 20:21:16.207178       1 trace.go:205] Trace[1148819465]: "iptables restore" (13-Aug-2021 20:21:14.011) (total time: 2195ms):

	Trace[1148819465]: [2.195338087s] [2.195338087s] END

	I0813 20:21:39.273178       1 trace.go:205] Trace[1324115582]: "iptables restore" (13-Aug-2021 20:21:36.931) (total time: 2341ms):

	Trace[1324115582]: [2.341227915s] [2.341227915s] END

	* 

	* ==> kube-proxy [a4dbf0c14cf5] <==

	* E0813 20:22:00.692301       1 node.go:161] Failed to retrieve node info: Get "https://control-plane.minikube.internal:8441/api/v1/nodes/functional-20210813131926-8053": dial tcp 192.168.49.2:8441: connect: connection refused

	I0813 20:22:04.764901       1 node.go:172] Successfully retrieved node IP: 192.168.49.2

	I0813 20:22:04.765017       1 server_others.go:140] Detected node IP 192.168.49.2

	W0813 20:22:04.765060       1 server_others.go:598] Unknown proxy mode "", assuming iptables proxy

	I0813 20:22:07.101758       1 server_others.go:206] kube-proxy running in dual-stack mode, IPv4-primary

	I0813 20:22:07.101850       1 server_others.go:212] Using iptables Proxier.

	I0813 20:22:07.101859       1 server_others.go:219] creating dualStackProxier for iptables.

	W0813 20:22:07.101866       1 server_others.go:512] detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6

	I0813 20:22:07.102184       1 server.go:643] Version: v1.21.3

	I0813 20:22:07.102649       1 config.go:224] Starting endpoint slice config controller

	I0813 20:22:07.102742       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config

	I0813 20:22:07.102831       1 config.go:315] Starting service config controller

	I0813 20:22:07.102858       1 shared_informer.go:240] Waiting for caches to sync for service config

	W0813 20:22:07.108215       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	W0813 20:22:07.108883       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	I0813 20:22:07.203497       1 shared_informer.go:247] Caches are synced for endpoint slice config 

	I0813 20:22:07.203527       1 shared_informer.go:247] Caches are synced for service config 

	W0813 20:22:46.682122       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	* 

	* ==> kube-scheduler [702cee73a40c] <==

	* I0813 20:22:01.509672       1 serving.go:347] Generated self-signed cert in-memory

	W0813 20:22:04.723419       1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'

	W0813 20:22:04.723453       1 authentication.go:337] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"

	W0813 20:22:04.723459       1 authentication.go:338] Continuing without authentication configuration. This may treat all requests as anonymous.

	W0813 20:22:04.723462       1 authentication.go:339] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false

	I0813 20:22:04.775715       1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0813 20:22:04.775753       1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0813 20:22:04.775897       1 secure_serving.go:197] Serving securely on 127.0.0.1:10259

	I0813 20:22:04.775954       1 tlsconfig.go:240] Starting DynamicServingCertificateController

	I0813 20:22:04.876958       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 

	* 

	* ==> kube-scheduler [9d5404187c66] <==

	* W0813 20:20:32.597185       1 authentication.go:337] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"

	W0813 20:20:32.597203       1 authentication.go:338] Continuing without authentication configuration. This may treat all requests as anonymous.

	W0813 20:20:32.597209       1 authentication.go:339] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false

	I0813 20:20:32.636201       1 secure_serving.go:197] Serving securely on 127.0.0.1:10259

	I0813 20:20:32.636276       1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0813 20:20:32.636280       1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0813 20:20:32.636287       1 tlsconfig.go:240] Starting DynamicServingCertificateController

	E0813 20:20:32.638772       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0813 20:20:32.639124       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0813 20:20:32.639163       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0813 20:20:32.639717       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0813 20:20:32.639970       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0813 20:20:32.639991       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0813 20:20:32.639972       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0813 20:20:32.640465       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.CSIStorageCapacity: failed to list *v1beta1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0813 20:20:32.640478       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E0813 20:20:32.641351       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0813 20:20:32.641376       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E0813 20:20:32.641817       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E0813 20:20:32.642227       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0813 20:20:32.643414       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0813 20:20:33.468213       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0813 20:20:33.582738       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0813 20:20:33.719031       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	I0813 20:20:33.936406       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 

	* 

	* ==> kubelet <==

	* -- Logs begin at Fri 2021-08-13 20:19:47 UTC, end at Fri 2021-08-13 20:22:49 UTC. --

	Aug 13 20:22:24 functional-20210813131926-8053 kubelet[6370]: I0813 20:22:24.592809    6370 status_manager.go:566] "Failed to get status for pod" podUID=9920347a8ff803b04ba09db0db41daaa pod="kube-system/kube-scheduler-functional-20210813131926-8053" error="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/kube-scheduler-functional-20210813131926-8053\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Aug 13 20:22:24 functional-20210813131926-8053 kubelet[6370]: I0813 20:22:24.593519    6370 status_manager.go:566] "Failed to get status for pod" podUID=a167fed55ab8e696561f106c712b5471 pod="kube-system/kube-controller-manager-functional-20210813131926-8053" error="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/kube-controller-manager-functional-20210813131926-8053\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Aug 13 20:22:24 functional-20210813131926-8053 kubelet[6370]: I0813 20:22:24.594022    6370 status_manager.go:566] "Failed to get status for pod" podUID=0e2a05e9d5f62a76b6deb0dd5ab4d463 pod="kube-system/etcd-functional-20210813131926-8053" error="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/etcd-functional-20210813131926-8053\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Aug 13 20:22:24 functional-20210813131926-8053 kubelet[6370]: I0813 20:22:24.594390    6370 status_manager.go:566] "Failed to get status for pod" podUID=d75f1151-7edf-4dac-acd9-128a49223ff1 pod="kube-system/storage-provisioner" error="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/storage-provisioner\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Aug 13 20:22:24 functional-20210813131926-8053 kubelet[6370]: I0813 20:22:24.594745    6370 status_manager.go:566] "Failed to get status for pod" podUID=5a622440-7ec5-4279-906a-dbb6df1293e4 pod="kube-system/coredns-558bd4d5db-rhdvr" error="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/coredns-558bd4d5db-rhdvr\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Aug 13 20:22:24 functional-20210813131926-8053 kubelet[6370]: I0813 20:22:24.594991    6370 status_manager.go:566] "Failed to get status for pod" podUID=99734e2c0a10537dcc22706974d552e2 pod="kube-system/kube-apiserver-functional-20210813131926-8053" error="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/kube-apiserver-functional-20210813131926-8053\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Aug 13 20:22:24 functional-20210813131926-8053 kubelet[6370]: I0813 20:22:24.726443    6370 status_manager.go:566] "Failed to get status for pod" podUID=a167fed55ab8e696561f106c712b5471 pod="kube-system/kube-controller-manager-functional-20210813131926-8053" error="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/kube-controller-manager-functional-20210813131926-8053\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Aug 13 20:22:27 functional-20210813131926-8053 kubelet[6370]: E0813 20:22:27.269636    6370 controller.go:144] failed to ensure lease exists, will retry in 6.4s, error: Get "https://control-plane.minikube.internal:8441/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/functional-20210813131926-8053?timeout=10s": dial tcp 192.168.49.2:8441: connect: connection refused

	Aug 13 20:22:27 functional-20210813131926-8053 kubelet[6370]: E0813 20:22:27.938014    6370 event.go:273] Unable to write event: '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kube-apiserver-functional-20210813131926-8053.169af74fa4ad3b05", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Pod", Namespace:"kube-system", Name:"kube-apiserver-functional-20210813131926-8053", UID:"99734e2c0a10537dcc22706974d552e2", APIVersion:"v1", ResourceVersion:"", FieldPath:"spec.containers{kube-apiserver}"}, Reason:"BackOff", Message:"B

ack-off restarting failed container", Source:v1.EventSource{Component:"kubelet", Host:"functional-20210813131926-8053"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc03dd2fe28d68b05, ext:10334646829, loc:(*time.Location)(0x74c3600)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc03dd2fe28d68b05, ext:10334646829, loc:(*time.Location)(0x74c3600)}}, Count:1, Type:"Warning", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'Post "https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/events": dial tcp 192.168.49.2:8441: connect: connection refused'(may retry after sleeping)

	Aug 13 20:22:31 functional-20210813131926-8053 kubelet[6370]: E0813 20:22:31.099159    6370 kubelet_node_status.go:470] "Error updating node status, will retry" err="error getting node \"functional-20210813131926-8053\": Get \"https://control-plane.minikube.internal:8441/api/v1/nodes/functional-20210813131926-8053?resourceVersion=0&timeout=10s\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Aug 13 20:22:31 functional-20210813131926-8053 kubelet[6370]: E0813 20:22:31.099566    6370 kubelet_node_status.go:470] "Error updating node status, will retry" err="error getting node \"functional-20210813131926-8053\": Get \"https://control-plane.minikube.internal:8441/api/v1/nodes/functional-20210813131926-8053?timeout=10s\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Aug 13 20:22:31 functional-20210813131926-8053 kubelet[6370]: E0813 20:22:31.099850    6370 kubelet_node_status.go:470] "Error updating node status, will retry" err="error getting node \"functional-20210813131926-8053\": Get \"https://control-plane.minikube.internal:8441/api/v1/nodes/functional-20210813131926-8053?timeout=10s\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Aug 13 20:22:31 functional-20210813131926-8053 kubelet[6370]: E0813 20:22:31.100137    6370 kubelet_node_status.go:470] "Error updating node status, will retry" err="error getting node \"functional-20210813131926-8053\": Get \"https://control-plane.minikube.internal:8441/api/v1/nodes/functional-20210813131926-8053?timeout=10s\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Aug 13 20:22:31 functional-20210813131926-8053 kubelet[6370]: E0813 20:22:31.100310    6370 kubelet_node_status.go:470] "Error updating node status, will retry" err="error getting node \"functional-20210813131926-8053\": Get \"https://control-plane.minikube.internal:8441/api/v1/nodes/functional-20210813131926-8053?timeout=10s\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Aug 13 20:22:31 functional-20210813131926-8053 kubelet[6370]: E0813 20:22:31.100355    6370 kubelet_node_status.go:457] "Unable to update node status" err="update node status exceeds retry count"

	Aug 13 20:22:33 functional-20210813131926-8053 kubelet[6370]: E0813 20:22:33.671273    6370 controller.go:144] failed to ensure lease exists, will retry in 7s, error: Get "https://control-plane.minikube.internal:8441/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/functional-20210813131926-8053?timeout=10s": dial tcp 192.168.49.2:8441: connect: connection refused

	Aug 13 20:22:34 functional-20210813131926-8053 kubelet[6370]: I0813 20:22:34.593321    6370 status_manager.go:566] "Failed to get status for pod" podUID=a167fed55ab8e696561f106c712b5471 pod="kube-system/kube-controller-manager-functional-20210813131926-8053" error="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/kube-controller-manager-functional-20210813131926-8053\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Aug 13 20:22:34 functional-20210813131926-8053 kubelet[6370]: I0813 20:22:34.593738    6370 status_manager.go:566] "Failed to get status for pod" podUID=0e2a05e9d5f62a76b6deb0dd5ab4d463 pod="kube-system/etcd-functional-20210813131926-8053" error="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/etcd-functional-20210813131926-8053\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Aug 13 20:22:34 functional-20210813131926-8053 kubelet[6370]: I0813 20:22:34.594143    6370 status_manager.go:566] "Failed to get status for pod" podUID=d75f1151-7edf-4dac-acd9-128a49223ff1 pod="kube-system/storage-provisioner" error="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/storage-provisioner\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Aug 13 20:22:34 functional-20210813131926-8053 kubelet[6370]: I0813 20:22:34.594538    6370 status_manager.go:566] "Failed to get status for pod" podUID=5a622440-7ec5-4279-906a-dbb6df1293e4 pod="kube-system/coredns-558bd4d5db-rhdvr" error="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/coredns-558bd4d5db-rhdvr\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Aug 13 20:22:34 functional-20210813131926-8053 kubelet[6370]: I0813 20:22:34.594971    6370 status_manager.go:566] "Failed to get status for pod" podUID=99734e2c0a10537dcc22706974d552e2 pod="kube-system/kube-apiserver-functional-20210813131926-8053" error="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/kube-apiserver-functional-20210813131926-8053\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Aug 13 20:22:34 functional-20210813131926-8053 kubelet[6370]: I0813 20:22:34.595333    6370 status_manager.go:566] "Failed to get status for pod" podUID=9920347a8ff803b04ba09db0db41daaa pod="kube-system/kube-scheduler-functional-20210813131926-8053" error="Get \"https://control-plane.minikube.internal:8441/api/v1/namespaces/kube-system/pods/kube-scheduler-functional-20210813131926-8053\": dial tcp 192.168.49.2:8441: connect: connection refused"

	Aug 13 20:22:35 functional-20210813131926-8053 kubelet[6370]: I0813 20:22:35.593232    6370 scope.go:111] "RemoveContainer" containerID="83fc53fcb046e52a6a02b2f2de4613942e95c75ddada33df73d84d63c79d8e2c"

	Aug 13 20:22:46 functional-20210813131926-8053 kubelet[6370]: I0813 20:22:46.860217    6370 pod_container_deletor.go:79] "Container not found in pod's containers" containerID="d66173141e7e00bf44b4bf409e9d8859c54e5e6d92d0f390f5fa506807eaa66e"

	Aug 13 20:22:46 functional-20210813131926-8053 kubelet[6370]: I0813 20:22:46.860257    6370 scope.go:111] "RemoveContainer" containerID="c4b0031b934617be49e5493937ea15caac6b895e01e8b3e36dd52978278b018b"

	* 

	* ==> storage-provisioner [b2296fd0d1e9] <==

	* I0813 20:22:16.010598       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0813 20:22:16.019564       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0813 20:22:16.019654       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	E0813 20:22:19.475117       1 leaderelection.go:325] error retrieving resource lock kube-system/k8s.io-minikube-hostpath: Get "https://10.96.0.1:443/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath": dial tcp 10.96.0.1:443: connect: connection refused

	E0813 20:22:23.712008       1 leaderelection.go:325] error retrieving resource lock kube-system/k8s.io-minikube-hostpath: Get "https://10.96.0.1:443/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath": dial tcp 10.96.0.1:443: connect: connection refused

	E0813 20:22:27.307605       1 leaderelection.go:325] error retrieving resource lock kube-system/k8s.io-minikube-hostpath: Get "https://10.96.0.1:443/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath": dial tcp 10.96.0.1:443: connect: connection refused

	E0813 20:22:30.359555       1 leaderelection.go:325] error retrieving resource lock kube-system/k8s.io-minikube-hostpath: Get "https://10.96.0.1:443/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath": dial tcp 10.96.0.1:443: connect: connection refused

	E0813 20:22:33.380137       1 leaderelection.go:325] error retrieving resource lock kube-system/k8s.io-minikube-hostpath: Get "https://10.96.0.1:443/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath": dial tcp 10.96.0.1:443: connect: connection refused

	I0813 20:22:38.347369       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0813 20:22:38.347493       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_functional-20210813131926-8053_281ee2df-bf55-432e-9ac9-afb821b0ef0f!

	I0813 20:22:38.347810       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"f3924885-42ee-4404-b92b-18e2b80efef1", APIVersion:"v1", ResourceVersion:"551", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' functional-20210813131926-8053_281ee2df-bf55-432e-9ac9-afb821b0ef0f became leader

	I0813 20:22:38.448501       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_functional-20210813131926-8053_281ee2df-bf55-432e-9ac9-afb821b0ef0f!

	* 

	* ==> storage-provisioner [c9cb7d5809d8] <==

	* I0813 20:21:21.763366       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0813 20:21:21.770235       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0813 20:21:21.770261       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I0813 20:21:21.783492       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0813 20:21:21.783642       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_functional-20210813131926-8053_89caf2fd-c393-4aa5-aa11-ee255d4b4c7a!

	I0813 20:21:21.783642       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"f3924885-42ee-4404-b92b-18e2b80efef1", APIVersion:"v1", ResourceVersion:"479", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' functional-20210813131926-8053_89caf2fd-c393-4aa5-aa11-ee255d4b4c7a became leader

	I0813 20:21:21.885038       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_functional-20210813131926-8053_89caf2fd-c393-4aa5-aa11-ee255d4b4c7a!

-- /stdout --

helpers_test.go:255: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.APIServer}} -p functional-20210813131926-8053 -n functional-20210813131926-8053

helpers_test.go:262: (dbg) Run:  kubectl --context functional-20210813131926-8053 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:271: non-running pods: 

helpers_test.go:273: ======> post-mortem[TestFunctional/serial/ComponentHealth]: describe non-running pods <======

helpers_test.go:276: (dbg) Run:  kubectl --context functional-20210813131926-8053 describe pod 

helpers_test.go:276: (dbg) Non-zero exit: kubectl --context functional-20210813131926-8053 describe pod : exit status 1 (42.42386ms)

** stderr ** 

	error: resource name may not be empty

** /stderr **

helpers_test.go:278: kubectl --context functional-20210813131926-8053 describe pod : exit status 1

--- FAIL: TestFunctional/serial/ComponentHealth (4.97s)

=== RUN   TestFunctional/parallel/PersistentVolumeClaim

=== PAUSE TestFunctional/parallel/PersistentVolumeClaim

=== CONT  TestFunctional/parallel/PersistentVolumeClaim

functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 4m0s for pods matching "integration-test=storage-provisioner" in namespace "kube-system" ...

helpers_test.go:343: "storage-provisioner" [d75f1151-7edf-4dac-acd9-128a49223ff1] Running

functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: integration-test=storage-provisioner healthy within 5.00798405s

functional_test_pvc_test.go:49: (dbg) Run:  kubectl --context functional-20210813131926-8053 get storageclass -o=json

functional_test_pvc_test.go:69: (dbg) Run:  kubectl --context functional-20210813131926-8053 apply -f testdata/storage-provisioner/pvc.yaml

functional_test_pvc_test.go:76: (dbg) Run:  kubectl --context functional-20210813131926-8053 get pvc myclaim -o=json

functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-20210813131926-8053 apply -f testdata/storage-provisioner/pod.yaml

functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...

helpers_test.go:343: "sp-pod" [f8a642d9-155f-43e2-a275-0270f2d99291] Pending

helpers_test.go:343: "sp-pod" [f8a642d9-155f-43e2-a275-0270f2d99291] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])

functional_test_pvc_test.go:130: ***** TestFunctional/parallel/PersistentVolumeClaim: pod "test=storage-provisioner" failed to start within 3m0s: timed out waiting for the condition ****

functional_test_pvc_test.go:130: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.APIServer}} -p functional-20210813131926-8053 -n functional-20210813131926-8053

functional_test_pvc_test.go:130: TestFunctional/parallel/PersistentVolumeClaim: showing logs for failed pods as of 2021-08-13 13:32:44.458201 -0700 PDT m=+1088.291394277

functional_test_pvc_test.go:130: (dbg) Run:  kubectl --context functional-20210813131926-8053 describe po sp-pod -n default

functional_test_pvc_test.go:130: (dbg) Done: kubectl --context functional-20210813131926-8053 describe po sp-pod -n default: (2.316849472s)

functional_test_pvc_test.go:130: (dbg) kubectl --context functional-20210813131926-8053 describe po sp-pod -n default:

Name:         sp-pod

Namespace:    default

Priority:     0

Node:         functional-20210813131926-8053/192.168.49.2

Start Time:   Fri, 13 Aug 2021 13:29:43 -0700

Labels:       test=storage-provisioner

Annotations:  <none>

Status:       Pending

IP:           172.17.0.5

IPs:

IP:  172.17.0.5

Containers:

myfrontend:

Container ID:   

Image:          nginx

Image ID:       

Port:           <none>

Host Port:      <none>

State:          Waiting

Reason:       ImagePullBackOff

Ready:          False

Restart Count:  0

Environment:    <none>

Mounts:

/tmp/mount from mypd (rw)

/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-plv7j (ro)

Conditions:

Type              Status

Initialized       True 

Ready             False 

ContainersReady   False 

PodScheduled      True 

Volumes:

mypd:

Type:       PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)

ClaimName:  myclaim

ReadOnly:   false

kube-api-access-plv7j:

Type:                    Projected (a volume that contains injected data from multiple sources)

TokenExpirationSeconds:  3607

ConfigMapName:           kube-root-ca.crt

ConfigMapOptional:       <nil>

DownwardAPI:             true

QoS Class:                   BestEffort

Node-Selectors:              <none>

Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

Events:

Type     Reason     Age                 From               Message

----     ------     ----                ----               -------

Normal   Scheduled  3m2s                default-scheduler  Successfully assigned default/sp-pod to functional-20210813131926-8053

Normal   Pulling    91s (x4 over 3m2s)  kubelet            Pulling image "nginx"

Warning  Failed     90s (x4 over 3m1s)  kubelet            Failed to pull image "nginx": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit

Warning  Failed     90s (x4 over 3m1s)  kubelet            Error: ErrImagePull

Warning  Failed     76s (x6 over 3m)    kubelet            Error: ImagePullBackOff

Normal   BackOff    61s (x7 over 3m)    kubelet            Back-off pulling image "nginx"

functional_test_pvc_test.go:130: (dbg) Run:  kubectl --context functional-20210813131926-8053 logs sp-pod -n default

functional_test_pvc_test.go:130: (dbg) Non-zero exit: kubectl --context functional-20210813131926-8053 logs sp-pod -n default: exit status 1 (69.979434ms)

** stderr ** 

	Error from server (BadRequest): container "myfrontend" in pod "sp-pod" is waiting to start: trying and failing to pull image

** /stderr **

functional_test_pvc_test.go:130: kubectl --context functional-20210813131926-8053 logs sp-pod -n default: exit status 1

functional_test_pvc_test.go:131: failed waiting for pod: test=storage-provisioner within 3m0s: timed out waiting for the condition

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:231: ======>  post-mortem[TestFunctional/parallel/PersistentVolumeClaim]: docker inspect <======

helpers_test.go:232: (dbg) Run:  docker inspect functional-20210813131926-8053

helpers_test.go:236: (dbg) docker inspect functional-20210813131926-8053:

-- stdout --

	[

	    {

	        "Id": "bd6d952ddeb5f310f9e68d0a941d3ceea9f8bcc59b82fe82663073652312e7bf",

	        "Created": "2021-08-13T20:19:33.443339625Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

	        ],

	        "State": {

	            "Status": "running",

	            "Running": true,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 19884,

	            "ExitCode": 0,

	            "Error": "",

	            "StartedAt": "2021-08-13T20:19:45.440445983Z",

	            "FinishedAt": "0001-01-01T00:00:00Z"

	        },

	        "Image": "sha256:965ebc74cb435c5d73c204fcd638e9daa526ad4ce3ec7f76be1149f30a789fab",

	        "ResolvConfPath": "/var/lib/docker/containers/bd6d952ddeb5f310f9e68d0a941d3ceea9f8bcc59b82fe82663073652312e7bf/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/bd6d952ddeb5f310f9e68d0a941d3ceea9f8bcc59b82fe82663073652312e7bf/hostname",

	        "HostsPath": "/var/lib/docker/containers/bd6d952ddeb5f310f9e68d0a941d3ceea9f8bcc59b82fe82663073652312e7bf/hosts",

	        "LogPath": "/var/lib/docker/containers/bd6d952ddeb5f310f9e68d0a941d3ceea9f8bcc59b82fe82663073652312e7bf/bd6d952ddeb5f310f9e68d0a941d3ceea9f8bcc59b82fe82663073652312e7bf-json.log",

	        "Name": "/functional-20210813131926-8053",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "/lib/modules:/lib/modules:ro",

	                "functional-20210813131926-8053:/var"

	            ],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

	            },

	            "NetworkMode": "functional-20210813131926-8053",

	            "PortBindings": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "8441/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ]

	            },

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

	            },

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "CapAdd": null,

	            "CapDrop": null,

	            "CgroupnsMode": "host",

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

	            ],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

	            },

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "ConsoleSize": [

	                0,

	                0

	            ],

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 4194304000,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": null,

	            "BlkioDeviceWriteBps": null,

	            "BlkioDeviceReadIOps": null,

	            "BlkioDeviceWriteIOps": null,

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "KernelMemory": 0,

	            "KernelMemoryTCP": 0,

	            "MemoryReservation": 0,

	            "MemorySwap": 4194304000,

	            "MemorySwappiness": null,

	            "OomKillDisable": false,

	            "PidsLimit": null,

	            "Ulimits": null,

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

	        },

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/3e4f101879c21cc86d3a345e84686ecfb0097ad0ef90e43949ac1917b277a31e-init/diff:/var/lib/docker/overlay2/b54d50d9722d23fb9637685b11892fb665fc20ba78ef431e07ed0ddfa868f7a1/diff:/var/lib/docker/overlay2/1ae49b54a8b23aaf60a7e9c9307ca333358576bae3a785f52751cdad083df982/diff:/var/lib/docker/overlay2/ea6c3052036e679f2d58c32269d4ea3143a3fc6f94abfc4e49173b050ea86a8b/diff:/var/lib/docker/overlay2/2a2dd58c96ee8d28d6328f3dc040dba105ab05a3a180db9efc72ab81c4f2dea8/diff:/var/lib/docker/overlay2/9b983e97e9a66172cc09d2798bfaa346d9fd6426e616339301e3bb8123e0e4f8/diff:/var/lib/docker/overlay2/dfeb06e54a5cea59763125a281a2a6800cd59c816b67601654af91996c53b0e9/diff:/var/lib/docker/overlay2/c9d50722d4822ee84b54a4086271aaa76449764ccee5cd9b3107efe20362db77/diff:/var/lib/docker/overlay2/7146eb1978a4f01c8661964f9a7e8e6900a73759e6d7f926784135a8c3675a0e/diff:/var/lib/docker/overlay2/6bcc532777a8b16bf0a8d49f5eba5dce2dad7acf9dd5d76a36fe91e4865df73c/diff:/var/lib/docker/overlay2/14de3b

84777e6d4bcd5b959be54fc67048ed8595b21548c2cb72c44e5bab5411/diff:/var/lib/docker/overlay2/f1ddefd3cddc8a76bb8102eba187352b3597d4a313ab8481788107dc17bb30be/diff:/var/lib/docker/overlay2/2be5ff1c0f18fc355d3d429c9a258aa1be9e5ebd0dd9b444f05aace4cc7acfea/diff:/var/lib/docker/overlay2/d1937ecc380ba5be5a64d9961a07aa0fa09d55136209e276d6ab5a08a2a5ce3c/diff:/var/lib/docker/overlay2/4b9bb8d1431c5ac321918e64797c008658b5e0db3587b9e7f484d00192b5a4be/diff:/var/lib/docker/overlay2/f9e7584420f2143a3affbe57ddd381ed9799067270b57d06e1af337987563637/diff:/var/lib/docker/overlay2/1ae74edd645de1296fe2ff40ac0d7659d56c4af7676d1e2b7077666f5cb598c4/diff:/var/lib/docker/overlay2/33df86dfa679c1be13df61855de34c224815a39320b3ee12131540df41ef4561/diff:/var/lib/docker/overlay2/eb8b1800e30954e5cf6fc67fbfa89db41d615ee50103aa0589446907b8c7ac49/diff:/var/lib/docker/overlay2/5c052f8924308a6f0fe3ae4941882e4b909ed1aeb01123b9e2faa7df2696de93/diff:/var/lib/docker/overlay2/69b433d87c6a506c3d510619bb41e8737b7e3d06bac5eb128be3e00efb740b98/diff:/var/lib/d

ocker/overlay2/c07998bd533865848849c722ed55cfa571f9562726f3fdb9bfd15f7b5936a8e6/diff:/var/lib/docker/overlay2/3df1a883fd0d44918646d29788faa76a5e7aaaf4b46a6ea2240c9d4b8bd4dc09/diff:/var/lib/docker/overlay2/9f2a07552f95e43119898b9bbe1e61d165ecd9eb3e862730a04a643bcc53a8c6/diff:/var/lib/docker/overlay2/fd2df25ca7e6b268f819b2fb38bbab50fbd5c6c8a4a2b4778f3917e567c64b8b/diff:/var/lib/docker/overlay2/a4639cb93382ebf39584a53948b6816dc6aa8e7011f2474b82320e09565c40ee/diff:/var/lib/docker/overlay2/16f320558e9c6c23b229f8b4dcf6f5c61670fa7b6513b707c1ceee8ff53ab012/diff:/var/lib/docker/overlay2/efde92a54c645d3d214babfea86fe173c88681a9a8bf1ee4c66f406eac0ce1f3/diff:/var/lib/docker/overlay2/67c175358f08a90e727cc2e59d3dc3f243bf98721348962ca80cedaa946e11e5/diff:/var/lib/docker/overlay2/abce6c2b52def112a2855b7240dfeb6e7ce8747ff80ae82b8c90df4358b5499f/diff:/var/lib/docker/overlay2/04adc9448565c768e00d76ed848aec196d92c4bcb1ba0268162b97accedfe7c0/diff:/var/lib/docker/overlay2/785c77e0f49a7d75d4a92bd8febab1b2a23633cd8c7be0e16fc628afb34

bcd83/diff:/var/lib/docker/overlay2/6716a51894c949d720d02845ebfc34f1d9f2431f04ffc2521d1b4fdf617ba172/diff:/var/lib/docker/overlay2/f7a3d7b89f4cc68fc5e0dd1756a2ae6260c2f0f5ab4bc40c3ce6b1b4d6ef0004/diff:/var/lib/docker/overlay2/91b9a991885a072e8afd1908c183be7e860cef03f6b3fbb173e06fdc90db2527/diff:/var/lib/docker/overlay2/8f4a011cc74f93ad854a02453507ef603a3da67ee7a766dfca38d3a46f5cdfb9/diff:/var/lib/docker/overlay2/b26e3ade0d328d23c224932591c878b90768d1c5e7058ccb26382021520bd343/diff",

	                "MergedDir": "/var/lib/docker/overlay2/3e4f101879c21cc86d3a345e84686ecfb0097ad0ef90e43949ac1917b277a31e/merged",

	                "UpperDir": "/var/lib/docker/overlay2/3e4f101879c21cc86d3a345e84686ecfb0097ad0ef90e43949ac1917b277a31e/diff",

	                "WorkDir": "/var/lib/docker/overlay2/3e4f101879c21cc86d3a345e84686ecfb0097ad0ef90e43949ac1917b277a31e/work"

	            },

	            "Name": "overlay2"

	        },

	        "Mounts": [

	            {

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

	            },

	            {

	                "Type": "volume",

	                "Name": "functional-20210813131926-8053",

	                "Source": "/var/lib/docker/volumes/functional-20210813131926-8053/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

	            }

	        ],

	        "Config": {

	            "Hostname": "functional-20210813131926-8053",

	            "Domainname": "",

	            "User": "root",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8441/tcp": {}

	            },

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

	            ],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6",

	            "Volumes": null,

	            "WorkingDir": "",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

	            ],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "functional-20210813131926-8053",

	                "name.minikube.sigs.k8s.io": "functional-20210813131926-8053",

	                "role.minikube.sigs.k8s.io": ""

	            },

	            "StopSignal": "SIGRTMIN+3"

	        },

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "fffc56d9ef4e71afae913f074fc77456290700b22c27c1f9874cc15c0358d2a3",

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "Ports": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "59731"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "59727"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "59728"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "59729"

	                    }

	                ],

	                "8441/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "59730"

	                    }

	                ]

	            },

	            "SandboxKey": "/var/run/docker/netns/fffc56d9ef4e",

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "functional-20210813131926-8053": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.49.2"

	                    },

	                    "Links": null,

	                    "Aliases": [

	                        "bd6d952ddeb5",

	                        "functional-20210813131926-8053"

	                    ],

	                    "NetworkID": "743ef3df7ddcc98a6822c8028d2b77ac28e2e76e3cc13ccd232db1d778dce820",

	                    "EndpointID": "9696b4dcace8ca7aad9efa41f1202a5fb2b54319373b4ef9628f151b3d732e54",

	                    "Gateway": "192.168.49.1",

	                    "IPAddress": "192.168.49.2",

	                    "IPPrefixLen": 24,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "MacAddress": "02:42:c0:a8:31:02",

	                    "DriverOpts": null

	                }

	            }

	        }

	    }

	]

-- /stdout --

helpers_test.go:240: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-20210813131926-8053 -n functional-20210813131926-8053

helpers_test.go:245: <<< TestFunctional/parallel/PersistentVolumeClaim FAILED: start of post-mortem logs <<<

helpers_test.go:246: ======>  post-mortem[TestFunctional/parallel/PersistentVolumeClaim]: minikube logs <======

helpers_test.go:248: (dbg) Run:  out/minikube-darwin-amd64 -p functional-20210813131926-8053 logs -n 25

helpers_test.go:248: (dbg) Done: out/minikube-darwin-amd64 -p functional-20210813131926-8053 logs -n 25: (3.171846003s)

helpers_test.go:253: TestFunctional/parallel/PersistentVolumeClaim logs: 

-- stdout --

	* 

	* ==> Audit <==

	* |---------|---------------------------------------------------------------------------------------------------|--------------------------------|---------|---------|-------------------------------|-------------------------------|

	| Command |                                               Args                                                |            Profile             |  User   | Version |          Start Time           |           End Time            |

	|---------|---------------------------------------------------------------------------------------------------|--------------------------------|---------|---------|-------------------------------|-------------------------------|

	| -p      | functional-20210813131926-8053 cache add                                                          | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:46 PDT | Fri, 13 Aug 2021 13:21:48 PDT |

	|         | minikube-local-cache-test:functional-20210813131926-8053                                          |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053 cache delete                                                       | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:48 PDT | Fri, 13 Aug 2021 13:21:48 PDT |

	|         | minikube-local-cache-test:functional-20210813131926-8053                                          |                                |         |         |                               |                               |

	| cache   | delete k8s.gcr.io/pause:3.3                                                                       | minikube                       | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:48 PDT | Fri, 13 Aug 2021 13:21:48 PDT |

	| cache   | list                                                                                              | minikube                       | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:48 PDT | Fri, 13 Aug 2021 13:21:48 PDT |

	| -p      | functional-20210813131926-8053                                                                    | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:48 PDT | Fri, 13 Aug 2021 13:21:49 PDT |

	|         | ssh sudo crictl images                                                                            |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                                                    | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:49 PDT | Fri, 13 Aug 2021 13:21:50 PDT |

	|         | ssh sudo docker rmi                                                                               |                                |         |         |                               |                               |

	|         | k8s.gcr.io/pause:latest                                                                           |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                                                    | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:50 PDT | Fri, 13 Aug 2021 13:21:52 PDT |

	|         | cache reload                                                                                      |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                                                    | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:52 PDT | Fri, 13 Aug 2021 13:21:53 PDT |

	|         | ssh sudo crictl inspecti                                                                          |                                |         |         |                               |                               |

	|         | k8s.gcr.io/pause:latest                                                                           |                                |         |         |                               |                               |

	| cache   | delete k8s.gcr.io/pause:3.1                                                                       | minikube                       | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:53 PDT | Fri, 13 Aug 2021 13:21:53 PDT |

	| cache   | delete k8s.gcr.io/pause:latest                                                                    | minikube                       | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:53 PDT | Fri, 13 Aug 2021 13:21:53 PDT |

	| -p      | functional-20210813131926-8053                                                                    | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:53 PDT | Fri, 13 Aug 2021 13:21:53 PDT |

	|         | kubectl -- --context                                                                              |                                |         |         |                               |                               |

	|         | functional-20210813131926-8053                                                                    |                                |         |         |                               |                               |

	|         | get pods                                                                                          |                                |         |         |                               |                               |

	| kubectl | --profile=functional-20210813131926-8053                                                          | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:54 PDT | Fri, 13 Aug 2021 13:21:54 PDT |

	|         | -- --context                                                                                      |                                |         |         |                               |                               |

	|         | functional-20210813131926-8053 get pods                                                           |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                                                    | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:22:41 PDT | Fri, 13 Aug 2021 13:22:45 PDT |

	|         | logs -n 25                                                                                        |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                                                    | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:22:46 PDT | Fri, 13 Aug 2021 13:22:49 PDT |

	|         | logs -n 25                                                                                        |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                                                    | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:22:50 PDT | Fri, 13 Aug 2021 13:22:54 PDT |

	|         | logs                                                                                              |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053 logs --file                                                        | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:22:54 PDT | Fri, 13 Aug 2021 13:22:57 PDT |

	|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/functional-20210813131926-8053467736887/logs.txt |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                                                    | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:22:57 PDT | Fri, 13 Aug 2021 13:22:57 PDT |

	|         | config unset cpus                                                                                 |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                                                    | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:22:57 PDT | Fri, 13 Aug 2021 13:22:57 PDT |

	|         | config set cpus 2                                                                                 |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                                                    | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:22:57 PDT | Fri, 13 Aug 2021 13:22:57 PDT |

	|         | config get cpus                                                                                   |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                                                    | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:22:57 PDT | Fri, 13 Aug 2021 13:22:57 PDT |

	|         | config unset cpus                                                                                 |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                                                    | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:22:57 PDT | Fri, 13 Aug 2021 13:22:58 PDT |

	|         | ssh sudo cat                                                                                      |                                |         |         |                               |                               |

	|         | /etc/test/nested/copy/8053/hosts                                                                  |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                                                    | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:22:58 PDT | Fri, 13 Aug 2021 13:22:58 PDT |

	|         | cp testdata/cp-test.txt                                                                           |                                |         |         |                               |                               |

	|         | /home/docker/cp-test.txt                                                                          |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                                                    | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:22:58 PDT | Fri, 13 Aug 2021 13:22:59 PDT |

	|         | ssh sudo cat                                                                                      |                                |         |         |                               |                               |

	|         | /home/docker/cp-test.txt                                                                          |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                                                    | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:22:59 PDT | Fri, 13 Aug 2021 13:22:59 PDT |

	|         | ssh echo hello                                                                                    |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                                                    | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:22:59 PDT | Fri, 13 Aug 2021 13:23:00 PDT |

	|         | ssh cat /etc/hostname                                                                             |                                |         |         |                               |                               |

	|---------|---------------------------------------------------------------------------------------------------|--------------------------------|---------|---------|-------------------------------|-------------------------------|

	* 

	* ==> Last Start <==

	* Log file created at: 2021/08/13 13:21:54

	Running on machine: 37309

	Binary: Built with gc go1.16.7 for darwin/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0813 13:21:54.281145    9787 out.go:298] Setting OutFile to fd 1 ...

	I0813 13:21:54.281275    9787 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0813 13:21:54.281277    9787 out.go:311] Setting ErrFile to fd 2...

	I0813 13:21:54.281279    9787 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0813 13:21:54.281354    9787 root.go:313] Updating PATH: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/bin

	I0813 13:21:54.281600    9787 out.go:305] Setting JSON to false

	I0813 13:21:54.299621    9787 start.go:111] hostinfo: {"hostname":"37309.local","uptime":4889,"bootTime":1628881225,"procs":312,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"11.2.3","kernelVersion":"20.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"c86236b2-4976-3542-80ca-74a6b8b4ba03"}

	W0813 13:21:54.299706    9787 start.go:119] gopshost.Virtualization returned error: not implemented yet

	I0813 13:21:54.326713    9787 out.go:177] * [functional-20210813131926-8053] minikube v1.22.0 on Darwin 11.2.3

	I0813 13:21:54.326846    9787 notify.go:169] Checking for updates...

	I0813 13:21:54.390409    9787 out.go:177]   - MINIKUBE_LOCATION=12230

	I0813 13:21:54.416142    9787 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/kubeconfig

	I0813 13:21:54.442299    9787 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64

	I0813 13:21:54.468300    9787 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube

	I0813 13:21:54.468666    9787 config.go:177] Loaded profile config "functional-20210813131926-8053": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.21.3

	I0813 13:21:54.468700    9787 driver.go:335] Setting default libvirt URI to qemu:///system

	I0813 13:21:54.567961    9787 docker.go:132] docker version: linux-20.10.6

	I0813 13:21:54.568092    9787 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I0813 13:21:54.749184    9787 info.go:263] docker info: {ID:43SM:MII3:NWBL:WJUG:JMKA:JL3W:EOOO:ZEGZ:7ZJH:ECYZ:GXPQ:XAL7 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:19 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:50 OomKillDisable:true NGoroutines:53 SystemTime:2021-08-13 20:21:54.680984807 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.25-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServer

Address:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6234726400 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.6 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05f951a3781f4f2c1911b05e61c160e9c30eaa8e Expected:05f951a3781f4f2c1911b05e61c160e9c30eaa8e} RuncCommit:{ID:12644e614e25b05da6fd08a38ffa0cfe1903fdec Expected:12644e614e25b05da6fd08a38ffa0cfe1903fdec} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=sec

comp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/local/lib/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Build with BuildKit Vendor:Docker Inc. Version:v0.5.1-docker] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:2.0.0-beta.1] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.8.0]] Warnings:<nil>}}

	I0813 13:21:54.775889    9787 out.go:177] * Using the docker driver based on existing profile

	I0813 13:21:54.775914    9787 start.go:278] selected driver: docker

	I0813 13:21:54.775919    9787 start.go:751] validating driver "docker" against &{Name:functional-20210813131926-8053 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.21.3 ClusterName:functional-20210813131926-8053 Namespace:default APIServerN

ame:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.21.3 ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false helm-tiller:false ingress:false ingress-dns:false istio:false istio-provisioner:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false] CustomAddon

Images:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0813 13:21:54.775984    9787 start.go:762] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}

	I0813 13:21:54.776188    9787 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I0813 13:21:54.961751    9787 info.go:263] docker info: {ID:43SM:MII3:NWBL:WJUG:JMKA:JL3W:EOOO:ZEGZ:7ZJH:ECYZ:GXPQ:XAL7 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:19 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:50 OomKillDisable:true NGoroutines:53 SystemTime:2021-08-13 20:21:54.893644183 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.25-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServer

Address:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6234726400 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.6 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05f951a3781f4f2c1911b05e61c160e9c30eaa8e Expected:05f951a3781f4f2c1911b05e61c160e9c30eaa8e} RuncCommit:{ID:12644e614e25b05da6fd08a38ffa0cfe1903fdec Expected:12644e614e25b05da6fd08a38ffa0cfe1903fdec} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=sec

comp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/local/lib/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Build with BuildKit Vendor:Docker Inc. Version:v0.5.1-docker] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:2.0.0-beta.1] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.8.0]] Warnings:<nil>}}

	I0813 13:21:54.964167    9787 start_flags.go:697] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0813 13:21:54.964195    9787 cni.go:93] Creating CNI manager for ""

	I0813 13:21:54.964201    9787 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I0813 13:21:54.964210    9787 start_flags.go:277] config:

	{Name:functional-20210813131926-8053 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.21.3 ClusterName:functional-20210813131926-8053 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Contain

erRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.21.3 ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false helm-tiller:false ingress:false ingress-dns:false istio:false istio-provisioner:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false] CustomAddonI

mages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0813 13:21:54.991369    9787 out.go:177] * Starting control plane node functional-20210813131926-8053 in cluster functional-20210813131926-8053

	I0813 13:21:54.991429    9787 cache.go:117] Beginning downloading kic base image for docker with docker

	I0813 13:21:55.059928    9787 out.go:177] * Pulling base image ...

	I0813 13:21:55.060060    9787 preload.go:131] Checking if preload exists for k8s version v1.21.3 and runtime docker

	I0813 13:21:55.060069    9787 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 in local docker daemon

	I0813 13:21:55.060163    9787 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.3-docker-overlay2-amd64.tar.lz4

	I0813 13:21:55.060181    9787 cache.go:56] Caching tarball of preloaded images

	I0813 13:21:55.060344    9787 preload.go:173] Found /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I0813 13:21:55.060355    9787 cache.go:59] Finished verifying existence of preloaded tar for  v1.21.3 on docker

	I0813 13:21:55.061830    9787 profile.go:148] Saving config to /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/functional-20210813131926-8053/config.json ...

	I0813 13:21:55.184646    9787 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 in local docker daemon, skipping pull

	I0813 13:21:55.184655    9787 cache.go:139] gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 exists in daemon, skipping load

	I0813 13:21:55.184665    9787 cache.go:205] Successfully downloaded all kic artifacts

	I0813 13:21:55.184720    9787 start.go:313] acquiring machines lock for functional-20210813131926-8053: {Name:mkc1b35540cb8690340beda05ed315b2f6e71bd5 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0813 13:21:55.184824    9787 start.go:317] acquired machines lock for "functional-20210813131926-8053" in 88.909µs

	I0813 13:21:55.184844    9787 start.go:93] Skipping create...Using existing machine configuration

	I0813 13:21:55.184850    9787 fix.go:55] fixHost starting: 

	I0813 13:21:55.185122    9787 cli_runner.go:115] Run: docker container inspect functional-20210813131926-8053 --format={{.State.Status}}

	I0813 13:21:55.302303    9787 fix.go:108] recreateIfNeeded on functional-20210813131926-8053: state=Running err=<nil>

	W0813 13:21:55.302324    9787 fix.go:134] unexpected machine state, will restart: <nil>

	I0813 13:21:55.329065    9787 out.go:177] * Updating the running docker "functional-20210813131926-8053" container ...

	I0813 13:21:55.329107    9787 machine.go:88] provisioning docker machine ...

	I0813 13:21:55.329153    9787 ubuntu.go:169] provisioning hostname "functional-20210813131926-8053"

	I0813 13:21:55.329300    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:55.448112    9787 main.go:130] libmachine: Using SSH client type: native

	I0813 13:21:55.448292    9787 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x13fa2e0] 0x13fa2a0 <nil>  [] 0s} 127.0.0.1 59731 <nil> <nil>}

	I0813 13:21:55.448311    9787 main.go:130] libmachine: About to run SSH command:

	sudo hostname functional-20210813131926-8053 && echo "functional-20210813131926-8053" | sudo tee /etc/hostname

	I0813 13:21:55.585147    9787 main.go:130] libmachine: SSH cmd err, output: <nil>: functional-20210813131926-8053

	I0813 13:21:55.585238    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:55.702492    9787 main.go:130] libmachine: Using SSH client type: native

	I0813 13:21:55.702674    9787 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x13fa2e0] 0x13fa2a0 <nil>  [] 0s} 127.0.0.1 59731 <nil> <nil>}

	I0813 13:21:55.702691    9787 main.go:130] libmachine: About to run SSH command:

			if ! grep -xq '.*\sfunctional-20210813131926-8053' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 functional-20210813131926-8053/g' /etc/hosts;

				else 

					echo '127.0.1.1 functional-20210813131926-8053' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0813 13:21:55.832252    9787 main.go:130] libmachine: SSH cmd err, output: <nil>: 

	I0813 13:21:55.832283    9787 ubuntu.go:175] set auth options {CertDir:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube CaCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/se

rver.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube}

	I0813 13:21:55.832316    9787 ubuntu.go:177] setting up certificates

	I0813 13:21:55.832332    9787 provision.go:83] configureAuth start

	I0813 13:21:55.832440    9787 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" functional-20210813131926-8053

	I0813 13:21:55.949496    9787 provision.go:138] copyHostCerts

	I0813 13:21:55.949586    9787 exec_runner.go:145] found /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.pem, removing ...

	I0813 13:21:55.949592    9787 exec_runner.go:190] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.pem

	I0813 13:21:55.949692    9787 exec_runner.go:152] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.pem (1082 bytes)

	I0813 13:21:55.949885    9787 exec_runner.go:145] found /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cert.pem, removing ...

	I0813 13:21:55.949892    9787 exec_runner.go:190] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cert.pem

	I0813 13:21:55.949956    9787 exec_runner.go:152] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cert.pem (1123 bytes)

	I0813 13:21:55.950102    9787 exec_runner.go:145] found /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/key.pem, removing ...

	I0813 13:21:55.950105    9787 exec_runner.go:190] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/key.pem

	I0813 13:21:55.950159    9787 exec_runner.go:152] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/key.pem (1675 bytes)

	I0813 13:21:55.950267    9787 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca-key.pem org=jenkins.functional-20210813131926-8053 san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube functional-20210813131926-8053]

	I0813 13:21:56.044777    9787 provision.go:172] copyRemoteCerts

	I0813 13:21:56.044832    9787 ssh_runner.go:149] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0813 13:21:56.044901    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:56.176574    9787 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:59731 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/functional-20210813131926-8053/id_rsa Username:docker}

	I0813 13:21:56.266936    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0813 13:21:56.285493    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server.pem --> /etc/docker/server.pem (1265 bytes)

	I0813 13:21:56.301792    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0813 13:21:56.318533    9787 provision.go:86] duration metric: configureAuth took 486.190467ms

	I0813 13:21:56.318541    9787 ubuntu.go:193] setting minikube options for container-runtime

	I0813 13:21:56.318718    9787 config.go:177] Loaded profile config "functional-20210813131926-8053": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.21.3

	I0813 13:21:56.318783    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:56.437674    9787 main.go:130] libmachine: Using SSH client type: native

	I0813 13:21:56.437827    9787 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x13fa2e0] 0x13fa2a0 <nil>  [] 0s} 127.0.0.1 59731 <nil> <nil>}

	I0813 13:21:56.437836    9787 main.go:130] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0813 13:21:56.563851    9787 main.go:130] libmachine: SSH cmd err, output: <nil>: overlay

	I0813 13:21:56.563864    9787 ubuntu.go:71] root file system type: overlay

	I0813 13:21:56.563998    9787 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I0813 13:21:56.564091    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:56.681639    9787 main.go:130] libmachine: Using SSH client type: native

	I0813 13:21:56.681807    9787 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x13fa2e0] 0x13fa2a0 <nil>  [] 0s} 127.0.0.1 59731 <nil> <nil>}

	I0813 13:21:56.681858    9787 main.go:130] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0813 13:21:56.819969    9787 main.go:130] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0813 13:21:56.820085    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:56.936161    9787 main.go:130] libmachine: Using SSH client type: native

	I0813 13:21:56.936301    9787 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x13fa2e0] 0x13fa2a0 <nil>  [] 0s} 127.0.0.1 59731 <nil> <nil>}

	I0813 13:21:56.936316    9787 main.go:130] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0813 13:21:57.070630    9787 main.go:130] libmachine: SSH cmd err, output: <nil>: 

	I0813 13:21:57.070642    9787 machine.go:91] provisioned docker machine in 1.741524027s

	I0813 13:21:57.070650    9787 start.go:267] post-start starting for "functional-20210813131926-8053" (driver="docker")

	I0813 13:21:57.070654    9787 start.go:277] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0813 13:21:57.070719    9787 ssh_runner.go:149] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0813 13:21:57.070786    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:57.185365    9787 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:59731 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/functional-20210813131926-8053/id_rsa Username:docker}

	I0813 13:21:57.278255    9787 ssh_runner.go:149] Run: cat /etc/os-release

	I0813 13:21:57.282084    9787 main.go:130] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found

	I0813 13:21:57.282094    9787 main.go:130] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found

	I0813 13:21:57.282099    9787 main.go:130] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found

	I0813 13:21:57.282104    9787 info.go:137] Remote host: Ubuntu 20.04.2 LTS

	I0813 13:21:57.282110    9787 filesync.go:126] Scanning /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/addons for local assets ...

	I0813 13:21:57.282205    9787 filesync.go:126] Scanning /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files for local assets ...

	I0813 13:21:57.282364    9787 filesync.go:149] local asset: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/80532.pem -> 80532.pem in /etc/ssl/certs

	I0813 13:21:57.282524    9787 filesync.go:149] local asset: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/test/nested/copy/8053/hosts -> hosts in /etc/test/nested/copy/8053

	I0813 13:21:57.282577    9787 ssh_runner.go:149] Run: sudo mkdir -p /etc/ssl/certs /etc/test/nested/copy/8053

	I0813 13:21:57.289648    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/80532.pem --> /etc/ssl/certs/80532.pem (1708 bytes)

	I0813 13:21:57.305812    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/test/nested/copy/8053/hosts --> /etc/test/nested/copy/8053/hosts (40 bytes)

	I0813 13:21:57.322252    9787 start.go:270] post-start completed in 251.592835ms

	I0813 13:21:57.322333    9787 ssh_runner.go:149] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0813 13:21:57.322390    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:57.441126    9787 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:59731 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/functional-20210813131926-8053/id_rsa Username:docker}

	I0813 13:21:57.530205    9787 fix.go:57] fixHost completed within 2.345344178s

	I0813 13:21:57.530220    9787 start.go:80] releasing machines lock for "functional-20210813131926-8053", held for 2.345384882s

	I0813 13:21:57.530368    9787 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" functional-20210813131926-8053

	I0813 13:21:57.649353    9787 ssh_runner.go:149] Run: curl -sS -m 2 https://k8s.gcr.io/

	I0813 13:21:57.649366    9787 ssh_runner.go:149] Run: systemctl --version

	I0813 13:21:57.649430    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:57.649444    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:57.779721    9787 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:59731 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/functional-20210813131926-8053/id_rsa Username:docker}

	I0813 13:21:57.779920    9787 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:59731 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/functional-20210813131926-8053/id_rsa Username:docker}

	I0813 13:21:57.870055    9787 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service containerd

	I0813 13:21:57.969894    9787 ssh_runner.go:149] Run: sudo systemctl cat docker.service

	I0813 13:21:57.979713    9787 cruntime.go:249] skipping containerd shutdown because we are bound to it

	I0813 13:21:57.979768    9787 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service crio

	I0813 13:21:57.989737    9787 ssh_runner.go:149] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/dockershim.sock

	image-endpoint: unix:///var/run/dockershim.sock

	" | sudo tee /etc/crictl.yaml"

	I0813 13:21:58.002260    9787 ssh_runner.go:149] Run: sudo systemctl unmask docker.service

	I0813 13:21:58.070268    9787 ssh_runner.go:149] Run: sudo systemctl enable docker.socket

	I0813 13:21:58.143885    9787 ssh_runner.go:149] Run: sudo systemctl cat docker.service

	I0813 13:21:58.153464    9787 ssh_runner.go:149] Run: sudo systemctl daemon-reload

	I0813 13:21:58.227112    9787 ssh_runner.go:149] Run: sudo systemctl start docker

	I0813 13:21:58.236571    9787 ssh_runner.go:149] Run: docker version --format {{.Server.Version}}

	I0813 13:21:58.275161    9787 ssh_runner.go:149] Run: docker version --format {{.Server.Version}}

	I0813 13:21:58.361792    9787 out.go:204] * Preparing Kubernetes v1.21.3 on Docker 20.10.8 ...

	I0813 13:21:58.361961    9787 cli_runner.go:115] Run: docker exec -t functional-20210813131926-8053 dig +short host.docker.internal

	I0813 13:21:58.547479    9787 network.go:69] got host ip for mount in container by digging dns: 192.168.65.2

	I0813 13:21:58.547597    9787 ssh_runner.go:149] Run: grep 192.168.65.2	host.minikube.internal$ /etc/hosts

	I0813 13:21:58.552110    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8441/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:58.698484    9787 out.go:177]   - apiserver.enable-admission-plugins=NamespaceAutoProvision

	I0813 13:21:58.698634    9787 preload.go:131] Checking if preload exists for k8s version v1.21.3 and runtime docker

	I0813 13:21:58.698805    9787 ssh_runner.go:149] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0813 13:21:58.729603    9787 docker.go:535] Got preloaded images: -- stdout --

	k8s.gcr.io/kube-apiserver:v1.21.3

	k8s.gcr.io/kube-scheduler:v1.21.3

	k8s.gcr.io/kube-proxy:v1.21.3

	k8s.gcr.io/kube-controller-manager:v1.21.3

	minikube-local-cache-test:functional-20210813131926-8053

	gcr.io/k8s-minikube/storage-provisioner:v5

	k8s.gcr.io/pause:3.4.1

	kubernetesui/dashboard:v2.1.0

	k8s.gcr.io/coredns/coredns:v1.8.0

	k8s.gcr.io/etcd:3.4.13-0

	k8s.gcr.io/pause:3.3

	kubernetesui/metrics-scraper:v1.0.4

	k8s.gcr.io/pause:3.1

	k8s.gcr.io/pause:latest

	-- /stdout --

	I0813 13:21:58.729614    9787 docker.go:466] Images already preloaded, skipping extraction

	I0813 13:21:58.729700    9787 ssh_runner.go:149] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0813 13:21:58.758863    9787 docker.go:535] Got preloaded images: -- stdout --

	k8s.gcr.io/kube-apiserver:v1.21.3

	k8s.gcr.io/kube-scheduler:v1.21.3

	k8s.gcr.io/kube-proxy:v1.21.3

	k8s.gcr.io/kube-controller-manager:v1.21.3

	minikube-local-cache-test:functional-20210813131926-8053

	gcr.io/k8s-minikube/storage-provisioner:v5

	k8s.gcr.io/pause:3.4.1

	kubernetesui/dashboard:v2.1.0

	k8s.gcr.io/coredns/coredns:v1.8.0

	k8s.gcr.io/etcd:3.4.13-0

	k8s.gcr.io/pause:3.3

	kubernetesui/metrics-scraper:v1.0.4

	k8s.gcr.io/pause:3.1

	k8s.gcr.io/pause:latest

	-- /stdout --

	I0813 13:21:58.758872    9787 cache_images.go:74] Images are preloaded, skipping loading

	I0813 13:21:58.758968    9787 ssh_runner.go:149] Run: docker info --format {{.CgroupDriver}}

	I0813 13:21:58.836165    9787 extraconfig.go:124] Overwriting default enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota with user provided enable-admission-plugins=NamespaceAutoProvision for component apiserver

	I0813 13:21:58.836186    9787 cni.go:93] Creating CNI manager for ""

	I0813 13:21:58.836195    9787 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I0813 13:21:58.836203    9787 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I0813 13:21:58.836216    9787 kubeadm.go:153] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8441 KubernetesVersion:v1.21.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:functional-20210813131926-8053 NodeName:functional-20210813131926-8053 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceAutoProvision] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}

	I0813 13:21:58.836321    9787 kubeadm.go:157] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.49.2

	  bindPort: 8441

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: /var/run/dockershim.sock

	  name: "functional-20210813131926-8053"

	  kubeletExtraArgs:

	    node-ip: 192.168.49.2

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceAutoProvision"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8441

	dns:

	  type: CoreDNS

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.21.3

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0813 13:21:58.836398    9787 kubeadm.go:909] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.21.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=functional-20210813131926-8053 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2

	[Install]

	 config:

	{KubernetesVersion:v1.21.3 ClusterName:functional-20210813131926-8053 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:}

	I0813 13:21:58.836468    9787 ssh_runner.go:149] Run: sudo ls /var/lib/minikube/binaries/v1.21.3

	I0813 13:21:58.843899    9787 binaries.go:44] Found k8s binaries, skipping transfer

	I0813 13:21:58.843961    9787 ssh_runner.go:149] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0813 13:21:58.850752    9787 ssh_runner.go:316] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (356 bytes)

	I0813 13:21:58.863434    9787 ssh_runner.go:316] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0813 13:21:58.875415    9787 ssh_runner.go:316] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (1923 bytes)

	I0813 13:21:58.887646    9787 ssh_runner.go:149] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts

	I0813 13:21:58.891653    9787 certs.go:52] Setting up /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/functional-20210813131926-8053 for IP: 192.168.49.2

	I0813 13:21:58.891733    9787 certs.go:179] skipping minikubeCA CA generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.key

	I0813 13:21:58.891764    9787 certs.go:179] skipping proxyClientCA CA generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.key

	I0813 13:21:58.891832    9787 certs.go:293] skipping minikube-user signed cert generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/functional-20210813131926-8053/client.key

	I0813 13:21:58.891864    9787 certs.go:293] skipping minikube signed cert generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/functional-20210813131926-8053/apiserver.key.dd3b5fb2

	I0813 13:21:58.891898    9787 certs.go:293] skipping aggregator signed cert generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/functional-20210813131926-8053/proxy-client.key

	I0813 13:21:58.892101    9787 certs.go:376] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/8053.pem (1338 bytes)

	W0813 13:21:58.892147    9787 certs.go:372] ignoring /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/8053_empty.pem, impossibly tiny 0 bytes

	I0813 13:21:58.892159    9787 certs.go:376] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca-key.pem (1675 bytes)

	I0813 13:21:58.892196    9787 certs.go:376] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem (1082 bytes)

	I0813 13:21:58.892231    9787 certs.go:376] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/cert.pem (1123 bytes)

	I0813 13:21:58.892268    9787 certs.go:376] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/key.pem (1675 bytes)

	I0813 13:21:58.892332    9787 certs.go:376] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/80532.pem (1708 bytes)

	I0813 13:21:58.893223    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/functional-20210813131926-8053/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I0813 13:21:58.909719    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/functional-20210813131926-8053/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0813 13:21:58.925905    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/functional-20210813131926-8053/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0813 13:21:58.942022    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/functional-20210813131926-8053/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0813 13:21:58.958623    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0813 13:21:58.975085    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I0813 13:21:58.991264    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0813 13:21:59.007328    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I0813 13:21:59.023488    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/8053.pem --> /usr/share/ca-certificates/8053.pem (1338 bytes)

	I0813 13:21:59.040270    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/80532.pem --> /usr/share/ca-certificates/80532.pem (1708 bytes)

	I0813 13:21:59.056327    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0813 13:21:59.072475    9787 ssh_runner.go:316] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0813 13:21:59.084536    9787 ssh_runner.go:149] Run: openssl version

	I0813 13:21:59.089935    9787 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/80532.pem && ln -fs /usr/share/ca-certificates/80532.pem /etc/ssl/certs/80532.pem"

	I0813 13:21:59.097684    9787 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/80532.pem

	I0813 13:21:59.101594    9787 certs.go:419] hashing: -rw-r--r-- 1 root root 1708 Aug 13 20:19 /usr/share/ca-certificates/80532.pem

	I0813 13:21:59.101643    9787 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/80532.pem

	I0813 13:21:59.107144    9787 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/80532.pem /etc/ssl/certs/3ec20f2e.0"

	I0813 13:21:59.114076    9787 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0813 13:21:59.121539    9787 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0813 13:21:59.125540    9787 certs.go:419] hashing: -rw-r--r-- 1 root root 1111 Aug 13 20:16 /usr/share/ca-certificates/minikubeCA.pem

	I0813 13:21:59.125584    9787 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0813 13:21:59.130700    9787 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0813 13:21:59.137797    9787 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/8053.pem && ln -fs /usr/share/ca-certificates/8053.pem /etc/ssl/certs/8053.pem"

	I0813 13:21:59.145736    9787 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/8053.pem

	I0813 13:21:59.149426    9787 certs.go:419] hashing: -rw-r--r-- 1 root root 1338 Aug 13 20:19 /usr/share/ca-certificates/8053.pem

	I0813 13:21:59.149475    9787 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/8053.pem

	I0813 13:21:59.154597    9787 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/8053.pem /etc/ssl/certs/51391683.0"

	I0813 13:21:59.161377    9787 kubeadm.go:390] StartCluster: {Name:functional-20210813131926-8053 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.21.3 ClusterName:functional-20210813131926-8053 Namespace:default APIServerName:minikubeCA APISe

rverNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.21.3 ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false helm-tiller:false ingress:false ingress-dns:false istio:false istio-provisioner:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-p

rovisioner-gluster:false volumesnapshots:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0813 13:21:59.161497    9787 ssh_runner.go:149] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0813 13:21:59.189545    9787 ssh_runner.go:149] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0813 13:21:59.198183    9787 kubeadm.go:401] found existing configuration files, will attempt cluster restart

	I0813 13:21:59.198193    9787 kubeadm.go:600] restartCluster start

	I0813 13:21:59.198243    9787 ssh_runner.go:149] Run: sudo test -d /data/minikube

	I0813 13:21:59.205178    9787 kubeadm.go:126] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1

	stdout:

	stderr:

	I0813 13:21:59.205256    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8441/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:59.324984    9787 kubeconfig.go:93] found "functional-20210813131926-8053" server: "https://127.0.0.1:59730"

	I0813 13:21:59.328207    9787 ssh_runner.go:149] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new

	I0813 13:21:59.336264    9787 kubeadm.go:568] needs reconfigure: configs differ:

	-- stdout --

	--- /var/tmp/minikube/kubeadm.yaml	2021-08-13 20:20:16.844537431 +0000

	+++ /var/tmp/minikube/kubeadm.yaml.new	2021-08-13 20:21:58.890702464 +0000

	@@ -22,7 +22,7 @@

	 apiServer:

	   certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]

	   extraArgs:

	-    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	+    enable-admission-plugins: "NamespaceAutoProvision"

	 controllerManager:

	   extraArgs:

	     allocate-node-cidrs: "true"

	-- /stdout --

	I0813 13:21:59.336273    9787 kubeadm.go:1032] stopping kube-system containers ...

	I0813 13:21:59.336353    9787 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0813 13:21:59.365803    9787 docker.go:367] Stopping containers: [c9cb7d5809d8 a775b806a61d cb9e8762e065 137cc83770ff d982e81551e9 0237d371d391 467412a75d20 52fbb2e72ccf 9d5404187c66 c4b0031b9346 60451e7f160d 474f32a18e0e 58a9c2f98763 2ec83ef7b889 d31f2fbd2084]

	I0813 13:21:59.365906    9787 ssh_runner.go:149] Run: docker stop c9cb7d5809d8 a775b806a61d cb9e8762e065 137cc83770ff d982e81551e9 0237d371d391 467412a75d20 52fbb2e72ccf 9d5404187c66 c4b0031b9346 60451e7f160d 474f32a18e0e 58a9c2f98763 2ec83ef7b889 d31f2fbd2084

	I0813 13:22:04.995080    9787 ssh_runner.go:189] Completed: docker stop c9cb7d5809d8 a775b806a61d cb9e8762e065 137cc83770ff d982e81551e9 0237d371d391 467412a75d20 52fbb2e72ccf 9d5404187c66 c4b0031b9346 60451e7f160d 474f32a18e0e 58a9c2f98763 2ec83ef7b889 d31f2fbd2084: (5.629129791s)

	I0813 13:22:04.995149    9787 ssh_runner.go:149] Run: sudo systemctl stop kubelet

	I0813 13:22:05.035150    9787 ssh_runner.go:149] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0813 13:22:05.043407    9787 kubeadm.go:154] found existing configuration files:

	-rw------- 1 root root 5639 Aug 13 20:20 /etc/kubernetes/admin.conf

	-rw------- 1 root root 5656 Aug 13 20:20 /etc/kubernetes/controller-manager.conf

	-rw------- 1 root root 2059 Aug 13 20:20 /etc/kubernetes/kubelet.conf

	-rw------- 1 root root 5604 Aug 13 20:20 /etc/kubernetes/scheduler.conf

	I0813 13:22:05.043464    9787 ssh_runner.go:149] Run: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/admin.conf

	I0813 13:22:05.051350    9787 ssh_runner.go:149] Run: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/kubelet.conf

	I0813 13:22:05.060114    9787 ssh_runner.go:149] Run: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/controller-manager.conf

	I0813 13:22:05.067525    9787 kubeadm.go:165] "https://control-plane.minikube.internal:8441" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/controller-manager.conf: Process exited with status 1

	stdout:

	stderr:

	I0813 13:22:05.067578    9787 ssh_runner.go:149] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I0813 13:22:05.075008    9787 ssh_runner.go:149] Run: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/scheduler.conf

	I0813 13:22:05.082906    9787 kubeadm.go:165] "https://control-plane.minikube.internal:8441" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/scheduler.conf: Process exited with status 1

	stdout:

	stderr:

	I0813 13:22:05.082967    9787 ssh_runner.go:149] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I0813 13:22:05.090012    9787 ssh_runner.go:149] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0813 13:22:05.098160    9787 kubeadm.go:676] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml

	I0813 13:22:05.098166    9787 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.3:$PATH kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"

	I0813 13:22:05.234978    9787 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.3:$PATH kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"

	I0813 13:22:06.121440    9787 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.3:$PATH kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"

	I0813 13:22:06.340305    9787 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.3:$PATH kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"

	I0813 13:22:06.503163    9787 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.3:$PATH kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"

	I0813 13:22:06.712462    9787 api_server.go:50] waiting for apiserver process to appear ...

	I0813 13:22:06.712527    9787 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 13:22:06.730332    9787 api_server.go:70] duration metric: took 17.874307ms to wait for apiserver process to appear ...

	I0813 13:22:06.730341    9787 api_server.go:86] waiting for apiserver healthz status ...

	I0813 13:22:06.730354    9787 api_server.go:239] Checking apiserver healthz at https://127.0.0.1:59730/healthz ...

	I0813 13:22:06.736407    9787 api_server.go:265] https://127.0.0.1:59730/healthz returned 200:

	ok

	I0813 13:22:06.743171    9787 api_server.go:139] control plane version: v1.21.3

	I0813 13:22:06.743179    9787 api_server.go:129] duration metric: took 12.83557ms to wait for apiserver health ...

	I0813 13:22:06.743183    9787 cni.go:93] Creating CNI manager for ""

	I0813 13:22:06.743191    9787 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I0813 13:22:06.743197    9787 system_pods.go:43] waiting for kube-system pods to appear ...

	I0813 13:22:06.753205    9787 system_pods.go:59] 7 kube-system pods found

	I0813 13:22:06.753216    9787 system_pods.go:61] "coredns-558bd4d5db-rhdvr" [5a622440-7ec5-4279-906a-dbb6df1293e4] Running

	I0813 13:22:06.753223    9787 system_pods.go:61] "etcd-functional-20210813131926-8053" [4f00bcab-aff3-43c8-acc0-58a4b8aabe25] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])

	I0813 13:22:06.753226    9787 system_pods.go:61] "kube-apiserver-functional-20210813131926-8053" [20ad3ec8-4b1e-4b0c-98d1-55d19db5ea62] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])

	I0813 13:22:06.753249    9787 system_pods.go:61] "kube-controller-manager-functional-20210813131926-8053" [dcbf1190-fbb7-47cc-8dc0-3e56e3c5edae] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])

	I0813 13:22:06.753254    9787 system_pods.go:61] "kube-proxy-kv9mv" [021b9666-4667-41cf-b041-7b8db53a4052] Running

	I0813 13:22:06.753257    9787 system_pods.go:61] "kube-scheduler-functional-20210813131926-8053" [afe411d1-6ad3-41a8-bb90-ff93ba88531c] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])

	I0813 13:22:06.753260    9787 system_pods.go:61] "storage-provisioner" [d75f1151-7edf-4dac-acd9-128a49223ff1] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])

	I0813 13:22:06.753263    9787 system_pods.go:74] duration metric: took 10.063476ms to wait for pod list to return data ...

	I0813 13:22:06.753267    9787 node_conditions.go:102] verifying NodePressure condition ...

	I0813 13:22:06.756805    9787 node_conditions.go:122] node storage ephemeral capacity is 123591232Ki

	I0813 13:22:06.756820    9787 node_conditions.go:123] node cpu capacity is 6

	I0813 13:22:06.756832    9787 node_conditions.go:105] duration metric: took 3.562026ms to run NodePressure ...

	I0813 13:22:06.756839    9787 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.3:$PATH kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"

	I0813 13:22:06.988642    9787 kubeadm.go:731] waiting for restarted kubelet to initialise ...

	I0813 13:22:06.992762    9787 kubeadm.go:746] kubelet initialised

	I0813 13:22:06.992768    9787 kubeadm.go:747] duration metric: took 4.11784ms waiting for restarted kubelet to initialise ...

	I0813 13:22:06.992772    9787 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0813 13:22:06.997055    9787 pod_ready.go:78] waiting up to 4m0s for pod "coredns-558bd4d5db-rhdvr" in "kube-system" namespace to be "Ready" ...

	I0813 13:22:07.004790    9787 pod_ready.go:92] pod "coredns-558bd4d5db-rhdvr" in "kube-system" namespace has status "Ready":"True"

	I0813 13:22:07.004795    9787 pod_ready.go:81] duration metric: took 7.730399ms waiting for pod "coredns-558bd4d5db-rhdvr" in "kube-system" namespace to be "Ready" ...

	I0813 13:22:07.004799    9787 pod_ready.go:78] waiting up to 4m0s for pod "etcd-functional-20210813131926-8053" in "kube-system" namespace to be "Ready" ...

	I0813 13:22:09.023880    9787 pod_ready.go:102] pod "etcd-functional-20210813131926-8053" in "kube-system" namespace has status "Ready":"False"

	I0813 13:22:11.523012    9787 pod_ready.go:97] node "functional-20210813131926-8053" hosting pod "etcd-functional-20210813131926-8053" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:11.523022    9787 pod_ready.go:81] duration metric: took 4.518205887s waiting for pod "etcd-functional-20210813131926-8053" in "kube-system" namespace to be "Ready" ...

	E0813 13:22:11.523028    9787 pod_ready.go:66] WaitExtra: waitPodCondition: node "functional-20210813131926-8053" hosting pod "etcd-functional-20210813131926-8053" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:11.523040    9787 pod_ready.go:78] waiting up to 4m0s for pod "kube-apiserver-functional-20210813131926-8053" in "kube-system" namespace to be "Ready" ...

	I0813 13:22:11.527525    9787 pod_ready.go:97] node "functional-20210813131926-8053" hosting pod "kube-apiserver-functional-20210813131926-8053" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:11.527531    9787 pod_ready.go:81] duration metric: took 4.486717ms waiting for pod "kube-apiserver-functional-20210813131926-8053" in "kube-system" namespace to be "Ready" ...

	E0813 13:22:11.527536    9787 pod_ready.go:66] WaitExtra: waitPodCondition: node "functional-20210813131926-8053" hosting pod "kube-apiserver-functional-20210813131926-8053" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:11.527544    9787 pod_ready.go:78] waiting up to 4m0s for pod "kube-controller-manager-functional-20210813131926-8053" in "kube-system" namespace to be "Ready" ...

	I0813 13:22:11.531857    9787 pod_ready.go:97] node "functional-20210813131926-8053" hosting pod "kube-controller-manager-functional-20210813131926-8053" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:11.531864    9787 pod_ready.go:81] duration metric: took 4.31653ms waiting for pod "kube-controller-manager-functional-20210813131926-8053" in "kube-system" namespace to be "Ready" ...

	E0813 13:22:11.531869    9787 pod_ready.go:66] WaitExtra: waitPodCondition: node "functional-20210813131926-8053" hosting pod "kube-controller-manager-functional-20210813131926-8053" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:11.531876    9787 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-kv9mv" in "kube-system" namespace to be "Ready" ...

	I0813 13:22:11.537017    9787 pod_ready.go:97] node "functional-20210813131926-8053" hosting pod "kube-proxy-kv9mv" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:11.537022    9787 pod_ready.go:81] duration metric: took 5.141983ms waiting for pod "kube-proxy-kv9mv" in "kube-system" namespace to be "Ready" ...

	E0813 13:22:11.537025    9787 pod_ready.go:66] WaitExtra: waitPodCondition: node "functional-20210813131926-8053" hosting pod "kube-proxy-kv9mv" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:11.537032    9787 pod_ready.go:78] waiting up to 4m0s for pod "kube-scheduler-functional-20210813131926-8053" in "kube-system" namespace to be "Ready" ...

	I0813 13:22:11.545827    9787 pod_ready.go:97] node "functional-20210813131926-8053" hosting pod "kube-scheduler-functional-20210813131926-8053" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:11.545836    9787 pod_ready.go:81] duration metric: took 8.799553ms waiting for pod "kube-scheduler-functional-20210813131926-8053" in "kube-system" namespace to be "Ready" ...

	E0813 13:22:11.545841    9787 pod_ready.go:66] WaitExtra: waitPodCondition: node "functional-20210813131926-8053" hosting pod "kube-scheduler-functional-20210813131926-8053" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:11.545851    9787 pod_ready.go:38] duration metric: took 4.553059995s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0813 13:22:11.545860    9787 ssh_runner.go:149] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0813 13:22:11.558301    9787 ops.go:34] apiserver oom_adj: -16

	I0813 13:22:11.558317    9787 kubeadm.go:604] restartCluster took 12.36008589s

	I0813 13:22:11.558321    9787 kubeadm.go:392] StartCluster complete in 12.39691792s

	I0813 13:22:11.558329    9787 settings.go:142] acquiring lock: {Name:mkea671a8cf1619d5bb0d33f936826680e87cf9b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 13:22:11.558414    9787 settings.go:150] Updating kubeconfig:  /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/kubeconfig

	I0813 13:22:11.558889    9787 lock.go:36] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/kubeconfig: {Name:mk2e9f304ce9a26dabf1dc11ded078755e07052d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 13:22:11.564907    9787 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "functional-20210813131926-8053" rescaled to 1

	I0813 13:22:11.564940    9787 ssh_runner.go:149] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.21.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0813 13:22:11.564936    9787 start.go:226] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.21.3 ControlPlane:true Worker:true}

	I0813 13:22:11.564966    9787 addons.go:342] enableAddons start: toEnable=map[ambassador:false auto-pause:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false helm-tiller:false ingress:false ingress-dns:false istio:false istio-provisioner:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false], additional=[]

	I0813 13:22:11.589685    9787 out.go:177] * Verifying Kubernetes components...

	I0813 13:22:11.565120    9787 config.go:177] Loaded profile config "functional-20210813131926-8053": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.21.3

	I0813 13:22:11.589733    9787 addons.go:59] Setting default-storageclass=true in profile "functional-20210813131926-8053"

	I0813 13:22:11.589735    9787 addons.go:59] Setting storage-provisioner=true in profile "functional-20210813131926-8053"

	I0813 13:22:11.589750    9787 addons.go:135] Setting addon storage-provisioner=true in "functional-20210813131926-8053"

	W0813 13:22:11.589756    9787 addons.go:147] addon storage-provisioner should already be in state true

	I0813 13:22:11.589756    9787 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "functional-20210813131926-8053"

	I0813 13:22:11.589762    9787 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service kubelet

	I0813 13:22:11.589779    9787 host.go:66] Checking if "functional-20210813131926-8053" exists ...

	I0813 13:22:11.590054    9787 cli_runner.go:115] Run: docker container inspect functional-20210813131926-8053 --format={{.State.Status}}

	I0813 13:22:11.591473    9787 cli_runner.go:115] Run: docker container inspect functional-20210813131926-8053 --format={{.State.Status}}

	I0813 13:22:11.640467    9787 start.go:708] CoreDNS already contains "host.minikube.internal" host record, skipping...

	I0813 13:22:11.640547    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8441/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:22:11.736998    9787 addons.go:135] Setting addon default-storageclass=true in "functional-20210813131926-8053"

	W0813 13:22:11.753928    9787 addons.go:147] addon default-storageclass should already be in state true

	I0813 13:22:11.753909    9787 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0813 13:22:11.753958    9787 host.go:66] Checking if "functional-20210813131926-8053" exists ...

	I0813 13:22:11.754030    9787 addons.go:275] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0813 13:22:11.754035    9787 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0813 13:22:11.754119    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:22:11.756650    9787 cli_runner.go:115] Run: docker container inspect functional-20210813131926-8053 --format={{.State.Status}}

	I0813 13:22:11.796607    9787 node_ready.go:35] waiting up to 6m0s for node "functional-20210813131926-8053" to be "Ready" ...

	I0813 13:22:11.883407    9787 addons.go:275] installing /etc/kubernetes/addons/storageclass.yaml

	I0813 13:22:11.883414    9787 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0813 13:22:11.883501    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:22:11.884664    9787 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:59731 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/functional-20210813131926-8053/id_rsa Username:docker}

	I0813 13:22:11.981485    9787 ssh_runner.go:149] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0813 13:22:12.002195    9787 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:59731 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/functional-20210813131926-8053/id_rsa Username:docker}

	I0813 13:22:12.100215    9787 ssh_runner.go:149] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0813 13:22:12.292911    9787 out.go:177] * Enabled addons: storage-provisioner, default-storageclass

	I0813 13:22:12.292941    9787 addons.go:344] enableAddons completed in 727.982788ms

	I0813 13:22:13.803981    9787 node_ready.go:58] node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:15.805967    9787 node_ready.go:58] node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:26.864663    9787 node_ready.go:53] error getting node "functional-20210813131926-8053": an error on the server ("") has prevented the request from succeeding (get nodes functional-20210813131926-8053)

	I0813 13:22:26.864673    9787 node_ready.go:38] duration metric: took 15.06800794s waiting for node "functional-20210813131926-8053" to be "Ready" ...

	* 

	* ==> Docker <==

	* -- Logs begin at Fri 2021-08-13 20:19:47 UTC, end at Fri 2021-08-13 20:32:48 UTC. --

	Aug 13 20:23:39 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:23:39.812219494Z" level=error msg="Handler for POST /v1.41/images/create returned error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:23:41 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:23:41.721814918Z" level=error msg="Not continuing with pull after error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:23:41 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:23:41.723559082Z" level=error msg="Handler for POST /v1.41/images/create returned error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:24:29 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:24:29.684199888Z" level=error msg="Not continuing with pull after error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:24:29 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:24:29.685309400Z" level=error msg="Handler for POST /v1.41/images/create returned error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:24:32 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:24:32.661964677Z" level=error msg="Not continuing with pull after error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:24:32 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:24:32.663723499Z" level=error msg="Handler for POST /v1.41/images/create returned error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:25:58 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:25:58.652594755Z" level=error msg="Not continuing with pull after error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:25:58 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:25:58.654390204Z" level=error msg="Handler for POST /v1.41/images/create returned error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:26:01 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:26:01.632718322Z" level=error msg="Not continuing with pull after error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:26:01 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:26:01.634194742Z" level=error msg="Handler for POST /v1.41/images/create returned error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:28:40 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:28:40.562402566Z" level=error msg="Not continuing with pull after error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:28:40 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:28:40.563999890Z" level=error msg="Handler for POST /v1.41/images/create returned error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:28:55 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:28:55.493887291Z" level=error msg="Not continuing with pull after error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:28:55 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:28:55.495161643Z" level=error msg="Handler for POST /v1.41/images/create returned error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:29:45 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:29:45.527535131Z" level=error msg="Not continuing with pull after error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:29:45 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:29:45.528967184Z" level=error msg="Handler for POST /v1.41/images/create returned error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:29:57 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:29:57.430527600Z" level=error msg="Not continuing with pull after error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:29:57 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:29:57.432158311Z" level=error msg="Handler for POST /v1.41/images/create returned error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:30:24 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:30:24.482182708Z" level=error msg="Not continuing with pull after error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:30:24 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:30:24.483471860Z" level=error msg="Handler for POST /v1.41/images/create returned error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:31:16 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:31:16.428323329Z" level=error msg="Not continuing with pull after error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:31:16 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:31:16.430000632Z" level=error msg="Handler for POST /v1.41/images/create returned error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:32:38 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:32:38.372830808Z" level=error msg="Not continuing with pull after error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:32:38 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:32:38.373973315Z" level=error msg="Handler for POST /v1.41/images/create returned error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	* 

	* ==> container status <==

	* CONTAINER           IMAGE               CREATED             STATE               NAME                      ATTEMPT             POD ID

	6d69afd52f8c3       3d174f00aa39e       10 minutes ago      Running             kube-apiserver            2                   d69f527d156d3

	83fc53fcb046e       3d174f00aa39e       10 minutes ago      Exited              kube-apiserver            1                   d69f527d156d3

	b2296fd0d1e96       6e38f40d628db       10 minutes ago      Running             storage-provisioner       2                   5e308be60a59b

	fd440add28af1       296a6d5035e2d       10 minutes ago      Running             coredns                   1                   f50593e11ff51

	702cee73a40cb       6be0dc1302e30       10 minutes ago      Running             kube-scheduler            1                   07d2de00a97f8

	48d06bb7b7911       0369cf4303ffd       10 minutes ago      Running             etcd                      1                   d8b864d434486

	aca358fec1904       bc2bb319a7038       10 minutes ago      Running             kube-controller-manager   1                   bd0a7904b87eb

	a4dbf0c14cf56       adb2816ea823a       10 minutes ago      Running             kube-proxy                1                   d1f104a42b8d8

	c9cb7d5809d85       6e38f40d628db       11 minutes ago      Exited              storage-provisioner       1                   cb9e8762e065a

	137cc83770ffa       296a6d5035e2d       11 minutes ago      Exited              coredns                   0                   d982e81551e90

	0237d371d3915       adb2816ea823a       11 minutes ago      Exited              kube-proxy                0                   467412a75d204

	52fbb2e72ccff       0369cf4303ffd       12 minutes ago      Exited              etcd                      0                   474f32a18e0ee

	9d5404187c668       6be0dc1302e30       12 minutes ago      Exited              kube-scheduler            0                   58a9c2f987638

	60451e7f160dd       bc2bb319a7038       12 minutes ago      Exited              kube-controller-manager   0                   2ec83ef7b8893

	* 

	* ==> coredns [137cc83770ff] <==

	* [INFO] plugin/ready: Still waiting on: "kubernetes"

	.:53

	[INFO] plugin/reload: Running configuration MD5 = db32ca3650231d74073ff4cf814959a7

	CoreDNS-1.8.0

	linux/amd64, go1.15.3, 054c9ae

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] Reloading

	[INFO] plugin/health: Going into lameduck mode for 5s

	[INFO] plugin/reload: Running configuration MD5 = c23ed519c17e71ee396ed052e6209e94

	[INFO] Reloading complete

	[INFO] SIGTERM: Shutting down servers then terminating

	[INFO] plugin/health: Going into lameduck mode for 5s

	I0813 20:21:20.439318       1 trace.go:205] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156 (13-Aug-2021 20:20:50.459) (total time: 30000ms):

	Trace[2019727887]: [30.000959061s] [30.000959061s] END

	E0813 20:21:20.439385       1 reflector.go:127] pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156: Failed to watch *v1.Endpoints: failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	I0813 20:21:20.439327       1 trace.go:205] Trace[1427131847]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156 (13-Aug-2021 20:20:50.459) (total time: 30000ms):

	Trace[1427131847]: [30.00091098s] [30.00091098s] END

	E0813 20:21:20.439411       1 reflector.go:127] pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	I0813 20:21:20.439589       1 trace.go:205] Trace[911902081]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156 (13-Aug-2021 20:20:50.459) (total time: 30001ms):

	Trace[911902081]: [30.001246144s] [30.001246144s] END

	E0813 20:21:20.439637       1 reflector.go:127] pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156: Failed to watch *v1.Namespace: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	* 

	* ==> coredns [fd440add28af] <==

	* .:53

	[INFO] plugin/reload: Running configuration MD5 = c23ed519c17e71ee396ed052e6209e94

	CoreDNS-1.8.0

	linux/amd64, go1.15.3, 054c9ae

	* 

	* ==> describe nodes <==

	* Name:               functional-20210813131926-8053

	Roles:              control-plane,master

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=functional-20210813131926-8053

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=852050cf77fe767e86d5a194bb91c06c4dc6c13c

	                    minikube.k8s.io/name=functional-20210813131926-8053

	                    minikube.k8s.io/updated_at=2021_08_13T13_20_35_0700

	                    minikube.k8s.io/version=v1.22.0

	                    node-role.kubernetes.io/control-plane=

	                    node-role.kubernetes.io/master=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /var/run/dockershim.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Fri, 13 Aug 2021 20:20:34 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  functional-20210813131926-8053

	  AcquireTime:     <unset>

	  RenewTime:       Fri, 13 Aug 2021 20:32:42 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Fri, 13 Aug 2021 20:32:42 +0000   Fri, 13 Aug 2021 20:20:34 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Fri, 13 Aug 2021 20:32:42 +0000   Fri, 13 Aug 2021 20:20:34 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Fri, 13 Aug 2021 20:32:42 +0000   Fri, 13 Aug 2021 20:20:34 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Fri, 13 Aug 2021 20:32:42 +0000   Fri, 13 Aug 2021 20:22:41 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.49.2

	  Hostname:    functional-20210813131926-8053

	Capacity:

	  cpu:                6

	  ephemeral-storage:  123591232Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  memory:             6088600Ki

	  pods:               110

	Allocatable:

	  cpu:                6

	  ephemeral-storage:  123591232Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  memory:             6088600Ki

	  pods:               110

	System Info:

	  Machine ID:                 dfc5def84a78402c9caa00a7cad25a86

	  System UUID:                c2a53005-c520-4b31-be6f-0d97f1736775

	  Boot ID:                    9c1335d8-2b93-45e8-96a7-e09bd9b095e5

	  Kernel Version:             5.10.25-linuxkit

	  OS Image:                   Ubuntu 20.04.2 LTS

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  docker://20.10.8

	  Kubelet Version:            v1.21.3

	  Kube-Proxy Version:         v1.21.3

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (10 in total)

	  Namespace                   Name                                                      CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                                      ------------  ----------  ---------------  -------------  ---

	  default                     mysql-9bbbc5bbb-lshfp                                     600m (10%!)(MISSING)    700m (11%!)(MISSING)  512Mi (8%!)(MISSING)       700Mi (11%!)(MISSING)    9m52s

	  default                     nginx-svc                                                 0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         9m49s

	  default                     sp-pod                                                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m6s

	  kube-system                 coredns-558bd4d5db-rhdvr                                  100m (1%!)(MISSING)     0 (0%!)(MISSING)      70Mi (1%!)(MISSING)        170Mi (2%!)(MISSING)     12m

	  kube-system                 etcd-functional-20210813131926-8053                       100m (1%!)(MISSING)     0 (0%!)(MISSING)      100Mi (1%!)(MISSING)       0 (0%!)(MISSING)         12m

	  kube-system                 kube-apiserver-functional-20210813131926-8053             250m (4%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         10m

	  kube-system                 kube-controller-manager-functional-20210813131926-8053    200m (3%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         12m

	  kube-system                 kube-proxy-kv9mv                                          0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         12m

	  kube-system                 kube-scheduler-functional-20210813131926-8053             100m (1%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         12m

	  kube-system                 storage-provisioner                                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         11m

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests     Limits

	  --------           --------     ------

	  cpu                1350m (22%!)(MISSING)  700m (11%!)(MISSING)

	  memory             682Mi (11%!)(MISSING)  870Mi (14%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)       0 (0%!)(MISSING)

	  hugepages-1Gi      0 (0%!)(MISSING)       0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)       0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                From        Message

	  ----    ------                   ----               ----        -------

	  Normal  NodeHasNoDiskPressure    12m (x4 over 12m)  kubelet     Node functional-20210813131926-8053 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     12m (x4 over 12m)  kubelet     Node functional-20210813131926-8053 status is now: NodeHasSufficientPID

	  Normal  NodeHasSufficientMemory  12m (x5 over 12m)  kubelet     Node functional-20210813131926-8053 status is now: NodeHasSufficientMemory

	  Normal  Starting                 12m                kubelet     Starting kubelet.

	  Normal  NodeHasSufficientMemory  12m                kubelet     Node functional-20210813131926-8053 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    12m                kubelet     Node functional-20210813131926-8053 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     12m                kubelet     Node functional-20210813131926-8053 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  12m                kubelet     Updated Node Allocatable limit across pods

	  Normal  NodeReady                12m                kubelet     Node functional-20210813131926-8053 status is now: NodeReady

	  Normal  Starting                 11m                kube-proxy  Starting kube-proxy.

	  Normal  Starting                 10m                kube-proxy  Starting kube-proxy.

	  Normal  Starting                 10m                kubelet     Starting kubelet.

	  Normal  NodeHasSufficientMemory  10m                kubelet     Node functional-20210813131926-8053 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    10m                kubelet     Node functional-20210813131926-8053 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     10m                kubelet     Node functional-20210813131926-8053 status is now: NodeHasSufficientPID

	  Normal  NodeNotReady             10m                kubelet     Node functional-20210813131926-8053 status is now: NodeNotReady

	  Normal  NodeAllocatableEnforced  10m                kubelet     Updated Node Allocatable limit across pods

	  Normal  NodeReady                10m                kubelet     Node functional-20210813131926-8053 status is now: NodeReady

	* 

	* ==> dmesg <==

	* [  +0.023734] bpfilter: write fail -32

	[  +7.626370] bpfilter: write fail -32

	[  +0.021701] bpfilter: read fail 0

	[  +0.027881] bpfilter: read fail 0

	[ +22.233286] bpfilter: write fail -32

	[  +0.027488] bpfilter: read fail 0

	[  +0.039804] bpfilter: read fail 0

	[Aug13 20:31] bpfilter: read fail 0

	[  +0.038687] bpfilter: read fail 0

	[  +0.035396] bpfilter: read fail 0

	[  +0.024146] bpfilter: write fail -32

	[  +7.622850] bpfilter: read fail 0

	[  +0.029637] bpfilter: read fail 0

	[  +0.027254] bpfilter: write fail -32

	[ +22.224221] bpfilter: write fail -32

	[  +0.046221] bpfilter: read fail 0

	[  +0.035840] bpfilter: write fail -32

	[Aug13 20:32] bpfilter: write fail -32

	[  +0.049394] bpfilter: write fail -32

	[  +7.670113] bpfilter: write fail -32

	[  +0.036921] bpfilter: read fail 0

	[  +0.026291] bpfilter: read fail 0

	[ +22.219038] bpfilter: write fail -32

	[  +0.033677] bpfilter: read fail 0

	[  +0.028038] bpfilter: write fail -32

	* 

	* ==> etcd [48d06bb7b791] <==

	* 2021-08-13 20:29:05.345715 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:29:15.345264 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:29:25.323792 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:29:35.324540 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:29:45.323926 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:29:55.302474 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:30:05.302850 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:30:15.301830 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:30:25.280676 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:30:35.281189 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:30:45.280793 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:30:55.263828 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:31:05.263873 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:31:15.264063 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:31:25.258600 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:31:35.258049 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:31:45.257394 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:31:55.237694 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:32:05.237978 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:32:15.238784 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:32:25.216857 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:32:35.216974 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:32:35.623551 I | mvcc: store.index: compact 904

	2021-08-13 20:32:35.624609 I | mvcc: finished scheduled compaction at 904 (took 537.61µs)

	2021-08-13 20:32:45.217826 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	* 

	* ==> etcd [52fbb2e72ccf] <==

	* raft2021/08/13 20:20:29 INFO: aec36adc501070cc is starting a new election at term 1

	raft2021/08/13 20:20:29 INFO: aec36adc501070cc became candidate at term 2

	raft2021/08/13 20:20:29 INFO: aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2

	raft2021/08/13 20:20:29 INFO: aec36adc501070cc became leader at term 2

	raft2021/08/13 20:20:29 INFO: raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2

	2021-08-13 20:20:29.449928 I | etcdserver: published {Name:functional-20210813131926-8053 ClientURLs:[https://192.168.49.2:2379]} to cluster fa54960ea34d58be

	2021-08-13 20:20:29.449956 I | embed: ready to serve client requests

	2021-08-13 20:20:29.450201 I | embed: ready to serve client requests

	2021-08-13 20:20:29.451895 I | embed: serving client requests on 192.168.49.2:2379

	2021-08-13 20:20:29.452662 I | etcdserver: setting up the initial cluster version to 3.4

	2021-08-13 20:20:29.453525 N | etcdserver/membership: set the initial cluster version to 3.4

	2021-08-13 20:20:29.453720 I | etcdserver/api: enabled capabilities for version 3.4

	2021-08-13 20:20:29.453832 I | embed: serving client requests on 127.0.0.1:2379

	2021-08-13 20:20:40.277076 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:20:48.493155 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:20:50.276798 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:21:00.256457 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:21:10.255657 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:21:20.255420 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:21:30.234727 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:21:40.237560 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:21:50.233853 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:21:59.424601 N | pkg/osutil: received terminated signal, shutting down...

	WARNING: 2021/08/13 20:21:59 grpc: addrConn.createTransport failed to connect to {127.0.0.1:2379  <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...

	2021-08-13 20:21:59.469510 I | etcdserver: skipped leadership transfer for single voting member cluster

	* 

	* ==> kernel <==

	*  20:32:49 up 18 min,  0 users,  load average: 0.10, 0.30, 0.44

	Linux functional-20210813131926-8053 5.10.25-linuxkit #1 SMP Tue Mar 23 09:27:39 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux

	PRETTY_NAME="Ubuntu 20.04.2 LTS"

	* 

	* ==> kube-apiserver [6d69afd52f8c] <==

	* I0813 20:27:24.487443       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	I0813 20:27:55.659438       1 client.go:360] parsed scheme: "passthrough"

	I0813 20:27:55.659562       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I0813 20:27:55.659586       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	I0813 20:28:37.647723       1 client.go:360] parsed scheme: "passthrough"

	I0813 20:28:37.647830       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I0813 20:28:37.647840       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	I0813 20:29:11.752795       1 client.go:360] parsed scheme: "passthrough"

	I0813 20:29:11.752879       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I0813 20:29:11.752944       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	I0813 20:29:45.073467       1 client.go:360] parsed scheme: "passthrough"

	I0813 20:29:45.073550       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I0813 20:29:45.073561       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	I0813 20:30:28.829667       1 client.go:360] parsed scheme: "passthrough"

	I0813 20:30:28.829779       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I0813 20:30:28.829800       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	I0813 20:31:02.238141       1 client.go:360] parsed scheme: "passthrough"

	I0813 20:31:02.238294       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I0813 20:31:02.238319       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	I0813 20:31:43.909829       1 client.go:360] parsed scheme: "passthrough"

	I0813 20:31:43.909908       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I0813 20:31:43.909918       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	I0813 20:32:19.339052       1 client.go:360] parsed scheme: "passthrough"

	I0813 20:32:19.339095       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I0813 20:32:19.339181       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	* 

	* ==> kube-apiserver [83fc53fcb046] <==

	* Flag --insecure-port has been deprecated, This flag has no effect now and will be removed in v1.24.

	I0813 20:22:16.559861       1 server.go:629] external host was not specified, using 192.168.49.2

	I0813 20:22:16.560215       1 server.go:181] Version: v1.21.3

	Error: failed to create listener: failed to listen on 0.0.0.0:8441: listen tcp 0.0.0.0:8441: bind: address already in use

	* 

	* ==> kube-controller-manager [60451e7f160d] <==

	* I0813 20:20:48.273552       1 shared_informer.go:247] Caches are synced for job 

	I0813 20:20:48.282298       1 shared_informer.go:247] Caches are synced for deployment 

	I0813 20:20:48.293694       1 shared_informer.go:247] Caches are synced for endpoint 

	I0813 20:20:48.305431       1 shared_informer.go:247] Caches are synced for persistent volume 

	I0813 20:20:48.305477       1 shared_informer.go:247] Caches are synced for ReplicaSet 

	I0813 20:20:48.306702       1 shared_informer.go:247] Caches are synced for PVC protection 

	I0813 20:20:48.306734       1 shared_informer.go:247] Caches are synced for daemon sets 

	I0813 20:20:48.306739       1 shared_informer.go:247] Caches are synced for ReplicationController 

	I0813 20:20:48.354976       1 shared_informer.go:247] Caches are synced for taint 

	I0813 20:20:48.355035       1 node_lifecycle_controller.go:1398] Initializing eviction metric for zone: 

	W0813 20:20:48.355070       1 node_lifecycle_controller.go:1013] Missing timestamp for Node functional-20210813131926-8053. Assuming now as a timestamp.

	I0813 20:20:48.355090       1 node_lifecycle_controller.go:1214] Controller detected that zone  is now in state Normal.

	I0813 20:20:48.355287       1 taint_manager.go:187] "Starting NoExecuteTaintManager"

	I0813 20:20:48.355539       1 event.go:291] "Event occurred" object="functional-20210813131926-8053" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node functional-20210813131926-8053 event: Registered Node functional-20210813131926-8053 in Controller"

	I0813 20:20:48.363710       1 shared_informer.go:247] Caches are synced for resource quota 

	I0813 20:20:48.459455       1 shared_informer.go:247] Caches are synced for resource quota 

	I0813 20:20:48.813595       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-558bd4d5db to 2"

	I0813 20:20:48.865824       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-558bd4d5db to 1"

	I0813 20:20:48.867323       1 shared_informer.go:247] Caches are synced for garbage collector 

	I0813 20:20:48.867334       1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage

	I0813 20:20:48.878039       1 shared_informer.go:247] Caches are synced for garbage collector 

	I0813 20:20:48.914893       1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-kv9mv"

	I0813 20:20:49.013282       1 event.go:291] "Event occurred" object="kube-system/coredns-558bd4d5db" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-558bd4d5db-v2mbz"

	I0813 20:20:49.019258       1 event.go:291] "Event occurred" object="kube-system/coredns-558bd4d5db" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-558bd4d5db-rhdvr"

	I0813 20:20:49.030463       1 event.go:291] "Event occurred" object="kube-system/coredns-558bd4d5db" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-558bd4d5db-v2mbz"

	* 

	* ==> kube-controller-manager [aca358fec190] <==

	* I0813 20:22:39.381011       1 shared_informer.go:247] Caches are synced for persistent volume 

	I0813 20:22:39.382157       1 shared_informer.go:247] Caches are synced for endpoint_slice 

	I0813 20:22:39.385673       1 shared_informer.go:247] Caches are synced for daemon sets 

	I0813 20:22:39.385742       1 shared_informer.go:247] Caches are synced for TTL 

	I0813 20:22:39.392583       1 shared_informer.go:247] Caches are synced for disruption 

	I0813 20:22:39.392613       1 disruption.go:371] Sending events to api server.

	I0813 20:22:39.470556       1 shared_informer.go:247] Caches are synced for attach detach 

	I0813 20:22:39.502015       1 shared_informer.go:247] Caches are synced for resource quota 

	I0813 20:22:39.578946       1 shared_informer.go:247] Caches are synced for taint 

	I0813 20:22:39.579027       1 node_lifecycle_controller.go:1398] Initializing eviction metric for zone: 

	W0813 20:22:39.579072       1 node_lifecycle_controller.go:1013] Missing timestamp for Node functional-20210813131926-8053. Assuming now as a timestamp.

	I0813 20:22:39.579127       1 node_lifecycle_controller.go:1164] Controller detected that all Nodes are not-Ready. Entering master disruption mode.

	I0813 20:22:39.579329       1 taint_manager.go:187] "Starting NoExecuteTaintManager"

	I0813 20:22:39.579508       1 event.go:291] "Event occurred" object="functional-20210813131926-8053" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node functional-20210813131926-8053 event: Registered Node functional-20210813131926-8053 in Controller"

	I0813 20:22:39.585516       1 event.go:291] "Event occurred" object="kube-system/coredns-558bd4d5db-rhdvr" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"

	I0813 20:22:39.587057       1 event.go:291] "Event occurred" object="kube-system/kube-proxy-kv9mv" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"

	I0813 20:22:39.594768       1 shared_informer.go:247] Caches are synced for resource quota 

	I0813 20:22:39.960552       1 shared_informer.go:247] Caches are synced for garbage collector 

	I0813 20:22:39.960608       1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage

	I0813 20:22:40.005112       1 shared_informer.go:247] Caches are synced for garbage collector 

	I0813 20:22:44.579703       1 node_lifecycle_controller.go:1191] Controller detected that some Nodes are Ready. Exiting master disruption mode.

	I0813 20:22:57.981698       1 event.go:291] "Event occurred" object="default/mysql" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set mysql-9bbbc5bbb to 1"

	I0813 20:22:57.989664       1 event.go:291] "Event occurred" object="default/mysql-9bbbc5bbb" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: mysql-9bbbc5bbb-lshfp"

	I0813 20:29:43.578145       1 event.go:291] "Event occurred" object="default/myclaim" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="waiting for a volume to be created, either by external provisioner \"k8s.io/minikube-hostpath\" or manually created by system administrator"

	I0813 20:29:43.578196       1 event.go:291] "Event occurred" object="default/myclaim" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="waiting for a volume to be created, either by external provisioner \"k8s.io/minikube-hostpath\" or manually created by system administrator"

	* 

	* ==> kube-proxy [0237d371d391] <==

	* I0813 20:20:49.964466       1 node.go:172] Successfully retrieved node IP: 192.168.49.2

	I0813 20:20:49.964521       1 server_others.go:140] Detected node IP 192.168.49.2

	W0813 20:20:49.964567       1 server_others.go:598] Unknown proxy mode "", assuming iptables proxy

	I0813 20:20:52.244100       1 server_others.go:206] kube-proxy running in dual-stack mode, IPv4-primary

	I0813 20:20:52.244135       1 server_others.go:212] Using iptables Proxier.

	I0813 20:20:52.244143       1 server_others.go:219] creating dualStackProxier for iptables.

	W0813 20:20:52.244150       1 server_others.go:512] detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6

	I0813 20:20:52.244421       1 server.go:643] Version: v1.21.3

	I0813 20:20:52.244978       1 config.go:315] Starting service config controller

	I0813 20:20:52.245004       1 shared_informer.go:240] Waiting for caches to sync for service config

	I0813 20:20:52.245304       1 config.go:224] Starting endpoint slice config controller

	I0813 20:20:52.245329       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config

	W0813 20:20:52.248097       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	W0813 20:20:52.249674       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	I0813 20:20:52.345268       1 shared_informer.go:247] Caches are synced for service config 

	I0813 20:20:52.346418       1 shared_informer.go:247] Caches are synced for endpoint slice config 

	I0813 20:21:06.307240       1 trace.go:205] Trace[128053735]: "iptables restore" (13-Aug-2021 20:21:04.237) (total time: 2070ms):

	Trace[128053735]: [2.070087345s] [2.070087345s] END

	I0813 20:21:16.207178       1 trace.go:205] Trace[1148819465]: "iptables restore" (13-Aug-2021 20:21:14.011) (total time: 2195ms):

	Trace[1148819465]: [2.195338087s] [2.195338087s] END

	I0813 20:21:39.273178       1 trace.go:205] Trace[1324115582]: "iptables restore" (13-Aug-2021 20:21:36.931) (total time: 2341ms):

	Trace[1324115582]: [2.341227915s] [2.341227915s] END

	* 

	* ==> kube-proxy [a4dbf0c14cf5] <==

	* I0813 20:22:04.765017       1 server_others.go:140] Detected node IP 192.168.49.2

	W0813 20:22:04.765060       1 server_others.go:598] Unknown proxy mode "", assuming iptables proxy

	I0813 20:22:07.101758       1 server_others.go:206] kube-proxy running in dual-stack mode, IPv4-primary

	I0813 20:22:07.101850       1 server_others.go:212] Using iptables Proxier.

	I0813 20:22:07.101859       1 server_others.go:219] creating dualStackProxier for iptables.

	W0813 20:22:07.101866       1 server_others.go:512] detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6

	I0813 20:22:07.102184       1 server.go:643] Version: v1.21.3

	I0813 20:22:07.102649       1 config.go:224] Starting endpoint slice config controller

	I0813 20:22:07.102742       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config

	I0813 20:22:07.102831       1 config.go:315] Starting service config controller

	I0813 20:22:07.102858       1 shared_informer.go:240] Waiting for caches to sync for service config

	W0813 20:22:07.108215       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	W0813 20:22:07.108883       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	I0813 20:22:07.203497       1 shared_informer.go:247] Caches are synced for endpoint slice config 

	I0813 20:22:07.203527       1 shared_informer.go:247] Caches are synced for service config 

	W0813 20:22:46.682122       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	I0813 20:22:49.877698       1 trace.go:205] Trace[478025731]: "iptables restore" (13-Aug-2021 20:22:47.667) (total time: 2210ms):

	Trace[478025731]: [2.210559754s] [2.210559754s] END

	I0813 20:23:00.966502       1 trace.go:205] Trace[2044389093]: "iptables restore" (13-Aug-2021 20:22:58.326) (total time: 2639ms):

	Trace[2044389093]: [2.639728438s] [2.639728438s] END

	I0813 20:23:10.121891       1 trace.go:205] Trace[1905563068]: "iptables restore" (13-Aug-2021 20:23:08.026) (total time: 2094ms):

	Trace[1905563068]: [2.094948379s] [2.094948379s] END

	I0813 20:23:19.793687       1 trace.go:205] Trace[988007401]: "iptables restore" (13-Aug-2021 20:23:17.584) (total time: 2208ms):

	Trace[988007401]: [2.208915023s] [2.208915023s] END

	W0813 20:32:03.297922       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	* 

	* ==> kube-scheduler [702cee73a40c] <==

	* I0813 20:22:01.509672       1 serving.go:347] Generated self-signed cert in-memory

	W0813 20:22:04.723419       1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'

	W0813 20:22:04.723453       1 authentication.go:337] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"

	W0813 20:22:04.723459       1 authentication.go:338] Continuing without authentication configuration. This may treat all requests as anonymous.

	W0813 20:22:04.723462       1 authentication.go:339] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false

	I0813 20:22:04.775715       1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0813 20:22:04.775753       1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0813 20:22:04.775897       1 secure_serving.go:197] Serving securely on 127.0.0.1:10259

	I0813 20:22:04.775954       1 tlsconfig.go:240] Starting DynamicServingCertificateController

	I0813 20:22:04.876958       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 

	* 

	* ==> kube-scheduler [9d5404187c66] <==

	* W0813 20:20:32.597185       1 authentication.go:337] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"

	W0813 20:20:32.597203       1 authentication.go:338] Continuing without authentication configuration. This may treat all requests as anonymous.

	W0813 20:20:32.597209       1 authentication.go:339] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false

	I0813 20:20:32.636201       1 secure_serving.go:197] Serving securely on 127.0.0.1:10259

	I0813 20:20:32.636276       1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0813 20:20:32.636280       1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0813 20:20:32.636287       1 tlsconfig.go:240] Starting DynamicServingCertificateController

	E0813 20:20:32.638772       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0813 20:20:32.639124       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0813 20:20:32.639163       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0813 20:20:32.639717       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0813 20:20:32.639970       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0813 20:20:32.639991       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0813 20:20:32.639972       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0813 20:20:32.640465       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.CSIStorageCapacity: failed to list *v1beta1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0813 20:20:32.640478       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E0813 20:20:32.641351       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0813 20:20:32.641376       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E0813 20:20:32.641817       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E0813 20:20:32.642227       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0813 20:20:32.643414       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0813 20:20:33.468213       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0813 20:20:33.582738       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0813 20:20:33.719031       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	I0813 20:20:33.936406       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 

	* 

	* ==> kubelet <==

	* -- Logs begin at Fri 2021-08-13 20:19:47 UTC, end at Fri 2021-08-13 20:32:50 UTC. --

	Aug 13 20:31:25 functional-20210813131926-8053 kubelet[6370]: E0813 20:31:25.227566    6370 pod_workers.go:190] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nginx\" with ImagePullBackOff: \"Back-off pulling image \\\"nginx:alpine\\\"\"" pod="default/nginx-svc" podUID=071bcc6b-e1dc-45aa-9126-fc27c1021b6b

	Aug 13 20:31:29 functional-20210813131926-8053 kubelet[6370]: E0813 20:31:29.227935    6370 pod_workers.go:190] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mysql\" with ImagePullBackOff: \"Back-off pulling image \\\"mysql:5.7\\\"\"" pod="default/mysql-9bbbc5bbb-lshfp" podUID=70efc65e-2c48-4fca-a41d-dd89eab324d3

	Aug 13 20:31:30 functional-20210813131926-8053 kubelet[6370]: E0813 20:31:30.228535    6370 pod_workers.go:190] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"myfrontend\" with ImagePullBackOff: \"Back-off pulling image \\\"nginx\\\"\"" pod="default/sp-pod" podUID=f8a642d9-155f-43e2-a275-0270f2d99291

	Aug 13 20:31:38 functional-20210813131926-8053 kubelet[6370]: E0813 20:31:38.225742    6370 pod_workers.go:190] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nginx\" with ImagePullBackOff: \"Back-off pulling image \\\"nginx:alpine\\\"\"" pod="default/nginx-svc" podUID=071bcc6b-e1dc-45aa-9126-fc27c1021b6b

	Aug 13 20:31:43 functional-20210813131926-8053 kubelet[6370]: E0813 20:31:43.226364    6370 pod_workers.go:190] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mysql\" with ImagePullBackOff: \"Back-off pulling image \\\"mysql:5.7\\\"\"" pod="default/mysql-9bbbc5bbb-lshfp" podUID=70efc65e-2c48-4fca-a41d-dd89eab324d3

	Aug 13 20:31:45 functional-20210813131926-8053 kubelet[6370]: E0813 20:31:45.227850    6370 pod_workers.go:190] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"myfrontend\" with ImagePullBackOff: \"Back-off pulling image \\\"nginx\\\"\"" pod="default/sp-pod" podUID=f8a642d9-155f-43e2-a275-0270f2d99291

	Aug 13 20:31:53 functional-20210813131926-8053 kubelet[6370]: E0813 20:31:53.207576    6370 pod_workers.go:190] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nginx\" with ImagePullBackOff: \"Back-off pulling image \\\"nginx:alpine\\\"\"" pod="default/nginx-svc" podUID=071bcc6b-e1dc-45aa-9126-fc27c1021b6b

	Aug 13 20:31:54 functional-20210813131926-8053 kubelet[6370]: E0813 20:31:54.208001    6370 pod_workers.go:190] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mysql\" with ImagePullBackOff: \"Back-off pulling image \\\"mysql:5.7\\\"\"" pod="default/mysql-9bbbc5bbb-lshfp" podUID=70efc65e-2c48-4fca-a41d-dd89eab324d3

	Aug 13 20:32:00 functional-20210813131926-8053 kubelet[6370]: E0813 20:32:00.207905    6370 pod_workers.go:190] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"myfrontend\" with ImagePullBackOff: \"Back-off pulling image \\\"nginx\\\"\"" pod="default/sp-pod" podUID=f8a642d9-155f-43e2-a275-0270f2d99291

	Aug 13 20:32:07 functional-20210813131926-8053 kubelet[6370]: E0813 20:32:07.206871    6370 pod_workers.go:190] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nginx\" with ImagePullBackOff: \"Back-off pulling image \\\"nginx:alpine\\\"\"" pod="default/nginx-svc" podUID=071bcc6b-e1dc-45aa-9126-fc27c1021b6b

	Aug 13 20:32:09 functional-20210813131926-8053 kubelet[6370]: E0813 20:32:09.208111    6370 pod_workers.go:190] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mysql\" with ImagePullBackOff: \"Back-off pulling image \\\"mysql:5.7\\\"\"" pod="default/mysql-9bbbc5bbb-lshfp" podUID=70efc65e-2c48-4fca-a41d-dd89eab324d3

	Aug 13 20:32:10 functional-20210813131926-8053 kubelet[6370]: W0813 20:32:10.713255    6370 sysinfo.go:203] Nodes topology is not available, providing CPU topology

	Aug 13 20:32:14 functional-20210813131926-8053 kubelet[6370]: E0813 20:32:14.209168    6370 pod_workers.go:190] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"myfrontend\" with ImagePullBackOff: \"Back-off pulling image \\\"nginx\\\"\"" pod="default/sp-pod" podUID=f8a642d9-155f-43e2-a275-0270f2d99291

	Aug 13 20:32:19 functional-20210813131926-8053 kubelet[6370]: E0813 20:32:19.207550    6370 pod_workers.go:190] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nginx\" with ImagePullBackOff: \"Back-off pulling image \\\"nginx:alpine\\\"\"" pod="default/nginx-svc" podUID=071bcc6b-e1dc-45aa-9126-fc27c1021b6b

	Aug 13 20:32:21 functional-20210813131926-8053 kubelet[6370]: E0813 20:32:21.185777    6370 pod_workers.go:190] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mysql\" with ImagePullBackOff: \"Back-off pulling image \\\"mysql:5.7\\\"\"" pod="default/mysql-9bbbc5bbb-lshfp" podUID=70efc65e-2c48-4fca-a41d-dd89eab324d3

	Aug 13 20:32:26 functional-20210813131926-8053 kubelet[6370]: E0813 20:32:26.186687    6370 pod_workers.go:190] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"myfrontend\" with ImagePullBackOff: \"Back-off pulling image \\\"nginx\\\"\"" pod="default/sp-pod" podUID=f8a642d9-155f-43e2-a275-0270f2d99291

	Aug 13 20:32:30 functional-20210813131926-8053 kubelet[6370]: E0813 20:32:30.187114    6370 pod_workers.go:190] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nginx\" with ImagePullBackOff: \"Back-off pulling image \\\"nginx:alpine\\\"\"" pod="default/nginx-svc" podUID=071bcc6b-e1dc-45aa-9126-fc27c1021b6b

	Aug 13 20:32:35 functional-20210813131926-8053 kubelet[6370]: E0813 20:32:35.187203    6370 pod_workers.go:190] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mysql\" with ImagePullBackOff: \"Back-off pulling image \\\"mysql:5.7\\\"\"" pod="default/mysql-9bbbc5bbb-lshfp" podUID=70efc65e-2c48-4fca-a41d-dd89eab324d3

	Aug 13 20:32:38 functional-20210813131926-8053 kubelet[6370]: E0813 20:32:38.374395    6370 remote_image.go:114] "PullImage from image service failed" err="rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit" image="nginx:latest"

	Aug 13 20:32:38 functional-20210813131926-8053 kubelet[6370]: E0813 20:32:38.374460    6370 kuberuntime_image.go:51] "Failed to pull image" err="rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit" image="nginx:latest"

	Aug 13 20:32:38 functional-20210813131926-8053 kubelet[6370]: E0813 20:32:38.374532    6370 kuberuntime_manager.go:864] container &Container{Name:myfrontend,Image:nginx,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:mypd,ReadOnly:false,MountPath:/tmp/mount,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:kube-api-access-plv7j,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,} start failed in pod sp-pod_default(f8a642d9-155f-43e2-a275-0270f2d99291): ErrImagePull: rpc error: code = Unknown desc = Error re

sponse from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit

	Aug 13 20:32:38 functional-20210813131926-8053 kubelet[6370]: E0813 20:32:38.374559    6370 pod_workers.go:190] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"myfrontend\" with ErrImagePull: \"rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit\"" pod="default/sp-pod" podUID=f8a642d9-155f-43e2-a275-0270f2d99291

	Aug 13 20:32:41 functional-20210813131926-8053 kubelet[6370]: E0813 20:32:41.186935    6370 pod_workers.go:190] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nginx\" with ImagePullBackOff: \"Back-off pulling image \\\"nginx:alpine\\\"\"" pod="default/nginx-svc" podUID=071bcc6b-e1dc-45aa-9126-fc27c1021b6b

	Aug 13 20:32:49 functional-20210813131926-8053 kubelet[6370]: E0813 20:32:49.186158    6370 pod_workers.go:190] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"myfrontend\" with ImagePullBackOff: \"Back-off pulling image \\\"nginx\\\"\"" pod="default/sp-pod" podUID=f8a642d9-155f-43e2-a275-0270f2d99291

	Aug 13 20:32:50 functional-20210813131926-8053 kubelet[6370]: E0813 20:32:50.165173    6370 pod_workers.go:190] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mysql\" with ImagePullBackOff: \"Back-off pulling image \\\"mysql:5.7\\\"\"" pod="default/mysql-9bbbc5bbb-lshfp" podUID=70efc65e-2c48-4fca-a41d-dd89eab324d3

	* 

	* ==> storage-provisioner [b2296fd0d1e9] <==

	* I0813 20:22:16.010598       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0813 20:22:16.019564       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0813 20:22:16.019654       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	E0813 20:22:19.475117       1 leaderelection.go:325] error retrieving resource lock kube-system/k8s.io-minikube-hostpath: Get "https://10.96.0.1:443/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath": dial tcp 10.96.0.1:443: connect: connection refused

	E0813 20:22:23.712008       1 leaderelection.go:325] error retrieving resource lock kube-system/k8s.io-minikube-hostpath: Get "https://10.96.0.1:443/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath": dial tcp 10.96.0.1:443: connect: connection refused

	E0813 20:22:27.307605       1 leaderelection.go:325] error retrieving resource lock kube-system/k8s.io-minikube-hostpath: Get "https://10.96.0.1:443/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath": dial tcp 10.96.0.1:443: connect: connection refused

	E0813 20:22:30.359555       1 leaderelection.go:325] error retrieving resource lock kube-system/k8s.io-minikube-hostpath: Get "https://10.96.0.1:443/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath": dial tcp 10.96.0.1:443: connect: connection refused

	E0813 20:22:33.380137       1 leaderelection.go:325] error retrieving resource lock kube-system/k8s.io-minikube-hostpath: Get "https://10.96.0.1:443/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath": dial tcp 10.96.0.1:443: connect: connection refused

	I0813 20:22:38.347369       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0813 20:22:38.347493       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_functional-20210813131926-8053_281ee2df-bf55-432e-9ac9-afb821b0ef0f!

	I0813 20:22:38.347810       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"f3924885-42ee-4404-b92b-18e2b80efef1", APIVersion:"v1", ResourceVersion:"551", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' functional-20210813131926-8053_281ee2df-bf55-432e-9ac9-afb821b0ef0f became leader

	I0813 20:22:38.448501       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_functional-20210813131926-8053_281ee2df-bf55-432e-9ac9-afb821b0ef0f!

	I0813 20:29:43.578609       1 controller.go:1332] provision "default/myclaim" class "standard": started

	I0813 20:29:43.578718       1 storage_provisioner.go:61] Provisioning volume {&StorageClass{ObjectMeta:{standard    681645c7-4736-455d-aede-1399bb5408a9 449 0 2021-08-13 20:20:50 +0000 UTC <nil> <nil> map[addonmanager.kubernetes.io/mode:EnsureExists] map[kubectl.kubernetes.io/last-applied-configuration:{"apiVersion":"storage.k8s.io/v1","kind":"StorageClass","metadata":{"annotations":{"storageclass.kubernetes.io/is-default-class":"true"},"labels":{"addonmanager.kubernetes.io/mode":"EnsureExists"},"name":"standard"},"provisioner":"k8s.io/minikube-hostpath"}

	 storageclass.kubernetes.io/is-default-class:true] [] []  [{kubectl-client-side-apply Update storage.k8s.io/v1 2021-08-13 20:20:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubectl.kubernetes.io/last-applied-configuration":{},"f:storageclass.kubernetes.io/is-default-class":{}},"f:labels":{".":{},"f:addonmanager.kubernetes.io/mode":{}}},"f:provisioner":{},"f:reclaimPolicy":{},"f:volumeBindingMode":{}}}]},Provisioner:k8s.io/minikube-hostpath,Parameters:map[string]string{},ReclaimPolicy:*Delete,MountOptions:[],AllowVolumeExpansion:nil,VolumeBindingMode:*Immediate,AllowedTopologies:[]TopologySelectorTerm{},} pvc-3049133e-dcfb-4f13-8cfe-e5ce6120b54b &PersistentVolumeClaim{ObjectMeta:{myclaim  default  3049133e-dcfb-4f13-8cfe-e5ce6120b54b 1002 0 2021-08-13 20:29:43 +0000 UTC <nil> <nil> map[] map[kubectl.kubernetes.io/last-applied-configuration:{"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"name":"myclaim","namespace":"default"},"spec":{"accessModes":["Re

adWriteOnce"],"resources":{"requests":{"storage":"500Mi"}},"volumeMode":"Filesystem"}}

	 volume.beta.kubernetes.io/storage-provisioner:k8s.io/minikube-hostpath] [] [kubernetes.io/pvc-protection]  [{kube-controller-manager Update v1 2021-08-13 20:29:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:volume.beta.kubernetes.io/storage-provisioner":{}}}}} {kubectl-client-side-apply Update v1 2021-08-13 20:29:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubectl.kubernetes.io/last-applied-configuration":{}}},"f:spec":{"f:accessModes":{},"f:resources":{"f:requests":{".":{},"f:storage":{}}},"f:volumeMode":{}}}}]},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{524288000 0} {<nil>} 500Mi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*standard,VolumeMode:*Filesystem,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},},} nil} to /tmp/hostpath-provisioner/default/myclaim

	I0813 20:29:43.579047       1 controller.go:1439] provision "default/myclaim" class "standard": volume "pvc-3049133e-dcfb-4f13-8cfe-e5ce6120b54b" provisioned

	I0813 20:29:43.579149       1 controller.go:1456] provision "default/myclaim" class "standard": succeeded

	I0813 20:29:43.579174       1 volume_store.go:212] Trying to save persistentvolume "pvc-3049133e-dcfb-4f13-8cfe-e5ce6120b54b"

	I0813 20:29:43.579047       1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"myclaim", UID:"3049133e-dcfb-4f13-8cfe-e5ce6120b54b", APIVersion:"v1", ResourceVersion:"1002", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/myclaim"

	I0813 20:29:43.591663       1 volume_store.go:219] persistentvolume "pvc-3049133e-dcfb-4f13-8cfe-e5ce6120b54b" saved

	I0813 20:29:43.592021       1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"myclaim", UID:"3049133e-dcfb-4f13-8cfe-e5ce6120b54b", APIVersion:"v1", ResourceVersion:"1002", FieldPath:""}): type: 'Normal' reason: 'ProvisioningSucceeded' Successfully provisioned volume pvc-3049133e-dcfb-4f13-8cfe-e5ce6120b54b

	* 

	* ==> storage-provisioner [c9cb7d5809d8] <==

	* I0813 20:21:21.763366       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0813 20:21:21.770235       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0813 20:21:21.770261       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I0813 20:21:21.783492       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0813 20:21:21.783642       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_functional-20210813131926-8053_89caf2fd-c393-4aa5-aa11-ee255d4b4c7a!

	I0813 20:21:21.783642       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"f3924885-42ee-4404-b92b-18e2b80efef1", APIVersion:"v1", ResourceVersion:"479", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' functional-20210813131926-8053_89caf2fd-c393-4aa5-aa11-ee255d4b4c7a became leader

	I0813 20:21:21.885038       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_functional-20210813131926-8053_89caf2fd-c393-4aa5-aa11-ee255d4b4c7a!

-- /stdout --

helpers_test.go:255: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.APIServer}} -p functional-20210813131926-8053 -n functional-20210813131926-8053

helpers_test.go:262: (dbg) Run:  kubectl --context functional-20210813131926-8053 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:271: non-running pods: mysql-9bbbc5bbb-lshfp nginx-svc sp-pod

helpers_test.go:273: ======> post-mortem[TestFunctional/parallel/PersistentVolumeClaim]: describe non-running pods <======

helpers_test.go:276: (dbg) Run:  kubectl --context functional-20210813131926-8053 describe pod mysql-9bbbc5bbb-lshfp nginx-svc sp-pod

helpers_test.go:281: (dbg) kubectl --context functional-20210813131926-8053 describe pod mysql-9bbbc5bbb-lshfp nginx-svc sp-pod:

-- stdout --

	Name:         mysql-9bbbc5bbb-lshfp

	Namespace:    default

	Priority:     0

	Node:         functional-20210813131926-8053/192.168.49.2

	Start Time:   Fri, 13 Aug 2021 13:22:57 -0700

	Labels:       app=mysql

	              pod-template-hash=9bbbc5bbb

	Annotations:  <none>

	Status:       Pending

	IP:           172.17.0.3

	IPs:

	  IP:           172.17.0.3

	Controlled By:  ReplicaSet/mysql-9bbbc5bbb

	Containers:

	  mysql:

	    Container ID:   

	    Image:          mysql:5.7

	    Image ID:       

	    Port:           3306/TCP

	    Host Port:      0/TCP

	    State:          Waiting

	      Reason:       ImagePullBackOff

	    Ready:          False

	    Restart Count:  0

	    Limits:

	      cpu:     700m

	      memory:  700Mi

	    Requests:

	      cpu:     600m

	      memory:  512Mi

	    Environment:

	      MYSQL_ROOT_PASSWORD:  password

	    Mounts:

	      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-6qxs4 (ro)

	Conditions:

	  Type              Status

	  Initialized       True 

	  Ready             False 

	  ContainersReady   False 

	  PodScheduled      True 

	Volumes:

	  kube-api-access-6qxs4:

	    Type:                    Projected (a volume that contains injected data from multiple sources)

	    TokenExpirationSeconds:  3607

	    ConfigMapName:           kube-root-ca.crt

	    ConfigMapOptional:       <nil>

	    DownwardAPI:             true

	QoS Class:                   Burstable

	Node-Selectors:              <none>

	Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

	                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

	Events:

	  Type     Reason     Age                     From               Message

	  ----     ------     ----                    ----               -------

	  Normal   Scheduled  9m53s                   default-scheduler  Successfully assigned default/mysql-9bbbc5bbb-lshfp to functional-20210813131926-8053

	  Normal   Pulling    8m20s (x4 over 9m53s)   kubelet            Pulling image "mysql:5.7"

	  Warning  Failed     8m19s (x4 over 9m52s)   kubelet            Failed to pull image "mysql:5.7": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit

	  Warning  Failed     8m19s (x4 over 9m52s)   kubelet            Error: ErrImagePull

	  Warning  Failed     8m8s (x6 over 9m52s)    kubelet            Error: ImagePullBackOff

	  Normal   BackOff    4m47s (x20 over 9m52s)  kubelet            Back-off pulling image "mysql:5.7"

	Name:         nginx-svc

	Namespace:    default

	Priority:     0

	Node:         functional-20210813131926-8053/192.168.49.2

	Start Time:   Fri, 13 Aug 2021 13:23:00 -0700

	Labels:       run=nginx-svc

	Annotations:  <none>

	Status:       Pending

	IP:           172.17.0.4

	IPs:

	  IP:  172.17.0.4

	Containers:

	  nginx:

	    Container ID:   

	    Image:          nginx:alpine

	    Image ID:       

	    Port:           80/TCP

	    Host Port:      0/TCP

	    State:          Waiting

	      Reason:       ImagePullBackOff

	    Ready:          False

	    Restart Count:  0

	    Environment:    <none>

	    Mounts:

	      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-fzqr5 (ro)

	Conditions:

	  Type              Status

	  Initialized       True 

	  Ready             False 

	  ContainersReady   False 

	  PodScheduled      True 

	Volumes:

	  kube-api-access-fzqr5:

	    Type:                    Projected (a volume that contains injected data from multiple sources)

	    TokenExpirationSeconds:  3607

	    ConfigMapName:           kube-root-ca.crt

	    ConfigMapOptional:       <nil>

	    DownwardAPI:             true

	QoS Class:                   BestEffort

	Node-Selectors:              <none>

	Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

	                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

	Events:

	  Type     Reason     Age                     From               Message

	  ----     ------     ----                    ----               -------

	  Normal   Scheduled  9m50s                   default-scheduler  Successfully assigned default/nginx-svc to functional-20210813131926-8053

	  Normal   Pulling    8m23s (x4 over 9m50s)   kubelet            Pulling image "nginx:alpine"

	  Warning  Failed     8m22s (x4 over 9m49s)   kubelet            Failed to pull image "nginx:alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit

	  Warning  Failed     8m22s (x4 over 9m49s)   kubelet            Error: ErrImagePull

	  Warning  Failed     8m9s (x6 over 9m49s)    kubelet            Error: ImagePullBackOff

	  Normal   BackOff    4m50s (x21 over 9m49s)  kubelet            Back-off pulling image "nginx:alpine"

	Name:         sp-pod

	Namespace:    default

	Priority:     0

	Node:         functional-20210813131926-8053/192.168.49.2

	Start Time:   Fri, 13 Aug 2021 13:29:43 -0700

	Labels:       test=storage-provisioner

	Annotations:  <none>

	Status:       Pending

	IP:           172.17.0.5

	IPs:

	  IP:  172.17.0.5

	Containers:

	  myfrontend:

	    Container ID:   

	    Image:          nginx

	    Image ID:       

	    Port:           <none>

	    Host Port:      <none>

	    State:          Waiting

	      Reason:       ErrImagePull

	    Ready:          False

	    Restart Count:  0

	    Environment:    <none>

	    Mounts:

	      /tmp/mount from mypd (rw)

	      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-plv7j (ro)

	Conditions:

	  Type              Status

	  Initialized       True 

	  Ready             False 

	  ContainersReady   False 

	  PodScheduled      True 

	Volumes:

	  mypd:

	    Type:       PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)

	    ClaimName:  myclaim

	    ReadOnly:   false

	  kube-api-access-plv7j:

	    Type:                    Projected (a volume that contains injected data from multiple sources)

	    TokenExpirationSeconds:  3607

	    ConfigMapName:           kube-root-ca.crt

	    ConfigMapOptional:       <nil>

	    DownwardAPI:             true

	QoS Class:                   BestEffort

	Node-Selectors:              <none>

	Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

	                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

	Events:

	  Type     Reason     Age                 From               Message

	  ----     ------     ----                ----               -------

	  Normal   Scheduled  3m7s                default-scheduler  Successfully assigned default/sp-pod to functional-20210813131926-8053

	  Normal   Pulling    96s (x4 over 3m7s)  kubelet            Pulling image "nginx"

	  Warning  Failed     95s (x4 over 3m6s)  kubelet            Failed to pull image "nginx": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit

	  Warning  Failed     95s (x4 over 3m6s)  kubelet            Error: ErrImagePull

	  Warning  Failed     81s (x6 over 3m5s)  kubelet            Error: ImagePullBackOff

	  Normal   BackOff    66s (x7 over 3m5s)  kubelet            Back-off pulling image "nginx"

-- /stdout --

helpers_test.go:284: <<< TestFunctional/parallel/PersistentVolumeClaim FAILED: end of post-mortem logs <<<

helpers_test.go:285: ---------------------/post-mortem---------------------------------

--- FAIL: TestFunctional/parallel/PersistentVolumeClaim (193.31s)

=== RUN   TestFunctional/parallel/MySQL

=== PAUSE TestFunctional/parallel/MySQL

=== CONT  TestFunctional/parallel/MySQL

functional_test.go:1546: (dbg) Run:  kubectl --context functional-20210813131926-8053 replace --force -f testdata/mysql.yaml

functional_test.go:1551: (dbg) TestFunctional/parallel/MySQL: waiting 10m0s for pods matching "app=mysql" in namespace "default" ...

helpers_test.go:343: "mysql-9bbbc5bbb-lshfp" [70efc65e-2c48-4fca-a41d-dd89eab324d3] Pending

=== CONT  TestFunctional/parallel/MySQL

helpers_test.go:343: "mysql-9bbbc5bbb-lshfp" [70efc65e-2c48-4fca-a41d-dd89eab324d3] Pending / Ready:ContainersNotReady (containers with unready status: [mysql]) / ContainersReady:ContainersNotReady (containers with unready status: [mysql])

=== CONT  TestFunctional/parallel/MySQL

functional_test.go:1551: ***** TestFunctional/parallel/MySQL: pod "app=mysql" failed to start within 10m0s: timed out waiting for the condition ****

functional_test.go:1551: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.APIServer}} -p functional-20210813131926-8053 -n functional-20210813131926-8053

functional_test.go:1551: TestFunctional/parallel/MySQL: showing logs for failed pods as of 2021-08-13 13:32:58.695586 -0700 PDT m=+1102.528710217

functional_test.go:1551: (dbg) Run:  kubectl --context functional-20210813131926-8053 describe po mysql-9bbbc5bbb-lshfp -n default

functional_test.go:1551: (dbg) kubectl --context functional-20210813131926-8053 describe po mysql-9bbbc5bbb-lshfp -n default:

Name:         mysql-9bbbc5bbb-lshfp

Namespace:    default

Priority:     0

Node:         functional-20210813131926-8053/192.168.49.2

Start Time:   Fri, 13 Aug 2021 13:22:57 -0700

Labels:       app=mysql

pod-template-hash=9bbbc5bbb

Annotations:  <none>

Status:       Pending

IP:           172.17.0.3

IPs:

IP:           172.17.0.3

Controlled By:  ReplicaSet/mysql-9bbbc5bbb

Containers:

mysql:

Container ID:   

Image:          mysql:5.7

Image ID:       

Port:           3306/TCP

Host Port:      0/TCP

State:          Waiting

Reason:       ImagePullBackOff

Ready:          False

Restart Count:  0

Limits:

cpu:     700m

memory:  700Mi

Requests:

cpu:     600m

memory:  512Mi

Environment:

MYSQL_ROOT_PASSWORD:  password

Mounts:

/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-6qxs4 (ro)

Conditions:

Type              Status

Initialized       True 

Ready             False 

ContainersReady   False 

PodScheduled      True 

Volumes:

kube-api-access-6qxs4:

Type:                    Projected (a volume that contains injected data from multiple sources)

TokenExpirationSeconds:  3607

ConfigMapName:           kube-root-ca.crt

ConfigMapOptional:       <nil>

DownwardAPI:             true

QoS Class:                   Burstable

Node-Selectors:              <none>

Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

Events:

Type     Reason     Age                     From               Message

----     ------     ----                    ----               -------

Normal   Scheduled  10m                     default-scheduler  Successfully assigned default/mysql-9bbbc5bbb-lshfp to functional-20210813131926-8053

Normal   Pulling    8m27s (x4 over 10m)     kubelet            Pulling image "mysql:5.7"

Warning  Failed     8m26s (x4 over 9m59s)   kubelet            Failed to pull image "mysql:5.7": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit

Warning  Failed     8m26s (x4 over 9m59s)   kubelet            Error: ErrImagePull

Warning  Failed     8m15s (x6 over 9m59s)   kubelet            Error: ImagePullBackOff

Normal   BackOff    4m54s (x20 over 9m59s)  kubelet            Back-off pulling image "mysql:5.7"

functional_test.go:1551: (dbg) Run:  kubectl --context functional-20210813131926-8053 logs mysql-9bbbc5bbb-lshfp -n default

functional_test.go:1551: (dbg) Non-zero exit: kubectl --context functional-20210813131926-8053 logs mysql-9bbbc5bbb-lshfp -n default: exit status 1 (59.394065ms)

** stderr ** 

	Error from server (BadRequest): container "mysql" in pod "mysql-9bbbc5bbb-lshfp" is waiting to start: trying and failing to pull image

** /stderr **

functional_test.go:1551: kubectl --context functional-20210813131926-8053 logs mysql-9bbbc5bbb-lshfp -n default: exit status 1

functional_test.go:1553: failed waiting for mysql pod: app=mysql within 10m0s: timed out waiting for the condition

helpers_test.go:223: -----------------------post-mortem--------------------------------

helpers_test.go:231: ======>  post-mortem[TestFunctional/parallel/MySQL]: docker inspect <======

helpers_test.go:232: (dbg) Run:  docker inspect functional-20210813131926-8053

helpers_test.go:236: (dbg) docker inspect functional-20210813131926-8053:

-- stdout --

	[

	    {

	        "Id": "bd6d952ddeb5f310f9e68d0a941d3ceea9f8bcc59b82fe82663073652312e7bf",

	        "Created": "2021-08-13T20:19:33.443339625Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

	        ],

	        "State": {

	            "Status": "running",

	            "Running": true,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 19884,

	            "ExitCode": 0,

	            "Error": "",

	            "StartedAt": "2021-08-13T20:19:45.440445983Z",

	            "FinishedAt": "0001-01-01T00:00:00Z"

	        },

	        "Image": "sha256:965ebc74cb435c5d73c204fcd638e9daa526ad4ce3ec7f76be1149f30a789fab",

	        "ResolvConfPath": "/var/lib/docker/containers/bd6d952ddeb5f310f9e68d0a941d3ceea9f8bcc59b82fe82663073652312e7bf/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/bd6d952ddeb5f310f9e68d0a941d3ceea9f8bcc59b82fe82663073652312e7bf/hostname",

	        "HostsPath": "/var/lib/docker/containers/bd6d952ddeb5f310f9e68d0a941d3ceea9f8bcc59b82fe82663073652312e7bf/hosts",

	        "LogPath": "/var/lib/docker/containers/bd6d952ddeb5f310f9e68d0a941d3ceea9f8bcc59b82fe82663073652312e7bf/bd6d952ddeb5f310f9e68d0a941d3ceea9f8bcc59b82fe82663073652312e7bf-json.log",

	        "Name": "/functional-20210813131926-8053",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "/lib/modules:/lib/modules:ro",

	                "functional-20210813131926-8053:/var"

	            ],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

	            },

	            "NetworkMode": "functional-20210813131926-8053",

	            "PortBindings": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "8441/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ]

	            },

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

	            },

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "CapAdd": null,

	            "CapDrop": null,

	            "CgroupnsMode": "host",

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

	            ],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

	            },

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "ConsoleSize": [

	                0,

	                0

	            ],

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 4194304000,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": null,

	            "BlkioDeviceWriteBps": null,

	            "BlkioDeviceReadIOps": null,

	            "BlkioDeviceWriteIOps": null,

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "KernelMemory": 0,

	            "KernelMemoryTCP": 0,

	            "MemoryReservation": 0,

	            "MemorySwap": 4194304000,

	            "MemorySwappiness": null,

	            "OomKillDisable": false,

	            "PidsLimit": null,

	            "Ulimits": null,

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

	        },

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/3e4f101879c21cc86d3a345e84686ecfb0097ad0ef90e43949ac1917b277a31e-init/diff:/var/lib/docker/overlay2/b54d50d9722d23fb9637685b11892fb665fc20ba78ef431e07ed0ddfa868f7a1/diff:/var/lib/docker/overlay2/1ae49b54a8b23aaf60a7e9c9307ca333358576bae3a785f52751cdad083df982/diff:/var/lib/docker/overlay2/ea6c3052036e679f2d58c32269d4ea3143a3fc6f94abfc4e49173b050ea86a8b/diff:/var/lib/docker/overlay2/2a2dd58c96ee8d28d6328f3dc040dba105ab05a3a180db9efc72ab81c4f2dea8/diff:/var/lib/docker/overlay2/9b983e97e9a66172cc09d2798bfaa346d9fd6426e616339301e3bb8123e0e4f8/diff:/var/lib/docker/overlay2/dfeb06e54a5cea59763125a281a2a6800cd59c816b67601654af91996c53b0e9/diff:/var/lib/docker/overlay2/c9d50722d4822ee84b54a4086271aaa76449764ccee5cd9b3107efe20362db77/diff:/var/lib/docker/overlay2/7146eb1978a4f01c8661964f9a7e8e6900a73759e6d7f926784135a8c3675a0e/diff:/var/lib/docker/overlay2/6bcc532777a8b16bf0a8d49f5eba5dce2dad7acf9dd5d76a36fe91e4865df73c/diff:/var/lib/docker/overlay2/14de3b

84777e6d4bcd5b959be54fc67048ed8595b21548c2cb72c44e5bab5411/diff:/var/lib/docker/overlay2/f1ddefd3cddc8a76bb8102eba187352b3597d4a313ab8481788107dc17bb30be/diff:/var/lib/docker/overlay2/2be5ff1c0f18fc355d3d429c9a258aa1be9e5ebd0dd9b444f05aace4cc7acfea/diff:/var/lib/docker/overlay2/d1937ecc380ba5be5a64d9961a07aa0fa09d55136209e276d6ab5a08a2a5ce3c/diff:/var/lib/docker/overlay2/4b9bb8d1431c5ac321918e64797c008658b5e0db3587b9e7f484d00192b5a4be/diff:/var/lib/docker/overlay2/f9e7584420f2143a3affbe57ddd381ed9799067270b57d06e1af337987563637/diff:/var/lib/docker/overlay2/1ae74edd645de1296fe2ff40ac0d7659d56c4af7676d1e2b7077666f5cb598c4/diff:/var/lib/docker/overlay2/33df86dfa679c1be13df61855de34c224815a39320b3ee12131540df41ef4561/diff:/var/lib/docker/overlay2/eb8b1800e30954e5cf6fc67fbfa89db41d615ee50103aa0589446907b8c7ac49/diff:/var/lib/docker/overlay2/5c052f8924308a6f0fe3ae4941882e4b909ed1aeb01123b9e2faa7df2696de93/diff:/var/lib/docker/overlay2/69b433d87c6a506c3d510619bb41e8737b7e3d06bac5eb128be3e00efb740b98/diff:/var/lib/d

ocker/overlay2/c07998bd533865848849c722ed55cfa571f9562726f3fdb9bfd15f7b5936a8e6/diff:/var/lib/docker/overlay2/3df1a883fd0d44918646d29788faa76a5e7aaaf4b46a6ea2240c9d4b8bd4dc09/diff:/var/lib/docker/overlay2/9f2a07552f95e43119898b9bbe1e61d165ecd9eb3e862730a04a643bcc53a8c6/diff:/var/lib/docker/overlay2/fd2df25ca7e6b268f819b2fb38bbab50fbd5c6c8a4a2b4778f3917e567c64b8b/diff:/var/lib/docker/overlay2/a4639cb93382ebf39584a53948b6816dc6aa8e7011f2474b82320e09565c40ee/diff:/var/lib/docker/overlay2/16f320558e9c6c23b229f8b4dcf6f5c61670fa7b6513b707c1ceee8ff53ab012/diff:/var/lib/docker/overlay2/efde92a54c645d3d214babfea86fe173c88681a9a8bf1ee4c66f406eac0ce1f3/diff:/var/lib/docker/overlay2/67c175358f08a90e727cc2e59d3dc3f243bf98721348962ca80cedaa946e11e5/diff:/var/lib/docker/overlay2/abce6c2b52def112a2855b7240dfeb6e7ce8747ff80ae82b8c90df4358b5499f/diff:/var/lib/docker/overlay2/04adc9448565c768e00d76ed848aec196d92c4bcb1ba0268162b97accedfe7c0/diff:/var/lib/docker/overlay2/785c77e0f49a7d75d4a92bd8febab1b2a23633cd8c7be0e16fc628afb34

bcd83/diff:/var/lib/docker/overlay2/6716a51894c949d720d02845ebfc34f1d9f2431f04ffc2521d1b4fdf617ba172/diff:/var/lib/docker/overlay2/f7a3d7b89f4cc68fc5e0dd1756a2ae6260c2f0f5ab4bc40c3ce6b1b4d6ef0004/diff:/var/lib/docker/overlay2/91b9a991885a072e8afd1908c183be7e860cef03f6b3fbb173e06fdc90db2527/diff:/var/lib/docker/overlay2/8f4a011cc74f93ad854a02453507ef603a3da67ee7a766dfca38d3a46f5cdfb9/diff:/var/lib/docker/overlay2/b26e3ade0d328d23c224932591c878b90768d1c5e7058ccb26382021520bd343/diff",

	                "MergedDir": "/var/lib/docker/overlay2/3e4f101879c21cc86d3a345e84686ecfb0097ad0ef90e43949ac1917b277a31e/merged",

	                "UpperDir": "/var/lib/docker/overlay2/3e4f101879c21cc86d3a345e84686ecfb0097ad0ef90e43949ac1917b277a31e/diff",

	                "WorkDir": "/var/lib/docker/overlay2/3e4f101879c21cc86d3a345e84686ecfb0097ad0ef90e43949ac1917b277a31e/work"

	            },

	            "Name": "overlay2"

	        },

	        "Mounts": [

	            {

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

	            },

	            {

	                "Type": "volume",

	                "Name": "functional-20210813131926-8053",

	                "Source": "/var/lib/docker/volumes/functional-20210813131926-8053/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

	            }

	        ],

	        "Config": {

	            "Hostname": "functional-20210813131926-8053",

	            "Domainname": "",

	            "User": "root",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8441/tcp": {}

	            },

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

	            ],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6",

	            "Volumes": null,

	            "WorkingDir": "",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

	            ],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "functional-20210813131926-8053",

	                "name.minikube.sigs.k8s.io": "functional-20210813131926-8053",

	                "role.minikube.sigs.k8s.io": ""

	            },

	            "StopSignal": "SIGRTMIN+3"

	        },

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "fffc56d9ef4e71afae913f074fc77456290700b22c27c1f9874cc15c0358d2a3",

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "Ports": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "59731"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "59727"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "59728"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "59729"

	                    }

	                ],

	                "8441/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "59730"

	                    }

	                ]

	            },

	            "SandboxKey": "/var/run/docker/netns/fffc56d9ef4e",

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "functional-20210813131926-8053": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.49.2"

	                    },

	                    "Links": null,

	                    "Aliases": [

	                        "bd6d952ddeb5",

	                        "functional-20210813131926-8053"

	                    ],

	                    "NetworkID": "743ef3df7ddcc98a6822c8028d2b77ac28e2e76e3cc13ccd232db1d778dce820",

	                    "EndpointID": "9696b4dcace8ca7aad9efa41f1202a5fb2b54319373b4ef9628f151b3d732e54",

	                    "Gateway": "192.168.49.1",

	                    "IPAddress": "192.168.49.2",

	                    "IPPrefixLen": 24,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "MacAddress": "02:42:c0:a8:31:02",

	                    "DriverOpts": null

	                }

	            }

	        }

	    }

	]

-- /stdout --

helpers_test.go:240: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-20210813131926-8053 -n functional-20210813131926-8053

helpers_test.go:245: <<< TestFunctional/parallel/MySQL FAILED: start of post-mortem logs <<<

helpers_test.go:246: ======>  post-mortem[TestFunctional/parallel/MySQL]: minikube logs <======

helpers_test.go:248: (dbg) Run:  out/minikube-darwin-amd64 -p functional-20210813131926-8053 logs -n 25

helpers_test.go:248: (dbg) Done: out/minikube-darwin-amd64 -p functional-20210813131926-8053 logs -n 25: (3.112931283s)

helpers_test.go:253: TestFunctional/parallel/MySQL logs: 

-- stdout --

	* 

	* ==> Audit <==

	* |---------|---------------------------------------------------------------------------------------------------|--------------------------------|---------|---------|-------------------------------|-------------------------------|

	| Command |                                               Args                                                |            Profile             |  User   | Version |          Start Time           |           End Time            |

	|---------|---------------------------------------------------------------------------------------------------|--------------------------------|---------|---------|-------------------------------|-------------------------------|

	| cache   | list                                                                                              | minikube                       | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:48 PDT | Fri, 13 Aug 2021 13:21:48 PDT |

	| -p      | functional-20210813131926-8053                                                                    | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:48 PDT | Fri, 13 Aug 2021 13:21:49 PDT |

	|         | ssh sudo crictl images                                                                            |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                                                    | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:49 PDT | Fri, 13 Aug 2021 13:21:50 PDT |

	|         | ssh sudo docker rmi                                                                               |                                |         |         |                               |                               |

	|         | k8s.gcr.io/pause:latest                                                                           |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                                                    | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:50 PDT | Fri, 13 Aug 2021 13:21:52 PDT |

	|         | cache reload                                                                                      |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                                                    | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:52 PDT | Fri, 13 Aug 2021 13:21:53 PDT |

	|         | ssh sudo crictl inspecti                                                                          |                                |         |         |                               |                               |

	|         | k8s.gcr.io/pause:latest                                                                           |                                |         |         |                               |                               |

	| cache   | delete k8s.gcr.io/pause:3.1                                                                       | minikube                       | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:53 PDT | Fri, 13 Aug 2021 13:21:53 PDT |

	| cache   | delete k8s.gcr.io/pause:latest                                                                    | minikube                       | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:53 PDT | Fri, 13 Aug 2021 13:21:53 PDT |

	| -p      | functional-20210813131926-8053                                                                    | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:53 PDT | Fri, 13 Aug 2021 13:21:53 PDT |

	|         | kubectl -- --context                                                                              |                                |         |         |                               |                               |

	|         | functional-20210813131926-8053                                                                    |                                |         |         |                               |                               |

	|         | get pods                                                                                          |                                |         |         |                               |                               |

	| kubectl | --profile=functional-20210813131926-8053                                                          | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:21:54 PDT | Fri, 13 Aug 2021 13:21:54 PDT |

	|         | -- --context                                                                                      |                                |         |         |                               |                               |

	|         | functional-20210813131926-8053 get pods                                                           |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                                                    | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:22:41 PDT | Fri, 13 Aug 2021 13:22:45 PDT |

	|         | logs -n 25                                                                                        |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                                                    | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:22:46 PDT | Fri, 13 Aug 2021 13:22:49 PDT |

	|         | logs -n 25                                                                                        |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                                                    | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:22:50 PDT | Fri, 13 Aug 2021 13:22:54 PDT |

	|         | logs                                                                                              |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053 logs --file                                                        | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:22:54 PDT | Fri, 13 Aug 2021 13:22:57 PDT |

	|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/functional-20210813131926-8053467736887/logs.txt |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                                                    | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:22:57 PDT | Fri, 13 Aug 2021 13:22:57 PDT |

	|         | config unset cpus                                                                                 |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                                                    | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:22:57 PDT | Fri, 13 Aug 2021 13:22:57 PDT |

	|         | config set cpus 2                                                                                 |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                                                    | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:22:57 PDT | Fri, 13 Aug 2021 13:22:57 PDT |

	|         | config get cpus                                                                                   |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                                                    | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:22:57 PDT | Fri, 13 Aug 2021 13:22:57 PDT |

	|         | config unset cpus                                                                                 |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                                                    | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:22:57 PDT | Fri, 13 Aug 2021 13:22:58 PDT |

	|         | ssh sudo cat                                                                                      |                                |         |         |                               |                               |

	|         | /etc/test/nested/copy/8053/hosts                                                                  |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                                                    | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:22:58 PDT | Fri, 13 Aug 2021 13:22:58 PDT |

	|         | cp testdata/cp-test.txt                                                                           |                                |         |         |                               |                               |

	|         | /home/docker/cp-test.txt                                                                          |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                                                    | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:22:58 PDT | Fri, 13 Aug 2021 13:22:59 PDT |

	|         | ssh sudo cat                                                                                      |                                |         |         |                               |                               |

	|         | /home/docker/cp-test.txt                                                                          |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                                                    | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:22:59 PDT | Fri, 13 Aug 2021 13:22:59 PDT |

	|         | ssh echo hello                                                                                    |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                                                    | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:22:59 PDT | Fri, 13 Aug 2021 13:23:00 PDT |

	|         | ssh cat /etc/hostname                                                                             |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                                                    | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:32:47 PDT | Fri, 13 Aug 2021 13:32:50 PDT |

	|         | logs -n 25                                                                                        |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                                                    | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:32:51 PDT | Fri, 13 Aug 2021 13:32:51 PDT |

	|         | addons list                                                                                       |                                |         |         |                               |                               |

	| -p      | functional-20210813131926-8053                                                                    | functional-20210813131926-8053 | jenkins | v1.22.0 | Fri, 13 Aug 2021 13:32:51 PDT | Fri, 13 Aug 2021 13:32:51 PDT |

	|         | addons list -o json                                                                               |                                |         |         |                               |                               |

	|---------|---------------------------------------------------------------------------------------------------|--------------------------------|---------|---------|-------------------------------|-------------------------------|

	* 

	* ==> Last Start <==

	* Log file created at: 2021/08/13 13:21:54

	Running on machine: 37309

	Binary: Built with gc go1.16.7 for darwin/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0813 13:21:54.281145    9787 out.go:298] Setting OutFile to fd 1 ...

	I0813 13:21:54.281275    9787 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0813 13:21:54.281277    9787 out.go:311] Setting ErrFile to fd 2...

	I0813 13:21:54.281279    9787 out.go:345] TERM=,COLORTERM=, which probably does not support color

	I0813 13:21:54.281354    9787 root.go:313] Updating PATH: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/bin

	I0813 13:21:54.281600    9787 out.go:305] Setting JSON to false

	I0813 13:21:54.299621    9787 start.go:111] hostinfo: {"hostname":"37309.local","uptime":4889,"bootTime":1628881225,"procs":312,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"11.2.3","kernelVersion":"20.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"c86236b2-4976-3542-80ca-74a6b8b4ba03"}

	W0813 13:21:54.299706    9787 start.go:119] gopshost.Virtualization returned error: not implemented yet

	I0813 13:21:54.326713    9787 out.go:177] * [functional-20210813131926-8053] minikube v1.22.0 on Darwin 11.2.3

	I0813 13:21:54.326846    9787 notify.go:169] Checking for updates...

	I0813 13:21:54.390409    9787 out.go:177]   - MINIKUBE_LOCATION=12230

	I0813 13:21:54.416142    9787 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/kubeconfig

	I0813 13:21:54.442299    9787 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64

	I0813 13:21:54.468300    9787 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube

	I0813 13:21:54.468666    9787 config.go:177] Loaded profile config "functional-20210813131926-8053": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.21.3

	I0813 13:21:54.468700    9787 driver.go:335] Setting default libvirt URI to qemu:///system

	I0813 13:21:54.567961    9787 docker.go:132] docker version: linux-20.10.6

	I0813 13:21:54.568092    9787 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I0813 13:21:54.749184    9787 info.go:263] docker info: {ID:43SM:MII3:NWBL:WJUG:JMKA:JL3W:EOOO:ZEGZ:7ZJH:ECYZ:GXPQ:XAL7 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:19 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:50 OomKillDisable:true NGoroutines:53 SystemTime:2021-08-13 20:21:54.680984807 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.25-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServer

Address:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6234726400 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.6 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05f951a3781f4f2c1911b05e61c160e9c30eaa8e Expected:05f951a3781f4f2c1911b05e61c160e9c30eaa8e} RuncCommit:{ID:12644e614e25b05da6fd08a38ffa0cfe1903fdec Expected:12644e614e25b05da6fd08a38ffa0cfe1903fdec} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=sec

comp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/local/lib/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Build with BuildKit Vendor:Docker Inc. Version:v0.5.1-docker] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:2.0.0-beta.1] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.8.0]] Warnings:<nil>}}

	I0813 13:21:54.775889    9787 out.go:177] * Using the docker driver based on existing profile

	I0813 13:21:54.775914    9787 start.go:278] selected driver: docker

	I0813 13:21:54.775919    9787 start.go:751] validating driver "docker" against &{Name:functional-20210813131926-8053 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.21.3 ClusterName:functional-20210813131926-8053 Namespace:default APIServerN

ame:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.21.3 ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false helm-tiller:false ingress:false ingress-dns:false istio:false istio-provisioner:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false] CustomAddon

Images:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0813 13:21:54.775984    9787 start.go:762] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}

	I0813 13:21:54.776188    9787 cli_runner.go:115] Run: docker system info --format "{{json .}}"

	I0813 13:21:54.961751    9787 info.go:263] docker info: {ID:43SM:MII3:NWBL:WJUG:JMKA:JL3W:EOOO:ZEGZ:7ZJH:ECYZ:GXPQ:XAL7 Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:19 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:50 OomKillDisable:true NGoroutines:53 SystemTime:2021-08-13 20:21:54.893644183 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.25-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServer

Address:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:6 MemTotal:6234726400 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.6 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05f951a3781f4f2c1911b05e61c160e9c30eaa8e Expected:05f951a3781f4f2c1911b05e61c160e9c30eaa8e} RuncCommit:{ID:12644e614e25b05da6fd08a38ffa0cfe1903fdec Expected:12644e614e25b05da6fd08a38ffa0cfe1903fdec} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=sec

comp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/local/lib/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Build with BuildKit Vendor:Docker Inc. Version:v0.5.1-docker] map[Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:2.0.0-beta.1] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.8.0]] Warnings:<nil>}}

	I0813 13:21:54.964167    9787 start_flags.go:697] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0813 13:21:54.964195    9787 cni.go:93] Creating CNI manager for ""

	I0813 13:21:54.964201    9787 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I0813 13:21:54.964210    9787 start_flags.go:277] config:

	{Name:functional-20210813131926-8053 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.21.3 ClusterName:functional-20210813131926-8053 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Contain

erRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.21.3 ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false helm-tiller:false ingress:false ingress-dns:false istio:false istio-provisioner:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false] CustomAddonI

mages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0813 13:21:54.991369    9787 out.go:177] * Starting control plane node functional-20210813131926-8053 in cluster functional-20210813131926-8053

	I0813 13:21:54.991429    9787 cache.go:117] Beginning downloading kic base image for docker with docker

	I0813 13:21:55.059928    9787 out.go:177] * Pulling base image ...

	I0813 13:21:55.060060    9787 preload.go:131] Checking if preload exists for k8s version v1.21.3 and runtime docker

	I0813 13:21:55.060069    9787 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 in local docker daemon

	I0813 13:21:55.060163    9787 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.3-docker-overlay2-amd64.tar.lz4

	I0813 13:21:55.060181    9787 cache.go:56] Caching tarball of preloaded images

	I0813 13:21:55.060344    9787 preload.go:173] Found /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I0813 13:21:55.060355    9787 cache.go:59] Finished verifying existence of preloaded tar for  v1.21.3 on docker

	I0813 13:21:55.061830    9787 profile.go:148] Saving config to /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/functional-20210813131926-8053/config.json ...

	I0813 13:21:55.184646    9787 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 in local docker daemon, skipping pull

	I0813 13:21:55.184655    9787 cache.go:139] gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 exists in daemon, skipping load

	I0813 13:21:55.184665    9787 cache.go:205] Successfully downloaded all kic artifacts

	I0813 13:21:55.184720    9787 start.go:313] acquiring machines lock for functional-20210813131926-8053: {Name:mkc1b35540cb8690340beda05ed315b2f6e71bd5 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0813 13:21:55.184824    9787 start.go:317] acquired machines lock for "functional-20210813131926-8053" in 88.909µs

	I0813 13:21:55.184844    9787 start.go:93] Skipping create...Using existing machine configuration

	I0813 13:21:55.184850    9787 fix.go:55] fixHost starting: 

	I0813 13:21:55.185122    9787 cli_runner.go:115] Run: docker container inspect functional-20210813131926-8053 --format={{.State.Status}}

	I0813 13:21:55.302303    9787 fix.go:108] recreateIfNeeded on functional-20210813131926-8053: state=Running err=<nil>

	W0813 13:21:55.302324    9787 fix.go:134] unexpected machine state, will restart: <nil>

	I0813 13:21:55.329065    9787 out.go:177] * Updating the running docker "functional-20210813131926-8053" container ...

	I0813 13:21:55.329107    9787 machine.go:88] provisioning docker machine ...

	I0813 13:21:55.329153    9787 ubuntu.go:169] provisioning hostname "functional-20210813131926-8053"

	I0813 13:21:55.329300    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:55.448112    9787 main.go:130] libmachine: Using SSH client type: native

	I0813 13:21:55.448292    9787 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x13fa2e0] 0x13fa2a0 <nil>  [] 0s} 127.0.0.1 59731 <nil> <nil>}

	I0813 13:21:55.448311    9787 main.go:130] libmachine: About to run SSH command:

	sudo hostname functional-20210813131926-8053 && echo "functional-20210813131926-8053" | sudo tee /etc/hostname

	I0813 13:21:55.585147    9787 main.go:130] libmachine: SSH cmd err, output: <nil>: functional-20210813131926-8053

	I0813 13:21:55.585238    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:55.702492    9787 main.go:130] libmachine: Using SSH client type: native

	I0813 13:21:55.702674    9787 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x13fa2e0] 0x13fa2a0 <nil>  [] 0s} 127.0.0.1 59731 <nil> <nil>}

	I0813 13:21:55.702691    9787 main.go:130] libmachine: About to run SSH command:

			if ! grep -xq '.*\sfunctional-20210813131926-8053' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 functional-20210813131926-8053/g' /etc/hosts;

				else 

					echo '127.0.1.1 functional-20210813131926-8053' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0813 13:21:55.832252    9787 main.go:130] libmachine: SSH cmd err, output: <nil>: 

	I0813 13:21:55.832283    9787 ubuntu.go:175] set auth options {CertDir:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube CaCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/se

rver.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube}

	I0813 13:21:55.832316    9787 ubuntu.go:177] setting up certificates

	I0813 13:21:55.832332    9787 provision.go:83] configureAuth start

	I0813 13:21:55.832440    9787 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" functional-20210813131926-8053

	I0813 13:21:55.949496    9787 provision.go:138] copyHostCerts

	I0813 13:21:55.949586    9787 exec_runner.go:145] found /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.pem, removing ...

	I0813 13:21:55.949592    9787 exec_runner.go:190] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.pem

	I0813 13:21:55.949692    9787 exec_runner.go:152] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.pem (1082 bytes)

	I0813 13:21:55.949885    9787 exec_runner.go:145] found /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cert.pem, removing ...

	I0813 13:21:55.949892    9787 exec_runner.go:190] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cert.pem

	I0813 13:21:55.949956    9787 exec_runner.go:152] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/cert.pem (1123 bytes)

	I0813 13:21:55.950102    9787 exec_runner.go:145] found /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/key.pem, removing ...

	I0813 13:21:55.950105    9787 exec_runner.go:190] rm: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/key.pem

	I0813 13:21:55.950159    9787 exec_runner.go:152] cp: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/key.pem (1675 bytes)

	I0813 13:21:55.950267    9787 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca-key.pem org=jenkins.functional-20210813131926-8053 san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube functional-20210813131926-8053]

	I0813 13:21:56.044777    9787 provision.go:172] copyRemoteCerts

	I0813 13:21:56.044832    9787 ssh_runner.go:149] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0813 13:21:56.044901    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:56.176574    9787 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:59731 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/functional-20210813131926-8053/id_rsa Username:docker}

	I0813 13:21:56.266936    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0813 13:21:56.285493    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server.pem --> /etc/docker/server.pem (1265 bytes)

	I0813 13:21:56.301792    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0813 13:21:56.318533    9787 provision.go:86] duration metric: configureAuth took 486.190467ms

	I0813 13:21:56.318541    9787 ubuntu.go:193] setting minikube options for container-runtime

	I0813 13:21:56.318718    9787 config.go:177] Loaded profile config "functional-20210813131926-8053": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.21.3

	I0813 13:21:56.318783    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:56.437674    9787 main.go:130] libmachine: Using SSH client type: native

	I0813 13:21:56.437827    9787 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x13fa2e0] 0x13fa2a0 <nil>  [] 0s} 127.0.0.1 59731 <nil> <nil>}

	I0813 13:21:56.437836    9787 main.go:130] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0813 13:21:56.563851    9787 main.go:130] libmachine: SSH cmd err, output: <nil>: overlay

	I0813 13:21:56.563864    9787 ubuntu.go:71] root file system type: overlay

	I0813 13:21:56.563998    9787 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I0813 13:21:56.564091    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:56.681639    9787 main.go:130] libmachine: Using SSH client type: native

	I0813 13:21:56.681807    9787 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x13fa2e0] 0x13fa2a0 <nil>  [] 0s} 127.0.0.1 59731 <nil> <nil>}

	I0813 13:21:56.681858    9787 main.go:130] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0813 13:21:56.819969    9787 main.go:130] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0813 13:21:56.820085    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:56.936161    9787 main.go:130] libmachine: Using SSH client type: native

	I0813 13:21:56.936301    9787 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x13fa2e0] 0x13fa2a0 <nil>  [] 0s} 127.0.0.1 59731 <nil> <nil>}

	I0813 13:21:56.936316    9787 main.go:130] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0813 13:21:57.070630    9787 main.go:130] libmachine: SSH cmd err, output: <nil>: 

	I0813 13:21:57.070642    9787 machine.go:91] provisioned docker machine in 1.741524027s

	I0813 13:21:57.070650    9787 start.go:267] post-start starting for "functional-20210813131926-8053" (driver="docker")

	I0813 13:21:57.070654    9787 start.go:277] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0813 13:21:57.070719    9787 ssh_runner.go:149] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0813 13:21:57.070786    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:57.185365    9787 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:59731 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/functional-20210813131926-8053/id_rsa Username:docker}

	I0813 13:21:57.278255    9787 ssh_runner.go:149] Run: cat /etc/os-release

	I0813 13:21:57.282084    9787 main.go:130] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found

	I0813 13:21:57.282094    9787 main.go:130] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found

	I0813 13:21:57.282099    9787 main.go:130] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found

	I0813 13:21:57.282104    9787 info.go:137] Remote host: Ubuntu 20.04.2 LTS

	I0813 13:21:57.282110    9787 filesync.go:126] Scanning /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/addons for local assets ...

	I0813 13:21:57.282205    9787 filesync.go:126] Scanning /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files for local assets ...

	I0813 13:21:57.282364    9787 filesync.go:149] local asset: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/80532.pem -> 80532.pem in /etc/ssl/certs

	I0813 13:21:57.282524    9787 filesync.go:149] local asset: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/test/nested/copy/8053/hosts -> hosts in /etc/test/nested/copy/8053

	I0813 13:21:57.282577    9787 ssh_runner.go:149] Run: sudo mkdir -p /etc/ssl/certs /etc/test/nested/copy/8053

	I0813 13:21:57.289648    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/80532.pem --> /etc/ssl/certs/80532.pem (1708 bytes)

	I0813 13:21:57.305812    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/test/nested/copy/8053/hosts --> /etc/test/nested/copy/8053/hosts (40 bytes)

	I0813 13:21:57.322252    9787 start.go:270] post-start completed in 251.592835ms

	I0813 13:21:57.322333    9787 ssh_runner.go:149] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0813 13:21:57.322390    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:57.441126    9787 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:59731 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/functional-20210813131926-8053/id_rsa Username:docker}

	I0813 13:21:57.530205    9787 fix.go:57] fixHost completed within 2.345344178s

	I0813 13:21:57.530220    9787 start.go:80] releasing machines lock for "functional-20210813131926-8053", held for 2.345384882s

	I0813 13:21:57.530368    9787 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" functional-20210813131926-8053

	I0813 13:21:57.649353    9787 ssh_runner.go:149] Run: curl -sS -m 2 https://k8s.gcr.io/

	I0813 13:21:57.649366    9787 ssh_runner.go:149] Run: systemctl --version

	I0813 13:21:57.649430    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:57.649444    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:57.779721    9787 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:59731 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/functional-20210813131926-8053/id_rsa Username:docker}

	I0813 13:21:57.779920    9787 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:59731 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/functional-20210813131926-8053/id_rsa Username:docker}

	I0813 13:21:57.870055    9787 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service containerd

	I0813 13:21:57.969894    9787 ssh_runner.go:149] Run: sudo systemctl cat docker.service

	I0813 13:21:57.979713    9787 cruntime.go:249] skipping containerd shutdown because we are bound to it

	I0813 13:21:57.979768    9787 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service crio

	I0813 13:21:57.989737    9787 ssh_runner.go:149] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/dockershim.sock

	image-endpoint: unix:///var/run/dockershim.sock

	" | sudo tee /etc/crictl.yaml"

	I0813 13:21:58.002260    9787 ssh_runner.go:149] Run: sudo systemctl unmask docker.service

	I0813 13:21:58.070268    9787 ssh_runner.go:149] Run: sudo systemctl enable docker.socket

	I0813 13:21:58.143885    9787 ssh_runner.go:149] Run: sudo systemctl cat docker.service

	I0813 13:21:58.153464    9787 ssh_runner.go:149] Run: sudo systemctl daemon-reload

	I0813 13:21:58.227112    9787 ssh_runner.go:149] Run: sudo systemctl start docker

	I0813 13:21:58.236571    9787 ssh_runner.go:149] Run: docker version --format {{.Server.Version}}

	I0813 13:21:58.275161    9787 ssh_runner.go:149] Run: docker version --format {{.Server.Version}}

	I0813 13:21:58.361792    9787 out.go:204] * Preparing Kubernetes v1.21.3 on Docker 20.10.8 ...

	I0813 13:21:58.361961    9787 cli_runner.go:115] Run: docker exec -t functional-20210813131926-8053 dig +short host.docker.internal

	I0813 13:21:58.547479    9787 network.go:69] got host ip for mount in container by digging dns: 192.168.65.2

	I0813 13:21:58.547597    9787 ssh_runner.go:149] Run: grep 192.168.65.2	host.minikube.internal$ /etc/hosts

	I0813 13:21:58.552110    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8441/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:58.698484    9787 out.go:177]   - apiserver.enable-admission-plugins=NamespaceAutoProvision

	I0813 13:21:58.698634    9787 preload.go:131] Checking if preload exists for k8s version v1.21.3 and runtime docker

	I0813 13:21:58.698805    9787 ssh_runner.go:149] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0813 13:21:58.729603    9787 docker.go:535] Got preloaded images: -- stdout --

	k8s.gcr.io/kube-apiserver:v1.21.3

	k8s.gcr.io/kube-scheduler:v1.21.3

	k8s.gcr.io/kube-proxy:v1.21.3

	k8s.gcr.io/kube-controller-manager:v1.21.3

	minikube-local-cache-test:functional-20210813131926-8053

	gcr.io/k8s-minikube/storage-provisioner:v5

	k8s.gcr.io/pause:3.4.1

	kubernetesui/dashboard:v2.1.0

	k8s.gcr.io/coredns/coredns:v1.8.0

	k8s.gcr.io/etcd:3.4.13-0

	k8s.gcr.io/pause:3.3

	kubernetesui/metrics-scraper:v1.0.4

	k8s.gcr.io/pause:3.1

	k8s.gcr.io/pause:latest

	-- /stdout --

	I0813 13:21:58.729614    9787 docker.go:466] Images already preloaded, skipping extraction

	I0813 13:21:58.729700    9787 ssh_runner.go:149] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0813 13:21:58.758863    9787 docker.go:535] Got preloaded images: -- stdout --

	k8s.gcr.io/kube-apiserver:v1.21.3

	k8s.gcr.io/kube-scheduler:v1.21.3

	k8s.gcr.io/kube-proxy:v1.21.3

	k8s.gcr.io/kube-controller-manager:v1.21.3

	minikube-local-cache-test:functional-20210813131926-8053

	gcr.io/k8s-minikube/storage-provisioner:v5

	k8s.gcr.io/pause:3.4.1

	kubernetesui/dashboard:v2.1.0

	k8s.gcr.io/coredns/coredns:v1.8.0

	k8s.gcr.io/etcd:3.4.13-0

	k8s.gcr.io/pause:3.3

	kubernetesui/metrics-scraper:v1.0.4

	k8s.gcr.io/pause:3.1

	k8s.gcr.io/pause:latest

	-- /stdout --

	I0813 13:21:58.758872    9787 cache_images.go:74] Images are preloaded, skipping loading

	I0813 13:21:58.758968    9787 ssh_runner.go:149] Run: docker info --format {{.CgroupDriver}}

	I0813 13:21:58.836165    9787 extraconfig.go:124] Overwriting default enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota with user provided enable-admission-plugins=NamespaceAutoProvision for component apiserver

	I0813 13:21:58.836186    9787 cni.go:93] Creating CNI manager for ""

	I0813 13:21:58.836195    9787 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I0813 13:21:58.836203    9787 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I0813 13:21:58.836216    9787 kubeadm.go:153] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8441 KubernetesVersion:v1.21.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:functional-20210813131926-8053 NodeName:functional-20210813131926-8053 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceAutoProvision] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}

	I0813 13:21:58.836321    9787 kubeadm.go:157] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.49.2

	  bindPort: 8441

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: /var/run/dockershim.sock

	  name: "functional-20210813131926-8053"

	  kubeletExtraArgs:

	    node-ip: 192.168.49.2

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceAutoProvision"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8441

	dns:

	  type: CoreDNS

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.21.3

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0813 13:21:58.836398    9787 kubeadm.go:909] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.21.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=functional-20210813131926-8053 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2

	[Install]

	 config:

	{KubernetesVersion:v1.21.3 ClusterName:functional-20210813131926-8053 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:}

	I0813 13:21:58.836468    9787 ssh_runner.go:149] Run: sudo ls /var/lib/minikube/binaries/v1.21.3

	I0813 13:21:58.843899    9787 binaries.go:44] Found k8s binaries, skipping transfer

	I0813 13:21:58.843961    9787 ssh_runner.go:149] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0813 13:21:58.850752    9787 ssh_runner.go:316] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (356 bytes)

	I0813 13:21:58.863434    9787 ssh_runner.go:316] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0813 13:21:58.875415    9787 ssh_runner.go:316] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (1923 bytes)

	I0813 13:21:58.887646    9787 ssh_runner.go:149] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts

	I0813 13:21:58.891653    9787 certs.go:52] Setting up /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/functional-20210813131926-8053 for IP: 192.168.49.2

	I0813 13:21:58.891733    9787 certs.go:179] skipping minikubeCA CA generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.key

	I0813 13:21:58.891764    9787 certs.go:179] skipping proxyClientCA CA generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.key

	I0813 13:21:58.891832    9787 certs.go:293] skipping minikube-user signed cert generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/functional-20210813131926-8053/client.key

	I0813 13:21:58.891864    9787 certs.go:293] skipping minikube signed cert generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/functional-20210813131926-8053/apiserver.key.dd3b5fb2

	I0813 13:21:58.891898    9787 certs.go:293] skipping aggregator signed cert generation: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/functional-20210813131926-8053/proxy-client.key

	I0813 13:21:58.892101    9787 certs.go:376] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/8053.pem (1338 bytes)

	W0813 13:21:58.892147    9787 certs.go:372] ignoring /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/8053_empty.pem, impossibly tiny 0 bytes

	I0813 13:21:58.892159    9787 certs.go:376] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca-key.pem (1675 bytes)

	I0813 13:21:58.892196    9787 certs.go:376] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/ca.pem (1082 bytes)

	I0813 13:21:58.892231    9787 certs.go:376] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/cert.pem (1123 bytes)

	I0813 13:21:58.892268    9787 certs.go:376] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/key.pem (1675 bytes)

	I0813 13:21:58.892332    9787 certs.go:376] found cert: /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/80532.pem (1708 bytes)

	I0813 13:21:58.893223    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/functional-20210813131926-8053/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I0813 13:21:58.909719    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/functional-20210813131926-8053/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0813 13:21:58.925905    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/functional-20210813131926-8053/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0813 13:21:58.942022    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/profiles/functional-20210813131926-8053/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0813 13:21:58.958623    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0813 13:21:58.975085    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I0813 13:21:58.991264    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0813 13:21:59.007328    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I0813 13:21:59.023488    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/certs/8053.pem --> /usr/share/ca-certificates/8053.pem (1338 bytes)

	I0813 13:21:59.040270    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/files/etc/ssl/certs/80532.pem --> /usr/share/ca-certificates/80532.pem (1708 bytes)

	I0813 13:21:59.056327    9787 ssh_runner.go:316] scp /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0813 13:21:59.072475    9787 ssh_runner.go:316] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0813 13:21:59.084536    9787 ssh_runner.go:149] Run: openssl version

	I0813 13:21:59.089935    9787 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/80532.pem && ln -fs /usr/share/ca-certificates/80532.pem /etc/ssl/certs/80532.pem"

	I0813 13:21:59.097684    9787 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/80532.pem

	I0813 13:21:59.101594    9787 certs.go:419] hashing: -rw-r--r-- 1 root root 1708 Aug 13 20:19 /usr/share/ca-certificates/80532.pem

	I0813 13:21:59.101643    9787 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/80532.pem

	I0813 13:21:59.107144    9787 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/80532.pem /etc/ssl/certs/3ec20f2e.0"

	I0813 13:21:59.114076    9787 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0813 13:21:59.121539    9787 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0813 13:21:59.125540    9787 certs.go:419] hashing: -rw-r--r-- 1 root root 1111 Aug 13 20:16 /usr/share/ca-certificates/minikubeCA.pem

	I0813 13:21:59.125584    9787 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0813 13:21:59.130700    9787 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0813 13:21:59.137797    9787 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/8053.pem && ln -fs /usr/share/ca-certificates/8053.pem /etc/ssl/certs/8053.pem"

	I0813 13:21:59.145736    9787 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/8053.pem

	I0813 13:21:59.149426    9787 certs.go:419] hashing: -rw-r--r-- 1 root root 1338 Aug 13 20:19 /usr/share/ca-certificates/8053.pem

	I0813 13:21:59.149475    9787 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/8053.pem

	I0813 13:21:59.154597    9787 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/8053.pem /etc/ssl/certs/51391683.0"

	I0813 13:21:59.161377    9787 kubeadm.go:390] StartCluster: {Name:functional-20210813131926-8053 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.25-1628619379-12032@sha256:937faef407987cbd8b3cb0a90c6c5dfd664817d5377be0b77a4ecbf0f9f9c1b6 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.21.3 ClusterName:functional-20210813131926-8053 Namespace:default APIServerName:minikubeCA APISe

rverNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.21.3 ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false helm-tiller:false ingress:false ingress-dns:false istio:false istio-provisioner:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-p

rovisioner-gluster:false volumesnapshots:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}

	I0813 13:21:59.161497    9787 ssh_runner.go:149] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0813 13:21:59.189545    9787 ssh_runner.go:149] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0813 13:21:59.198183    9787 kubeadm.go:401] found existing configuration files, will attempt cluster restart

	I0813 13:21:59.198193    9787 kubeadm.go:600] restartCluster start

	I0813 13:21:59.198243    9787 ssh_runner.go:149] Run: sudo test -d /data/minikube

	I0813 13:21:59.205178    9787 kubeadm.go:126] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1

	stdout:

	stderr:

	I0813 13:21:59.205256    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8441/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:21:59.324984    9787 kubeconfig.go:93] found "functional-20210813131926-8053" server: "https://127.0.0.1:59730"

	I0813 13:21:59.328207    9787 ssh_runner.go:149] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new

	I0813 13:21:59.336264    9787 kubeadm.go:568] needs reconfigure: configs differ:

	-- stdout --

	--- /var/tmp/minikube/kubeadm.yaml	2021-08-13 20:20:16.844537431 +0000

	+++ /var/tmp/minikube/kubeadm.yaml.new	2021-08-13 20:21:58.890702464 +0000

	@@ -22,7 +22,7 @@

	 apiServer:

	   certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]

	   extraArgs:

	-    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	+    enable-admission-plugins: "NamespaceAutoProvision"

	 controllerManager:

	   extraArgs:

	     allocate-node-cidrs: "true"

	-- /stdout --

	I0813 13:21:59.336273    9787 kubeadm.go:1032] stopping kube-system containers ...

	I0813 13:21:59.336353    9787 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0813 13:21:59.365803    9787 docker.go:367] Stopping containers: [c9cb7d5809d8 a775b806a61d cb9e8762e065 137cc83770ff d982e81551e9 0237d371d391 467412a75d20 52fbb2e72ccf 9d5404187c66 c4b0031b9346 60451e7f160d 474f32a18e0e 58a9c2f98763 2ec83ef7b889 d31f2fbd2084]

	I0813 13:21:59.365906    9787 ssh_runner.go:149] Run: docker stop c9cb7d5809d8 a775b806a61d cb9e8762e065 137cc83770ff d982e81551e9 0237d371d391 467412a75d20 52fbb2e72ccf 9d5404187c66 c4b0031b9346 60451e7f160d 474f32a18e0e 58a9c2f98763 2ec83ef7b889 d31f2fbd2084

	I0813 13:22:04.995080    9787 ssh_runner.go:189] Completed: docker stop c9cb7d5809d8 a775b806a61d cb9e8762e065 137cc83770ff d982e81551e9 0237d371d391 467412a75d20 52fbb2e72ccf 9d5404187c66 c4b0031b9346 60451e7f160d 474f32a18e0e 58a9c2f98763 2ec83ef7b889 d31f2fbd2084: (5.629129791s)

	I0813 13:22:04.995149    9787 ssh_runner.go:149] Run: sudo systemctl stop kubelet

	I0813 13:22:05.035150    9787 ssh_runner.go:149] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0813 13:22:05.043407    9787 kubeadm.go:154] found existing configuration files:

	-rw------- 1 root root 5639 Aug 13 20:20 /etc/kubernetes/admin.conf

	-rw------- 1 root root 5656 Aug 13 20:20 /etc/kubernetes/controller-manager.conf

	-rw------- 1 root root 2059 Aug 13 20:20 /etc/kubernetes/kubelet.conf

	-rw------- 1 root root 5604 Aug 13 20:20 /etc/kubernetes/scheduler.conf

	I0813 13:22:05.043464    9787 ssh_runner.go:149] Run: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/admin.conf

	I0813 13:22:05.051350    9787 ssh_runner.go:149] Run: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/kubelet.conf

	I0813 13:22:05.060114    9787 ssh_runner.go:149] Run: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/controller-manager.conf

	I0813 13:22:05.067525    9787 kubeadm.go:165] "https://control-plane.minikube.internal:8441" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/controller-manager.conf: Process exited with status 1

	stdout:

	stderr:

	I0813 13:22:05.067578    9787 ssh_runner.go:149] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I0813 13:22:05.075008    9787 ssh_runner.go:149] Run: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/scheduler.conf

	I0813 13:22:05.082906    9787 kubeadm.go:165] "https://control-plane.minikube.internal:8441" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/scheduler.conf: Process exited with status 1

	stdout:

	stderr:

	I0813 13:22:05.082967    9787 ssh_runner.go:149] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I0813 13:22:05.090012    9787 ssh_runner.go:149] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0813 13:22:05.098160    9787 kubeadm.go:676] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml

	I0813 13:22:05.098166    9787 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.3:$PATH kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"

	I0813 13:22:05.234978    9787 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.3:$PATH kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"

	I0813 13:22:06.121440    9787 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.3:$PATH kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"

	I0813 13:22:06.340305    9787 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.3:$PATH kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"

	I0813 13:22:06.503163    9787 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.3:$PATH kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"

	I0813 13:22:06.712462    9787 api_server.go:50] waiting for apiserver process to appear ...

	I0813 13:22:06.712527    9787 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0813 13:22:06.730332    9787 api_server.go:70] duration metric: took 17.874307ms to wait for apiserver process to appear ...

	I0813 13:22:06.730341    9787 api_server.go:86] waiting for apiserver healthz status ...

	I0813 13:22:06.730354    9787 api_server.go:239] Checking apiserver healthz at https://127.0.0.1:59730/healthz ...

	I0813 13:22:06.736407    9787 api_server.go:265] https://127.0.0.1:59730/healthz returned 200:

	ok

	I0813 13:22:06.743171    9787 api_server.go:139] control plane version: v1.21.3

	I0813 13:22:06.743179    9787 api_server.go:129] duration metric: took 12.83557ms to wait for apiserver health ...

	I0813 13:22:06.743183    9787 cni.go:93] Creating CNI manager for ""

	I0813 13:22:06.743191    9787 cni.go:167] CNI unnecessary in this configuration, recommending no CNI

	I0813 13:22:06.743197    9787 system_pods.go:43] waiting for kube-system pods to appear ...

	I0813 13:22:06.753205    9787 system_pods.go:59] 7 kube-system pods found

	I0813 13:22:06.753216    9787 system_pods.go:61] "coredns-558bd4d5db-rhdvr" [5a622440-7ec5-4279-906a-dbb6df1293e4] Running

	I0813 13:22:06.753223    9787 system_pods.go:61] "etcd-functional-20210813131926-8053" [4f00bcab-aff3-43c8-acc0-58a4b8aabe25] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])

	I0813 13:22:06.753226    9787 system_pods.go:61] "kube-apiserver-functional-20210813131926-8053" [20ad3ec8-4b1e-4b0c-98d1-55d19db5ea62] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])

	I0813 13:22:06.753249    9787 system_pods.go:61] "kube-controller-manager-functional-20210813131926-8053" [dcbf1190-fbb7-47cc-8dc0-3e56e3c5edae] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])

	I0813 13:22:06.753254    9787 system_pods.go:61] "kube-proxy-kv9mv" [021b9666-4667-41cf-b041-7b8db53a4052] Running

	I0813 13:22:06.753257    9787 system_pods.go:61] "kube-scheduler-functional-20210813131926-8053" [afe411d1-6ad3-41a8-bb90-ff93ba88531c] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])

	I0813 13:22:06.753260    9787 system_pods.go:61] "storage-provisioner" [d75f1151-7edf-4dac-acd9-128a49223ff1] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])

	I0813 13:22:06.753263    9787 system_pods.go:74] duration metric: took 10.063476ms to wait for pod list to return data ...

	I0813 13:22:06.753267    9787 node_conditions.go:102] verifying NodePressure condition ...

	I0813 13:22:06.756805    9787 node_conditions.go:122] node storage ephemeral capacity is 123591232Ki

	I0813 13:22:06.756820    9787 node_conditions.go:123] node cpu capacity is 6

	I0813 13:22:06.756832    9787 node_conditions.go:105] duration metric: took 3.562026ms to run NodePressure ...

	I0813 13:22:06.756839    9787 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.3:$PATH kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"

	I0813 13:22:06.988642    9787 kubeadm.go:731] waiting for restarted kubelet to initialise ...

	I0813 13:22:06.992762    9787 kubeadm.go:746] kubelet initialised

	I0813 13:22:06.992768    9787 kubeadm.go:747] duration metric: took 4.11784ms waiting for restarted kubelet to initialise ...

	I0813 13:22:06.992772    9787 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0813 13:22:06.997055    9787 pod_ready.go:78] waiting up to 4m0s for pod "coredns-558bd4d5db-rhdvr" in "kube-system" namespace to be "Ready" ...

	I0813 13:22:07.004790    9787 pod_ready.go:92] pod "coredns-558bd4d5db-rhdvr" in "kube-system" namespace has status "Ready":"True"

	I0813 13:22:07.004795    9787 pod_ready.go:81] duration metric: took 7.730399ms waiting for pod "coredns-558bd4d5db-rhdvr" in "kube-system" namespace to be "Ready" ...

	I0813 13:22:07.004799    9787 pod_ready.go:78] waiting up to 4m0s for pod "etcd-functional-20210813131926-8053" in "kube-system" namespace to be "Ready" ...

	I0813 13:22:09.023880    9787 pod_ready.go:102] pod "etcd-functional-20210813131926-8053" in "kube-system" namespace has status "Ready":"False"

	I0813 13:22:11.523012    9787 pod_ready.go:97] node "functional-20210813131926-8053" hosting pod "etcd-functional-20210813131926-8053" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:11.523022    9787 pod_ready.go:81] duration metric: took 4.518205887s waiting for pod "etcd-functional-20210813131926-8053" in "kube-system" namespace to be "Ready" ...

	E0813 13:22:11.523028    9787 pod_ready.go:66] WaitExtra: waitPodCondition: node "functional-20210813131926-8053" hosting pod "etcd-functional-20210813131926-8053" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:11.523040    9787 pod_ready.go:78] waiting up to 4m0s for pod "kube-apiserver-functional-20210813131926-8053" in "kube-system" namespace to be "Ready" ...

	I0813 13:22:11.527525    9787 pod_ready.go:97] node "functional-20210813131926-8053" hosting pod "kube-apiserver-functional-20210813131926-8053" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:11.527531    9787 pod_ready.go:81] duration metric: took 4.486717ms waiting for pod "kube-apiserver-functional-20210813131926-8053" in "kube-system" namespace to be "Ready" ...

	E0813 13:22:11.527536    9787 pod_ready.go:66] WaitExtra: waitPodCondition: node "functional-20210813131926-8053" hosting pod "kube-apiserver-functional-20210813131926-8053" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:11.527544    9787 pod_ready.go:78] waiting up to 4m0s for pod "kube-controller-manager-functional-20210813131926-8053" in "kube-system" namespace to be "Ready" ...

	I0813 13:22:11.531857    9787 pod_ready.go:97] node "functional-20210813131926-8053" hosting pod "kube-controller-manager-functional-20210813131926-8053" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:11.531864    9787 pod_ready.go:81] duration metric: took 4.31653ms waiting for pod "kube-controller-manager-functional-20210813131926-8053" in "kube-system" namespace to be "Ready" ...

	E0813 13:22:11.531869    9787 pod_ready.go:66] WaitExtra: waitPodCondition: node "functional-20210813131926-8053" hosting pod "kube-controller-manager-functional-20210813131926-8053" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:11.531876    9787 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-kv9mv" in "kube-system" namespace to be "Ready" ...

	I0813 13:22:11.537017    9787 pod_ready.go:97] node "functional-20210813131926-8053" hosting pod "kube-proxy-kv9mv" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:11.537022    9787 pod_ready.go:81] duration metric: took 5.141983ms waiting for pod "kube-proxy-kv9mv" in "kube-system" namespace to be "Ready" ...

	E0813 13:22:11.537025    9787 pod_ready.go:66] WaitExtra: waitPodCondition: node "functional-20210813131926-8053" hosting pod "kube-proxy-kv9mv" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:11.537032    9787 pod_ready.go:78] waiting up to 4m0s for pod "kube-scheduler-functional-20210813131926-8053" in "kube-system" namespace to be "Ready" ...

	I0813 13:22:11.545827    9787 pod_ready.go:97] node "functional-20210813131926-8053" hosting pod "kube-scheduler-functional-20210813131926-8053" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:11.545836    9787 pod_ready.go:81] duration metric: took 8.799553ms waiting for pod "kube-scheduler-functional-20210813131926-8053" in "kube-system" namespace to be "Ready" ...

	E0813 13:22:11.545841    9787 pod_ready.go:66] WaitExtra: waitPodCondition: node "functional-20210813131926-8053" hosting pod "kube-scheduler-functional-20210813131926-8053" in "kube-system" namespace is currently not "Ready" (skipping!): node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:11.545851    9787 pod_ready.go:38] duration metric: took 4.553059995s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0813 13:22:11.545860    9787 ssh_runner.go:149] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0813 13:22:11.558301    9787 ops.go:34] apiserver oom_adj: -16

	I0813 13:22:11.558317    9787 kubeadm.go:604] restartCluster took 12.36008589s

	I0813 13:22:11.558321    9787 kubeadm.go:392] StartCluster complete in 12.39691792s

	I0813 13:22:11.558329    9787 settings.go:142] acquiring lock: {Name:mkea671a8cf1619d5bb0d33f936826680e87cf9b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 13:22:11.558414    9787 settings.go:150] Updating kubeconfig:  /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/kubeconfig

	I0813 13:22:11.558889    9787 lock.go:36] WriteFile acquiring /Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/kubeconfig: {Name:mk2e9f304ce9a26dabf1dc11ded078755e07052d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0813 13:22:11.564907    9787 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "functional-20210813131926-8053" rescaled to 1

	I0813 13:22:11.564940    9787 ssh_runner.go:149] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.21.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0813 13:22:11.564936    9787 start.go:226] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.21.3 ControlPlane:true Worker:true}

	I0813 13:22:11.564966    9787 addons.go:342] enableAddons start: toEnable=map[ambassador:false auto-pause:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false helm-tiller:false ingress:false ingress-dns:false istio:false istio-provisioner:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false], additional=[]

	I0813 13:22:11.589685    9787 out.go:177] * Verifying Kubernetes components...

	I0813 13:22:11.565120    9787 config.go:177] Loaded profile config "functional-20210813131926-8053": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.21.3

	I0813 13:22:11.589733    9787 addons.go:59] Setting default-storageclass=true in profile "functional-20210813131926-8053"

	I0813 13:22:11.589735    9787 addons.go:59] Setting storage-provisioner=true in profile "functional-20210813131926-8053"

	I0813 13:22:11.589750    9787 addons.go:135] Setting addon storage-provisioner=true in "functional-20210813131926-8053"

	W0813 13:22:11.589756    9787 addons.go:147] addon storage-provisioner should already be in state true

	I0813 13:22:11.589756    9787 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "functional-20210813131926-8053"

	I0813 13:22:11.589762    9787 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service kubelet

	I0813 13:22:11.589779    9787 host.go:66] Checking if "functional-20210813131926-8053" exists ...

	I0813 13:22:11.590054    9787 cli_runner.go:115] Run: docker container inspect functional-20210813131926-8053 --format={{.State.Status}}

	I0813 13:22:11.591473    9787 cli_runner.go:115] Run: docker container inspect functional-20210813131926-8053 --format={{.State.Status}}

	I0813 13:22:11.640467    9787 start.go:708] CoreDNS already contains "host.minikube.internal" host record, skipping...

	I0813 13:22:11.640547    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8441/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:22:11.736998    9787 addons.go:135] Setting addon default-storageclass=true in "functional-20210813131926-8053"

	W0813 13:22:11.753928    9787 addons.go:147] addon default-storageclass should already be in state true

	I0813 13:22:11.753909    9787 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0813 13:22:11.753958    9787 host.go:66] Checking if "functional-20210813131926-8053" exists ...

	I0813 13:22:11.754030    9787 addons.go:275] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0813 13:22:11.754035    9787 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0813 13:22:11.754119    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:22:11.756650    9787 cli_runner.go:115] Run: docker container inspect functional-20210813131926-8053 --format={{.State.Status}}

	I0813 13:22:11.796607    9787 node_ready.go:35] waiting up to 6m0s for node "functional-20210813131926-8053" to be "Ready" ...

	I0813 13:22:11.883407    9787 addons.go:275] installing /etc/kubernetes/addons/storageclass.yaml

	I0813 13:22:11.883414    9787 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0813 13:22:11.883501    9787 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-20210813131926-8053

	I0813 13:22:11.884664    9787 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:59731 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/functional-20210813131926-8053/id_rsa Username:docker}

	I0813 13:22:11.981485    9787 ssh_runner.go:149] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0813 13:22:12.002195    9787 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:59731 SSHKeyPath:/Users/jenkins/minikube-integration/darwin-amd64-docker--12230-7026-098adff14f97e55ded5626b0a90c858c09622337/.minikube/machines/functional-20210813131926-8053/id_rsa Username:docker}

	I0813 13:22:12.100215    9787 ssh_runner.go:149] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0813 13:22:12.292911    9787 out.go:177] * Enabled addons: storage-provisioner, default-storageclass

	I0813 13:22:12.292941    9787 addons.go:344] enableAddons completed in 727.982788ms

	I0813 13:22:13.803981    9787 node_ready.go:58] node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:15.805967    9787 node_ready.go:58] node "functional-20210813131926-8053" has status "Ready":"False"

	I0813 13:22:26.864663    9787 node_ready.go:53] error getting node "functional-20210813131926-8053": an error on the server ("") has prevented the request from succeeding (get nodes functional-20210813131926-8053)

	I0813 13:22:26.864673    9787 node_ready.go:38] duration metric: took 15.06800794s waiting for node "functional-20210813131926-8053" to be "Ready" ...

	* 

	* ==> Docker <==

	* -- Logs begin at Fri 2021-08-13 20:19:47 UTC, end at Fri 2021-08-13 20:33:00 UTC. --

	Aug 13 20:23:39 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:23:39.812219494Z" level=error msg="Handler for POST /v1.41/images/create returned error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:23:41 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:23:41.721814918Z" level=error msg="Not continuing with pull after error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:23:41 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:23:41.723559082Z" level=error msg="Handler for POST /v1.41/images/create returned error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:24:29 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:24:29.684199888Z" level=error msg="Not continuing with pull after error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:24:29 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:24:29.685309400Z" level=error msg="Handler for POST /v1.41/images/create returned error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:24:32 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:24:32.661964677Z" level=error msg="Not continuing with pull after error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:24:32 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:24:32.663723499Z" level=error msg="Handler for POST /v1.41/images/create returned error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:25:58 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:25:58.652594755Z" level=error msg="Not continuing with pull after error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:25:58 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:25:58.654390204Z" level=error msg="Handler for POST /v1.41/images/create returned error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:26:01 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:26:01.632718322Z" level=error msg="Not continuing with pull after error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:26:01 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:26:01.634194742Z" level=error msg="Handler for POST /v1.41/images/create returned error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:28:40 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:28:40.562402566Z" level=error msg="Not continuing with pull after error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:28:40 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:28:40.563999890Z" level=error msg="Handler for POST /v1.41/images/create returned error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:28:55 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:28:55.493887291Z" level=error msg="Not continuing with pull after error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:28:55 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:28:55.495161643Z" level=error msg="Handler for POST /v1.41/images/create returned error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:29:45 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:29:45.527535131Z" level=error msg="Not continuing with pull after error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:29:45 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:29:45.528967184Z" level=error msg="Handler for POST /v1.41/images/create returned error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:29:57 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:29:57.430527600Z" level=error msg="Not continuing with pull after error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:29:57 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:29:57.432158311Z" level=error msg="Handler for POST /v1.41/images/create returned error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:30:24 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:30:24.482182708Z" level=error msg="Not continuing with pull after error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:30:24 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:30:24.483471860Z" level=error msg="Handler for POST /v1.41/images/create returned error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:31:16 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:31:16.428323329Z" level=error msg="Not continuing with pull after error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:31:16 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:31:16.430000632Z" level=error msg="Handler for POST /v1.41/images/create returned error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:32:38 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:32:38.372830808Z" level=error msg="Not continuing with pull after error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	Aug 13 20:32:38 functional-20210813131926-8053 dockerd[464]: time="2021-08-13T20:32:38.373973315Z" level=error msg="Handler for POST /v1.41/images/create returned error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit"

	* 

	* ==> container status <==

	* CONTAINER           IMAGE                                                                                           CREATED             STATE               NAME                      ATTEMPT             POD ID

	23df5548ce9a0       k8s.gcr.io/echoserver@sha256:cb3386f863f6a4b05f33c191361723f9d5927ac287463b1bea633bf859475969   5 seconds ago       Running             echoserver                0                   d376ae6554e88

	6d69afd52f8c3       3d174f00aa39e                                                                                   10 minutes ago      Running             kube-apiserver            2                   d69f527d156d3

	83fc53fcb046e       3d174f00aa39e                                                                                   10 minutes ago      Exited              kube-apiserver            1                   d69f527d156d3

	b2296fd0d1e96       6e38f40d628db                                                                                   10 minutes ago      Running             storage-provisioner       2                   5e308be60a59b

	fd440add28af1       296a6d5035e2d                                                                                   10 minutes ago      Running             coredns                   1                   f50593e11ff51

	a4dbf0c14cf56       adb2816ea823a                                                                                   11 minutes ago      Running             kube-proxy                1                   d1f104a42b8d8

	702cee73a40cb       6be0dc1302e30                                                                                   11 minutes ago      Running             kube-scheduler            1                   07d2de00a97f8

	48d06bb7b7911       0369cf4303ffd                                                                                   11 minutes ago      Running             etcd                      1                   d8b864d434486

	aca358fec1904       bc2bb319a7038                                                                                   11 minutes ago      Running             kube-controller-manager   1                   bd0a7904b87eb

	c9cb7d5809d85       6e38f40d628db                                                                                   11 minutes ago      Exited              storage-provisioner       1                   cb9e8762e065a

	137cc83770ffa       296a6d5035e2d                                                                                   12 minutes ago      Exited              coredns                   0                   d982e81551e90

	0237d371d3915       adb2816ea823a                                                                                   12 minutes ago      Exited              kube-proxy                0                   467412a75d204

	52fbb2e72ccff       0369cf4303ffd                                                                                   12 minutes ago      Exited              etcd                      0                   474f32a18e0ee

	9d5404187c668       6be0dc1302e30                                                                                   12 minutes ago      Exited              kube-scheduler            0                   58a9c2f987638

	60451e7f160dd       bc2bb319a7038                                                                                   12 minutes ago      Exited              kube-controller-manager   0                   2ec83ef7b8893

	* 

	* ==> coredns [137cc83770ff] <==

	* [INFO] plugin/ready: Still waiting on: "kubernetes"

	.:53

	[INFO] plugin/reload: Running configuration MD5 = db32ca3650231d74073ff4cf814959a7

	CoreDNS-1.8.0

	linux/amd64, go1.15.3, 054c9ae

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] Reloading

	[INFO] plugin/health: Going into lameduck mode for 5s

	[INFO] plugin/reload: Running configuration MD5 = c23ed519c17e71ee396ed052e6209e94

	[INFO] Reloading complete

	[INFO] SIGTERM: Shutting down servers then terminating

	[INFO] plugin/health: Going into lameduck mode for 5s

	I0813 20:21:20.439318       1 trace.go:205] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156 (13-Aug-2021 20:20:50.459) (total time: 30000ms):

	Trace[2019727887]: [30.000959061s] [30.000959061s] END

	E0813 20:21:20.439385       1 reflector.go:127] pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156: Failed to watch *v1.Endpoints: failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	I0813 20:21:20.439327       1 trace.go:205] Trace[1427131847]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156 (13-Aug-2021 20:20:50.459) (total time: 30000ms):

	Trace[1427131847]: [30.00091098s] [30.00091098s] END

	E0813 20:21:20.439411       1 reflector.go:127] pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	I0813 20:21:20.439589       1 trace.go:205] Trace[911902081]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156 (13-Aug-2021 20:20:50.459) (total time: 30001ms):

	Trace[911902081]: [30.001246144s] [30.001246144s] END

	E0813 20:21:20.439637       1 reflector.go:127] pkg/mod/k8s.io/client-go@v0.19.2/tools/cache/reflector.go:156: Failed to watch *v1.Namespace: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	* 

	* ==> coredns [fd440add28af] <==

	* .:53

	[INFO] plugin/reload: Running configuration MD5 = c23ed519c17e71ee396ed052e6209e94

	CoreDNS-1.8.0

	linux/amd64, go1.15.3, 054c9ae

	* 

	* ==> describe nodes <==

	* Name:               functional-20210813131926-8053

	Roles:              control-plane,master

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=functional-20210813131926-8053

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=852050cf77fe767e86d5a194bb91c06c4dc6c13c

	                    minikube.k8s.io/name=functional-20210813131926-8053

	                    minikube.k8s.io/updated_at=2021_08_13T13_20_35_0700

	                    minikube.k8s.io/version=v1.22.0

	                    node-role.kubernetes.io/control-plane=

	                    node-role.kubernetes.io/master=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /var/run/dockershim.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Fri, 13 Aug 2021 20:20:34 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  functional-20210813131926-8053

	  AcquireTime:     <unset>

	  RenewTime:       Fri, 13 Aug 2021 20:32:52 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Fri, 13 Aug 2021 20:32:42 +0000   Fri, 13 Aug 2021 20:20:34 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Fri, 13 Aug 2021 20:32:42 +0000   Fri, 13 Aug 2021 20:20:34 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Fri, 13 Aug 2021 20:32:42 +0000   Fri, 13 Aug 2021 20:20:34 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Fri, 13 Aug 2021 20:32:42 +0000   Fri, 13 Aug 2021 20:22:41 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.49.2

	  Hostname:    functional-20210813131926-8053

	Capacity:

	  cpu:                6

	  ephemeral-storage:  123591232Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  memory:             6088600Ki

	  pods:               110

	Allocatable:

	  cpu:                6

	  ephemeral-storage:  123591232Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  memory:             6088600Ki

	  pods:               110

	System Info:

	  Machine ID:                 dfc5def84a78402c9caa00a7cad25a86

	  System UUID:                c2a53005-c520-4b31-be6f-0d97f1736775

	  Boot ID:                    9c1335d8-2b93-45e8-96a7-e09bd9b095e5

	  Kernel Version:             5.10.25-linuxkit

	  OS Image:                   Ubuntu 20.04.2 LTS

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  docker://20.10.8

	  Kubelet Version:            v1.21.3

	  Kube-Proxy Version:         v1.21.3

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (11 in total)

	  Namespace                   Name                                                      CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                                      ------------  ----------  ---------------  -------------  ---

	  default                     hello-node-6cbfcd7cbc-j6gqr                               0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         10s

	  default                     mysql-9bbbc5bbb-lshfp                                     600m (10%!)(MISSING)    700m (11%!)(MISSING)  512Mi (8%!)(MISSING)       700Mi (11%!)(MISSING)    10m

	  default                     nginx-svc                                                 0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         10m

	  default                     sp-pod                                                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m18s

	  kube-system                 coredns-558bd4d5db-rhdvr                                  100m (1%!)(MISSING)     0 (0%!)(MISSING)      70Mi (1%!)(MISSING)        170Mi (2%!)(MISSING)     12m

	  kube-system                 etcd-functional-20210813131926-8053                       100m (1%!)(MISSING)     0 (0%!)(MISSING)      100Mi (1%!)(MISSING)       0 (0%!)(MISSING)         12m

	  kube-system                 kube-apiserver-functional-20210813131926-8053             250m (4%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         10m

	  kube-system                 kube-controller-manager-functional-20210813131926-8053    200m (3%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         12m

	  kube-system                 kube-proxy-kv9mv                                          0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         12m

	  kube-system                 kube-scheduler-functional-20210813131926-8053             100m (1%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         12m

	  kube-system                 storage-provisioner                                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         12m

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests     Limits

	  --------           --------     ------

	  cpu                1350m (22%!)(MISSING)  700m (11%!)(MISSING)

	  memory             682Mi (11%!)(MISSING)  870Mi (14%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)       0 (0%!)(MISSING)

	  hugepages-1Gi      0 (0%!)(MISSING)       0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)       0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                From        Message

	  ----    ------                   ----               ----        -------

	  Normal  NodeHasNoDiskPressure    12m (x4 over 12m)  kubelet     Node functional-20210813131926-8053 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     12m (x4 over 12m)  kubelet     Node functional-20210813131926-8053 status is now: NodeHasSufficientPID

	  Normal  NodeHasSufficientMemory  12m (x5 over 12m)  kubelet     Node functional-20210813131926-8053 status is now: NodeHasSufficientMemory

	  Normal  Starting                 12m                kubelet     Starting kubelet.

	  Normal  NodeHasSufficientMemory  12m                kubelet     Node functional-20210813131926-8053 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    12m                kubelet     Node functional-20210813131926-8053 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     12m                kubelet     Node functional-20210813131926-8053 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  12m                kubelet     Updated Node Allocatable limit across pods

	  Normal  NodeReady                12m                kubelet     Node functional-20210813131926-8053 status is now: NodeReady

	  Normal  Starting                 12m                kube-proxy  Starting kube-proxy.

	  Normal  Starting                 10m                kube-proxy  Starting kube-proxy.

	  Normal  Starting                 10m                kubelet     Starting kubelet.

	  Normal  NodeHasSufficientMemory  10m                kubelet     Node functional-20210813131926-8053 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    10m                kubelet     Node functional-20210813131926-8053 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     10m                kubelet     Node functional-20210813131926-8053 status is now: NodeHasSufficientPID

	  Normal  NodeNotReady             10m                kubelet     Node functional-20210813131926-8053 status is now: NodeNotReady

	  Normal  NodeAllocatableEnforced  10m                kubelet     Updated Node Allocatable limit across pods

	  Normal  NodeReady                10m                kubelet     Node functional-20210813131926-8053 status is now: NodeReady

	* 

	* ==> dmesg <==

	* [  +0.033093] bpfilter: read fail 0

	[  +0.031205] bpfilter: read fail 0

	[  +0.026864] bpfilter: read fail 0

	[  +0.035289] bpfilter: read fail 0

	[  +0.036443] bpfilter: write fail -32

	[  +0.030210] bpfilter: read fail 0

	[  +0.030528] bpfilter: write fail -32

	[  +0.024344] bpfilter: read fail 0

	[  +0.035577] bpfilter: read fail 0

	[  +0.031017] bpfilter: read fail 0

	[  +0.025831] bpfilter: read fail 0

	[  +0.032816] bpfilter: read fail 0

	[  +0.031101] bpfilter: read fail 0

	[  +0.034082] bpfilter: read fail 0

	[  +0.028483] bpfilter: read fail 0

	[  +0.029605] bpfilter: read fail 0

	[  +0.025510] bpfilter: read fail 0

	[  +0.029560] bpfilter: read fail 0

	[  +0.031527] bpfilter: read fail 0

	[  +0.030956] bpfilter: read fail 0

	[  +0.024161] bpfilter: read fail 0

	[  +0.024759] bpfilter: read fail 0

	[  +0.023973] bpfilter: read fail 0

	[  +0.026616] bpfilter: write fail -32

	[  +0.034382] bpfilter: read fail 0

	* 

	* ==> etcd [48d06bb7b791] <==

	* 2021-08-13 20:29:15.345264 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:29:25.323792 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:29:35.324540 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:29:45.323926 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:29:55.302474 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:30:05.302850 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:30:15.301830 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:30:25.280676 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:30:35.281189 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:30:45.280793 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:30:55.263828 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:31:05.263873 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:31:15.264063 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:31:25.258600 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:31:35.258049 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:31:45.257394 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:31:55.237694 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:32:05.237978 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:32:15.238784 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:32:25.216857 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:32:35.216974 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:32:35.623551 I | mvcc: store.index: compact 904

	2021-08-13 20:32:35.624609 I | mvcc: finished scheduled compaction at 904 (took 537.61µs)

	2021-08-13 20:32:45.217826 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:32:55.194786 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	* 

	* ==> etcd [52fbb2e72ccf] <==

	* raft2021/08/13 20:20:29 INFO: aec36adc501070cc is starting a new election at term 1

	raft2021/08/13 20:20:29 INFO: aec36adc501070cc became candidate at term 2

	raft2021/08/13 20:20:29 INFO: aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2

	raft2021/08/13 20:20:29 INFO: aec36adc501070cc became leader at term 2

	raft2021/08/13 20:20:29 INFO: raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2

	2021-08-13 20:20:29.449928 I | etcdserver: published {Name:functional-20210813131926-8053 ClientURLs:[https://192.168.49.2:2379]} to cluster fa54960ea34d58be

	2021-08-13 20:20:29.449956 I | embed: ready to serve client requests

	2021-08-13 20:20:29.450201 I | embed: ready to serve client requests

	2021-08-13 20:20:29.451895 I | embed: serving client requests on 192.168.49.2:2379

	2021-08-13 20:20:29.452662 I | etcdserver: setting up the initial cluster version to 3.4

	2021-08-13 20:20:29.453525 N | etcdserver/membership: set the initial cluster version to 3.4

	2021-08-13 20:20:29.453720 I | etcdserver/api: enabled capabilities for version 3.4

	2021-08-13 20:20:29.453832 I | embed: serving client requests on 127.0.0.1:2379

	2021-08-13 20:20:40.277076 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:20:48.493155 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:20:50.276798 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:21:00.256457 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:21:10.255657 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:21:20.255420 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:21:30.234727 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:21:40.237560 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:21:50.233853 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2021-08-13 20:21:59.424601 N | pkg/osutil: received terminated signal, shutting down...

	WARNING: 2021/08/13 20:21:59 grpc: addrConn.createTransport failed to connect to {127.0.0.1:2379  <nil> 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...

	2021-08-13 20:21:59.469510 I | etcdserver: skipped leadership transfer for single voting member cluster

	* 

	* ==> kernel <==

	*  20:33:01 up 18 min,  0 users,  load average: 0.47, 0.38, 0.46

	Linux functional-20210813131926-8053 5.10.25-linuxkit #1 SMP Tue Mar 23 09:27:39 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux

	PRETTY_NAME="Ubuntu 20.04.2 LTS"

	* 

	* ==> kube-apiserver [6d69afd52f8c] <==

	* I0813 20:27:55.659586       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	I0813 20:28:37.647723       1 client.go:360] parsed scheme: "passthrough"

	I0813 20:28:37.647830       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I0813 20:28:37.647840       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	I0813 20:29:11.752795       1 client.go:360] parsed scheme: "passthrough"

	I0813 20:29:11.752879       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I0813 20:29:11.752944       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	I0813 20:29:45.073467       1 client.go:360] parsed scheme: "passthrough"

	I0813 20:29:45.073550       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I0813 20:29:45.073561       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	I0813 20:30:28.829667       1 client.go:360] parsed scheme: "passthrough"

	I0813 20:30:28.829779       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I0813 20:30:28.829800       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	I0813 20:31:02.238141       1 client.go:360] parsed scheme: "passthrough"

	I0813 20:31:02.238294       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I0813 20:31:02.238319       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	I0813 20:31:43.909829       1 client.go:360] parsed scheme: "passthrough"

	I0813 20:31:43.909908       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I0813 20:31:43.909918       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	I0813 20:32:19.339052       1 client.go:360] parsed scheme: "passthrough"

	I0813 20:32:19.339095       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I0813 20:32:19.339181       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	I0813 20:32:59.059003       1 client.go:360] parsed scheme: "passthrough"

	I0813 20:32:59.059049       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I0813 20:32:59.059056       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	* 

	* ==> kube-apiserver [83fc53fcb046] <==

	* Flag --insecure-port has been deprecated, This flag has no effect now and will be removed in v1.24.

	I0813 20:22:16.559861       1 server.go:629] external host was not specified, using 192.168.49.2

	I0813 20:22:16.560215       1 server.go:181] Version: v1.21.3

	Error: failed to create listener: failed to listen on 0.0.0.0:8441: listen tcp 0.0.0.0:8441: bind: address already in use

	* 

	* ==> kube-controller-manager [60451e7f160d] <==

	* I0813 20:20:48.273552       1 shared_informer.go:247] Caches are synced for job 

	I0813 20:20:48.282298       1 shared_informer.go:247] Caches are synced for deployment 

	I0813 20:20:48.293694       1 shared_informer.go:247] Caches are synced for endpoint 

	I0813 20:20:48.305431       1 shared_informer.go:247] Caches are synced for persistent volume 

	I0813 20:20:48.305477       1 shared_informer.go:247] Caches are synced for ReplicaSet 

	I0813 20:20:48.306702       1 shared_informer.go:247] Caches are synced for PVC protection 

	I0813 20:20:48.306734       1 shared_informer.go:247] Caches are synced for daemon sets 

	I0813 20:20:48.306739       1 shared_informer.go:247] Caches are synced for ReplicationController 

	I0813 20:20:48.354976       1 shared_informer.go:247] Caches are synced for taint 

	I0813 20:20:48.355035       1 node_lifecycle_controller.go:1398] Initializing eviction metric for zone: 

	W0813 20:20:48.355070       1 node_lifecycle_controller.go:1013] Missing timestamp for Node functional-20210813131926-8053. Assuming now as a timestamp.

	I0813 20:20:48.355090       1 node_lifecycle_controller.go:1214] Controller detected that zone  is now in state Normal.

	I0813 20:20:48.355287       1 taint_manager.go:187] "Starting NoExecuteTaintManager"

	I0813 20:20:48.355539       1 event.go:291] "Event occurred" object="functional-20210813131926-8053" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node functional-20210813131926-8053 event: Registered Node functional-20210813131926-8053 in Controller"

	I0813 20:20:48.363710       1 shared_informer.go:247] Caches are synced for resource quota 

	I0813 20:20:48.459455       1 shared_informer.go:247] Caches are synced for resource quota 

	I0813 20:20:48.813595       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-558bd4d5db to 2"

	I0813 20:20:48.865824       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-558bd4d5db to 1"

	I0813 20:20:48.867323       1 shared_informer.go:247] Caches are synced for garbage collector 

	I0813 20:20:48.867334       1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage

	I0813 20:20:48.878039       1 shared_informer.go:247] Caches are synced for garbage collector 

	I0813 20:20:48.914893       1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-kv9mv"

	I0813 20:20:49.013282       1 event.go:291] "Event occurred" object="kube-system/coredns-558bd4d5db" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-558bd4d5db-v2mbz"

	I0813 20:20:49.019258       1 event.go:291] "Event occurred" object="kube-system/coredns-558bd4d5db" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-558bd4d5db-rhdvr"

	I0813 20:20:49.030463       1 event.go:291] "Event occurred" object="kube-system/coredns-558bd4d5db" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-558bd4d5db-v2mbz"

	* 

	* ==> kube-controller-manager [aca358fec190] <==

	* I0813 20:22:39.385673       1 shared_informer.go:247] Caches are synced for daemon sets 

	I0813 20:22:39.385742       1 shared_informer.go:247] Caches are synced for TTL 

	I0813 20:22:39.392583       1 shared_informer.go:247] Caches are synced for disruption 

	I0813 20:22:39.392613       1 disruption.go:371] Sending events to api server.

	I0813 20:22:39.470556       1 shared_informer.go:247] Caches are synced for attach detach 

	I0813 20:22:39.502015       1 shared_informer.go:247] Caches are synced for resource quota 

	I0813 20:22:39.578946       1 shared_informer.go:247] Caches are synced for taint 

	I0813 20:22:39.579027       1 node_lifecycle_controller.go:1398] Initializing eviction metric for zone: 

	W0813 20:22:39.579072       1 node_lifecycle_controller.go:1013] Missing timestamp for Node functional-20210813131926-8053. Assuming now as a timestamp.

	I0813 20:22:39.579127       1 node_lifecycle_controller.go:1164] Controller detected that all Nodes are not-Ready. Entering master disruption mode.

	I0813 20:22:39.579329       1 taint_manager.go:187] "Starting NoExecuteTaintManager"

	I0813 20:22:39.579508       1 event.go:291] "Event occurred" object="functional-20210813131926-8053" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node functional-20210813131926-8053 event: Registered Node functional-20210813131926-8053 in Controller"

	I0813 20:22:39.585516       1 event.go:291] "Event occurred" object="kube-system/coredns-558bd4d5db-rhdvr" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"

	I0813 20:22:39.587057       1 event.go:291] "Event occurred" object="kube-system/kube-proxy-kv9mv" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"

	I0813 20:22:39.594768       1 shared_informer.go:247] Caches are synced for resource quota 

	I0813 20:22:39.960552       1 shared_informer.go:247] Caches are synced for garbage collector 

	I0813 20:22:39.960608       1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage

	I0813 20:22:40.005112       1 shared_informer.go:247] Caches are synced for garbage collector 

	I0813 20:22:44.579703       1 node_lifecycle_controller.go:1191] Controller detected that some Nodes are Ready. Exiting master disruption mode.

	I0813 20:22:57.981698       1 event.go:291] "Event occurred" object="default/mysql" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set mysql-9bbbc5bbb to 1"

	I0813 20:22:57.989664       1 event.go:291] "Event occurred" object="default/mysql-9bbbc5bbb" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: mysql-9bbbc5bbb-lshfp"

	I0813 20:29:43.578145       1 event.go:291] "Event occurred" object="default/myclaim" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="waiting for a volume to be created, either by external provisioner \"k8s.io/minikube-hostpath\" or manually created by system administrator"

	I0813 20:29:43.578196       1 event.go:291] "Event occurred" object="default/myclaim" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="waiting for a volume to be created, either by external provisioner \"k8s.io/minikube-hostpath\" or manually created by system administrator"

	I0813 20:32:51.978159       1 event.go:291] "Event occurred" object="default/hello-node" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set hello-node-6cbfcd7cbc to 1"

	I0813 20:32:51.982205       1 event.go:291] "Event occurred" object="default/hello-node-6cbfcd7cbc" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: hello-node-6cbfcd7cbc-j6gqr"

	* 

	* ==> kube-proxy [0237d371d391] <==

	* I0813 20:20:49.964466       1 node.go:172] Successfully retrieved node IP: 192.168.49.2

	I0813 20:20:49.964521       1 server_others.go:140] Detected node IP 192.168.49.2

	W0813 20:20:49.964567       1 server_others.go:598] Unknown proxy mode "", assuming iptables proxy

	I0813 20:20:52.244100       1 server_others.go:206] kube-proxy running in dual-stack mode, IPv4-primary

	I0813 20:20:52.244135       1 server_others.go:212] Using iptables Proxier.

	I0813 20:20:52.244143       1 server_others.go:219] creating dualStackProxier for iptables.

	W0813 20:20:52.244150       1 server_others.go:512] detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6

	I0813 20:20:52.244421       1 server.go:643] Version: v1.21.3

	I0813 20:20:52.244978       1 config.go:315] Starting service config controller

	I0813 20:20:52.245004       1 shared_informer.go:240] Waiting for caches to sync for service config

	I0813 20:20:52.245304       1 config.go:224] Starting endpoint slice config controller

	I0813 20:20:52.245329       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config

	W0813 20:20:52.248097       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	W0813 20:20:52.249674       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	I0813 20:20:52.345268       1 shared_informer.go:247] Caches are synced for service config 

	I0813 20:20:52.346418       1 shared_informer.go:247] Caches are synced for endpoint slice config 

	I0813 20:21:06.307240       1 trace.go:205] Trace[128053735]: "iptables restore" (13-Aug-2021 20:21:04.237) (total time: 2070ms):

	Trace[128053735]: [2.070087345s] [2.070087345s] END

	I0813 20:21:16.207178       1 trace.go:205] Trace[1148819465]: "iptables restore" (13-Aug-2021 20:21:14.011) (total time: 2195ms):

	Trace[1148819465]: [2.195338087s] [2.195338087s] END

	I0813 20:21:39.273178       1 trace.go:205] Trace[1324115582]: "iptables restore" (13-Aug-2021 20:21:36.931) (total time: 2341ms):

	Trace[1324115582]: [2.341227915s] [2.341227915s] END

	* 

	* ==> kube-proxy [a4dbf0c14cf5] <==

	* I0813 20:22:04.765017       1 server_others.go:140] Detected node IP 192.168.49.2

	W0813 20:22:04.765060       1 server_others.go:598] Unknown proxy mode "", assuming iptables proxy

	I0813 20:22:07.101758       1 server_others.go:206] kube-proxy running in dual-stack mode, IPv4-primary

	I0813 20:22:07.101850       1 server_others.go:212] Using iptables Proxier.

	I0813 20:22:07.101859       1 server_others.go:219] creating dualStackProxier for iptables.

	W0813 20:22:07.101866       1 server_others.go:512] detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6

	I0813 20:22:07.102184       1 server.go:643] Version: v1.21.3

	I0813 20:22:07.102649       1 config.go:224] Starting endpoint slice config controller

	I0813 20:22:07.102742       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config

	I0813 20:22:07.102831       1 config.go:315] Starting service config controller

	I0813 20:22:07.102858       1 shared_informer.go:240] Waiting for caches to sync for service config

	W0813 20:22:07.108215       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	W0813 20:22:07.108883       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	I0813 20:22:07.203497       1 shared_informer.go:247] Caches are synced for endpoint slice config 

	I0813 20:22:07.203527       1 shared_informer.go:247] Caches are synced for service config 

	W0813 20:22:46.682122       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	I0813 20:22:49.877698       1 trace.go:205] Trace[478025731]: "iptables restore" (13-Aug-2021 20:22:47.667) (total time: 2210ms):

	Trace[478025731]: [2.210559754s] [2.210559754s] END

	I0813 20:23:00.966502       1 trace.go:205] Trace[2044389093]: "iptables restore" (13-Aug-2021 20:22:58.326) (total time: 2639ms):

	Trace[2044389093]: [2.639728438s] [2.639728438s] END

	I0813 20:23:10.121891       1 trace.go:205] Trace[1905563068]: "iptables restore" (13-Aug-2021 20:23:08.026) (total time: 2094ms):

	Trace[1905563068]: [2.094948379s] [2.094948379s] END

	I0813 20:23:19.793687       1 trace.go:205] Trace[988007401]: "iptables restore" (13-Aug-2021 20:23:17.584) (total time: 2208ms):

	Trace[988007401]: [2.208915023s] [2.208915023s] END

	W0813 20:32:03.297922       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

	* 

	* ==> kube-scheduler [702cee73a40c] <==

	* I0813 20:22:01.509672       1 serving.go:347] Generated self-signed cert in-memory

	W0813 20:22:04.723419       1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'

	W0813 20:22:04.723453       1 authentication.go:337] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"

	W0813 20:22:04.723459       1 authentication.go:338] Continuing without authentication configuration. This may treat all requests as anonymous.

	W0813 20:22:04.723462       1 authentication.go:339] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false

	I0813 20:22:04.775715       1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0813 20:22:04.775753       1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0813 20:22:04.775897       1 secure_serving.go:197] Serving securely on 127.0.0.1:10259

	I0813 20:22:04.775954       1 tlsconfig.go:240] Starting DynamicServingCertificateController

	I0813 20:22:04.876958       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 

	* 

	* ==> kube-scheduler [9d5404187c66] <==

	* W0813 20:20:32.597185       1 authentication.go:337] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"

	W0813 20:20:32.597203       1 authentication.go:338] Continuing without authentication configuration. This may treat all requests as anonymous.

	W0813 20:20:32.597209       1 authentication.go:339] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false

	I0813 20:20:32.636201       1 secure_serving.go:197] Serving securely on 127.0.0.1:10259

	I0813 20:20:32.636276       1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0813 20:20:32.636280       1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I0813 20:20:32.636287       1 tlsconfig.go:240] Starting DynamicServingCertificateController

	E0813 20:20:32.638772       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0813 20:20:32.639124       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0813 20:20:32.639163       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0813 20:20:32.639717       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0813 20:20:32.639970       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0813 20:20:32.639991       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0813 20:20:32.639972       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0813 20:20:32.640465       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.CSIStorageCapacity: failed to list *v1beta1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0813 20:20:32.640478       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E0813 20:20:32.641351       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0813 20:20:32.641376       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E0813 20:20:32.641817       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E0813 20:20:32.642227       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0813 20:20:32.643414       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0813 20:20:33.468213       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0813 20:20:33.582738       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0813 20:20:33.719031       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	I0813 20:20:33.936406       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 

	* 

	* ==> kubelet <==

	* -- Logs begin at Fri 2021-08-13 20:19:47 UTC, end at Fri 2021-08-13 20:33:02 UTC. --

	Aug 13 20:31:54 functional-20210813131926-8053 kubelet[6370]: E0813 20:31:54.208001    6370 pod_workers.go:190] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mysql\" with ImagePullBackOff: \"Back-off pulling image \\\"mysql:5.7\\\"\"" pod="default/mysql-9bbbc5bbb-lshfp" podUID=70efc65e-2c48-4fca-a41d-dd89eab324d3

	Aug 13 20:32:00 functional-20210813131926-8053 kubelet[6370]: E0813 20:32:00.207905    6370 pod_workers.go:190] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"myfrontend\" with ImagePullBackOff: \"Back-off pulling image \\\"nginx\\\"\"" pod="default/sp-pod" podUID=f8a642d9-155f-43e2-a275-0270f2d99291

	Aug 13 20:32:07 functional-20210813131926-8053 kubelet[6370]: E0813 20:32:07.206871    6370 pod_workers.go:190] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nginx\" with ImagePullBackOff: \"Back-off pulling image \\\"nginx:alpine\\\"\"" pod="default/nginx-svc" podUID=071bcc6b-e1dc-45aa-9126-fc27c1021b6b

	Aug 13 20:32:09 functional-20210813131926-8053 kubelet[6370]: E0813 20:32:09.208111    6370 pod_workers.go:190] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mysql\" with ImagePullBackOff: \"Back-off pulling image \\\"mysql:5.7\\\"\"" pod="default/mysql-9bbbc5bbb-lshfp" podUID=70efc65e-2c48-4fca-a41d-dd89eab324d3

	Aug 13 20:32:10 functional-20210813131926-8053 kubelet[6370]: W0813 20:32:10.713255    6370 sysinfo.go:203] Nodes topology is not available, providing CPU topology

	Aug 13 20:32:14 functional-20210813131926-8053 kubelet[6370]: E0813 20:32:14.209168    6370 pod_workers.go:190] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"myfrontend\" with ImagePullBackOff: \"Back-off pulling image \\\"nginx\\\"\"" pod="default/sp-pod" podUID=f8a642d9-155f-43e2-a275-0270f2d99291

	Aug 13 20:32:19 functional-20210813131926-8053 kubelet[6370]: E0813 20:32:19.207550    6370 pod_workers.go:190] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nginx\" with ImagePullBackOff: \"Back-off pulling image \\\"nginx:alpine\\\"\"" pod="default/nginx-svc" podUID=071bcc6b-e1dc-45aa-9126-fc27c1021b6b

	Aug 13 20:32:21 functional-20210813131926-8053 kubelet[6370]: E0813 20:32:21.185777    6370 pod_workers.go:190] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mysql\" with ImagePullBackOff: \"Back-off pulling image \\\"mysql:5.7\\\"\"" pod="default/mysql-9bbbc5bbb-lshfp" podUID=70efc65e-2c48-4fca-a41d-dd89eab324d3

	Aug 13 20:32:26 functional-20210813131926-8053 kubelet[6370]: E0813 20:32:26.186687    6370 pod_workers.go:190] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"myfrontend\" with ImagePullBackOff: \"Back-off pulling image \\\"nginx\\\"\"" pod="default/sp-pod" podUID=f8a642d9-155f-43e2-a275-0270f2d99291

	Aug 13 20:32:30 functional-20210813131926-8053 kubelet[6370]: E0813 20:32:30.187114    6370 pod_workers.go:190] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nginx\" with ImagePullBackOff: \"Back-off pulling image \\\"nginx:alpine\\\"\"" pod="default/nginx-svc" podUID=071bcc6b-e1dc-45aa-9126-fc27c1021b6b

	Aug 13 20:32:35 functional-20210813131926-8053 kubelet[6370]: E0813 20:32:35.187203    6370 pod_workers.go:190] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mysql\" with ImagePullBackOff: \"Back-off pulling image \\\"mysql:5.7\\\"\"" pod="default/mysql-9bbbc5bbb-lshfp" podUID=70efc65e-2c48-4fca-a41d-dd89eab324d3

	Aug 13 20:32:38 functional-20210813131926-8053 kubelet[6370]: E0813 20:32:38.374395    6370 remote_image.go:114] "PullImage from image service failed" err="rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit" image="nginx:latest"

	Aug 13 20:32:38 functional-20210813131926-8053 kubelet[6370]: E0813 20:32:38.374460    6370 kuberuntime_image.go:51] "Failed to pull image" err="rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit" image="nginx:latest"

	Aug 13 20:32:38 functional-20210813131926-8053 kubelet[6370]: E0813 20:32:38.374532    6370 kuberuntime_manager.go:864] container &Container{Name:myfrontend,Image:nginx,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:mypd,ReadOnly:false,MountPath:/tmp/mount,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:kube-api-access-plv7j,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,} start failed in pod sp-pod_default(f8a642d9-155f-43e2-a275-0270f2d99291): ErrImagePull: rpc error: code = Unknown desc = Error re

sponse from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit

	Aug 13 20:32:38 functional-20210813131926-8053 kubelet[6370]: E0813 20:32:38.374559    6370 pod_workers.go:190] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"myfrontend\" with ErrImagePull: \"rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit\"" pod="default/sp-pod" podUID=f8a642d9-155f-43e2-a275-0270f2d99291

	Aug 13 20:32:41 functional-20210813131926-8053 kubelet[6370]: E0813 20:32:41.186935    6370 pod_workers.go:190] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nginx\" with ImagePullBackOff: \"Back-off pulling image \\\"nginx:alpine\\\"\"" pod="default/nginx-svc" podUID=071bcc6b-e1dc-45aa-9126-fc27c1021b6b

	Aug 13 20:32:49 functional-20210813131926-8053 kubelet[6370]: E0813 20:32:49.186158    6370 pod_workers.go:190] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"myfrontend\" with ImagePullBackOff: \"Back-off pulling image \\\"nginx\\\"\"" pod="default/sp-pod" podUID=f8a642d9-155f-43e2-a275-0270f2d99291

	Aug 13 20:32:50 functional-20210813131926-8053 kubelet[6370]: E0813 20:32:50.165173    6370 pod_workers.go:190] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mysql\" with ImagePullBackOff: \"Back-off pulling image \\\"mysql:5.7\\\"\"" pod="default/mysql-9bbbc5bbb-lshfp" podUID=70efc65e-2c48-4fca-a41d-dd89eab324d3

	Aug 13 20:32:51 functional-20210813131926-8053 kubelet[6370]: I0813 20:32:51.985892    6370 topology_manager.go:187] "Topology Admit Handler"

	Aug 13 20:32:52 functional-20210813131926-8053 kubelet[6370]: I0813 20:32:52.173661    6370 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7f2f\" (UniqueName: \"kubernetes.io/projected/0e1d1c47-4c5a-41dc-a919-02e193373993-kube-api-access-t7f2f\") pod \"hello-node-6cbfcd7cbc-j6gqr\" (UID: \"0e1d1c47-4c5a-41dc-a919-02e193373993\") "

	Aug 13 20:32:52 functional-20210813131926-8053 kubelet[6370]: I0813 20:32:52.511787    6370 docker_sandbox.go:401] "Failed to read pod IP from plugin/docker" err="Couldn't find network status for default/hello-node-6cbfcd7cbc-j6gqr through plugin: invalid network status for"

	Aug 13 20:32:53 functional-20210813131926-8053 kubelet[6370]: E0813 20:32:53.012487    6370 cadvisor_stats_provider.go:151] "Unable to fetch pod etc hosts stats" err="failed to get stats failed command 'du' ($ nice -n 19 du -x -s -B 1) on path /var/lib/kubelet/pods/0e1d1c47-4c5a-41dc-a919-02e193373993/etc-hosts with error exit status 1" pod="default/hello-node-6cbfcd7cbc-j6gqr"

	Aug 13 20:32:53 functional-20210813131926-8053 kubelet[6370]: I0813 20:32:53.106324    6370 docker_sandbox.go:401] "Failed to read pod IP from plugin/docker" err="Couldn't find network status for default/hello-node-6cbfcd7cbc-j6gqr through plugin: invalid network status for"

	Aug 13 20:32:54 functional-20210813131926-8053 kubelet[6370]: E0813 20:32:54.164723    6370 pod_workers.go:190] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nginx\" with ImagePullBackOff: \"Back-off pulling image \\\"nginx:alpine\\\"\"" pod="default/nginx-svc" podUID=071bcc6b-e1dc-45aa-9126-fc27c1021b6b

	Aug 13 20:32:56 functional-20210813131926-8053 kubelet[6370]: I0813 20:32:56.132583    6370 docker_sandbox.go:401] "Failed to read pod IP from plugin/docker" err="Couldn't find network status for default/hello-node-6cbfcd7cbc-j6gqr through plugin: invalid network status for"

	* 

	* ==> storage-provisioner [b2296fd0d1e9] <==

	* I0813 20:22:16.010598       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0813 20:22:16.019564       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0813 20:22:16.019654       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	E0813 20:22:19.475117       1 leaderelection.go:325] error retrieving resource lock kube-system/k8s.io-minikube-hostpath: Get "https://10.96.0.1:443/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath": dial tcp 10.96.0.1:443: connect: connection refused

	E0813 20:22:23.712008       1 leaderelection.go:325] error retrieving resource lock kube-system/k8s.io-minikube-hostpath: Get "https://10.96.0.1:443/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath": dial tcp 10.96.0.1:443: connect: connection refused

	E0813 20:22:27.307605       1 leaderelection.go:325] error retrieving resource lock kube-system/k8s.io-minikube-hostpath: Get "https://10.96.0.1:443/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath": dial tcp 10.96.0.1:443: connect: connection refused

	E0813 20:22:30.359555       1 leaderelection.go:325] error retrieving resource lock kube-system/k8s.io-minikube-hostpath: Get "https://10.96.0.1:443/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath": dial tcp 10.96.0.1:443: connect: connection refused

	E0813 20:22:33.380137       1 leaderelection.go:325] error retrieving resource lock kube-system/k8s.io-minikube-hostpath: Get "https://10.96.0.1:443/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath": dial tcp 10.96.0.1:443: connect: connection refused

	I0813 20:22:38.347369       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0813 20:22:38.347493       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_functional-20210813131926-8053_281ee2df-bf55-432e-9ac9-afb821b0ef0f!

	I0813 20:22:38.347810       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"f3924885-42ee-4404-b92b-18e2b80efef1", APIVersion:"v1", ResourceVersion:"551", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' functional-20210813131926-8053_281ee2df-bf55-432e-9ac9-afb821b0ef0f became leader

	I0813 20:22:38.448501       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_functional-20210813131926-8053_281ee2df-bf55-432e-9ac9-afb821b0ef0f!

	I0813 20:29:43.578609       1 controller.go:1332] provision "default/myclaim" class "standard": started

	I0813 20:29:43.578718       1 storage_provisioner.go:61] Provisioning volume {&StorageClass{ObjectMeta:{standard    681645c7-4736-455d-aede-1399bb5408a9 449 0 2021-08-13 20:20:50 +0000 UTC <nil> <nil> map[addonmanager.kubernetes.io/mode:EnsureExists] map[kubectl.kubernetes.io/last-applied-configuration:{"apiVersion":"storage.k8s.io/v1","kind":"StorageClass","metadata":{"annotations":{"storageclass.kubernetes.io/is-default-class":"true"},"labels":{"addonmanager.kubernetes.io/mode":"EnsureExists"},"name":"standard"},"provisioner":"k8s.io/minikube-hostpath"}

	 storageclass.kubernetes.io/is-default-class:true] [] []  [{kubectl-client-side-apply Update storage.k8s.io/v1 2021-08-13 20:20:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubectl.kubernetes.io/last-applied-configuration":{},"f:storageclass.kubernetes.io/is-default-class":{}},"f:labels":{".":{},"f:addonmanager.kubernetes.io/mode":{}}},"f:provisioner":{},"f:reclaimPolicy":{},"f:volumeBindingMode":{}}}]},Provisioner:k8s.io/minikube-hostpath,Parameters:map[string]string{},ReclaimPolicy:*Delete,MountOptions:[],AllowVolumeExpansion:nil,VolumeBindingMode:*Immediate,AllowedTopologies:[]TopologySelectorTerm{},} pvc-3049133e-dcfb-4f13-8cfe-e5ce6120b54b &PersistentVolumeClaim{ObjectMeta:{myclaim  default  3049133e-dcfb-4f13-8cfe-e5ce6120b54b 1002 0 2021-08-13 20:29:43 +0000 UTC <nil> <nil> map[] map[kubectl.kubernetes.io/last-applied-configuration:{"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"name":"myclaim","namespace":"default"},"spec":{"accessModes":["Re

adWriteOnce"],"resources":{"requests":{"storage":"500Mi"}},"volumeMode":"Filesystem"}}

	 volume.beta.kubernetes.io/storage-provisioner:k8s.io/minikube-hostpath] [] [kubernetes.io/pvc-protection]  [{kube-controller-manager Update v1 2021-08-13 20:29:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:volume.beta.kubernetes.io/storage-provisioner":{}}}}} {kubectl-client-side-apply Update v1 2021-08-13 20:29:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubectl.kubernetes.io/last-applied-configuration":{}}},"f:spec":{"f:accessModes":{},"f:resources":{"f:requests":{".":{},"f:storage":{}}},"f:volumeMode":{}}}}]},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{524288000 0} {<nil>} 500Mi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*standard,VolumeMode:*Filesystem,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},},} nil} to /tmp/hostpath-provisioner/default/myclaim

	I0813 20:29:43.579047       1 controller.go:1439] provision "default/myclaim" class "standard": volume "pvc-3049133e-dcfb-4f13-8cfe-e5ce6120b54b" provisioned

	I0813 20:29:43.579149       1 controller.go:1456] provision "default/myclaim" class "standard": succeeded

	I0813 20:29:43.579174       1 volume_store.go:212] Trying to save persistentvolume "pvc-3049133e-dcfb-4f13-8cfe-e5ce6120b54b"

	I0813 20:29:43.579047       1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"myclaim", UID:"3049133e-dcfb-4f13-8cfe-e5ce6120b54b", APIVersion:"v1", ResourceVersion:"1002", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/myclaim"

	I0813 20:29:43.591663       1 volume_store.go:219] persistentvolume "pvc-3049133e-dcfb-4f13-8cfe-e5ce6120b54b" saved

	I0813 20:29:43.592021       1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"myclaim", UID:"3049133e-dcfb-4f13-8cfe-e5ce6120b54b", APIVersion:"v1", ResourceVersion:"1002", FieldPath:""}): type: 'Normal' reason: 'ProvisioningSucceeded' Successfully provisioned volume pvc-3049133e-dcfb-4f13-8cfe-e5ce6120b54b

	* 

	* ==> storage-provisioner [c9cb7d5809d8] <==

	* I0813 20:21:21.763366       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0813 20:21:21.770235       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0813 20:21:21.770261       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I0813 20:21:21.783492       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0813 20:21:21.783642       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_functional-20210813131926-8053_89caf2fd-c393-4aa5-aa11-ee255d4b4c7a!

	I0813 20:21:21.783642       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"f3924885-42ee-4404-b92b-18e2b80efef1", APIVersion:"v1", ResourceVersion:"479", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' functional-20210813131926-8053_89caf2fd-c393-4aa5-aa11-ee255d4b4c7a became leader

	I0813 20:21:21.885038       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_functional-20210813131926-8053_89caf2fd-c393-4aa5-aa11-ee255d4b4c7a!

-- /stdout --

helpers_test.go:255: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.APIServer}} -p functional-20210813131926-8053 -n functional-20210813131926-8053

=== CONT  TestFunctional/parallel/MySQL

helpers_test.go:262: (dbg) Run:  kubectl --context functional-20210813131926-8053 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:271: non-running pods: mysql-9bbbc5bbb-lshfp nginx-svc sp-pod

helpers_test.go:273: ======> post-mortem[TestFunctional/parallel/MySQL]: describe non-running pods <======

helpers_test.go:276: (dbg) Run:  kubectl --context functional-20210813131926-8053 describe pod mysql-9bbbc5bbb-lshfp nginx-svc sp-pod

helpers_test.go:281: (dbg) kubectl --context functional-20210813131926-8053 describe pod mysql-9bbbc5bbb-lshfp nginx-svc sp-pod:

-- stdout --

	Name:         mysql-9bbbc5bbb-lshfp

	Namespace:    default

	Priority:     0

	Node:         functional-20210813131926-8053/192.168.49.2

	Start Time:   Fri, 13 Aug 2021 13:22:57 -0700

	Labels:       app=mysql

	              pod-template-hash=9bbbc5bbb

	Annotations:  <none>

	Status:       Pending

	IP:           172.17.0.3

	IPs:

	  IP:           172.17.0.3

	Controlled By:  ReplicaSet/mysql-9bbbc5bbb

	Containers:

	  mysql:

	    Container ID:   

	    Image:          mysql:5.7

	    Image ID:       

	    Port:           3306/TCP

	    Host Port:      0/TCP

	    State:          Waiting

	      Reason:       ImagePullBackOff

	    Ready:          False

	    Restart Count:  0

	    Limits:

	      cpu:     700m

	      memory:  700Mi

	    Requests:

	      cpu:     600m

	      memory:  512Mi

	    Environment:

	      MYSQL_ROOT_PASSWORD:  password

	    Mounts:

	      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-6qxs4 (ro)

	Conditions:

	  Type              Status

	  Initialized       True 

	  Ready             False 

	  ContainersReady   False 

	  PodScheduled      True 

	Volumes:

	  kube-api-access-6qxs4:

	    Type:                    Projected (a volume that contains injected data from multiple sources)

	    TokenExpirationSeconds:  3607

	    ConfigMapName:           kube-root-ca.crt

	    ConfigMapOptional:       <nil>

	    DownwardAPI:             true

	QoS Class:                   Burstable

	Node-Selectors:              <none>

	Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

	                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

	Events:

	  Type     Reason     Age                   From               Message

	  ----     ------     ----                  ----               -------

	  Normal   Scheduled  10m                   default-scheduler  Successfully assigned default/mysql-9bbbc5bbb-lshfp to functional-20210813131926-8053

	  Normal   Pulling    8m32s (x4 over 10m)   kubelet            Pulling image "mysql:5.7"

	  Warning  Failed     8m31s (x4 over 10m)   kubelet            Failed to pull image "mysql:5.7": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit

	  Warning  Failed     8m31s (x4 over 10m)   kubelet            Error: ErrImagePull

	  Warning  Failed     8m20s (x6 over 10m)   kubelet            Error: ImagePullBackOff

	  Normal   BackOff    4m59s (x20 over 10m)  kubelet            Back-off pulling image "mysql:5.7"

	Name:         nginx-svc

	Namespace:    default

	Priority:     0

	Node:         functional-20210813131926-8053/192.168.49.2

	Start Time:   Fri, 13 Aug 2021 13:23:00 -0700

	Labels:       run=nginx-svc

	Annotations:  <none>

	Status:       Pending

	IP:           172.17.0.4

	IPs:

	  IP:  172.17.0.4

	Containers:

	  nginx:

	    Container ID:   

	    Image:          nginx:alpine

	    Image ID:       

	    Port:           80/TCP

	    Host Port:      0/TCP

	    State:          Waiting

	      Reason:       ImagePullBackOff

	    Ready:          False

	    Restart Count:  0

	    Environment:    <none>

	    Mounts:

	      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-fzqr5 (ro)

	Conditions:

	  Type              Status

	  Initialized       True 

	  Ready             False 

	  ContainersReady   False 

	  PodScheduled      True 

	Volumes:

	  kube-api-access-fzqr5:

	    Type:                    Projected (a volume that contains injected data from multiple sources)

	    TokenExpirationSeconds:  3607

	    ConfigMapName:           kube-root-ca.crt

	    ConfigMapOptional:       <nil>

	    DownwardAPI:             true

	QoS Class:                   BestEffort

	Node-Selectors:              <none>

	Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

	                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

	Events:

	  Type     Reason     Age                  From               Message

	  ----     ------     ----                 ----               -------

	  Normal   Scheduled  10m                  default-scheduler  Successfully assigned default/nginx-svc to functional-20210813131926-8053

	  Normal   Pulling    8m35s (x4 over 10m)  kubelet            Pulling image "nginx:alpine"

	  Warning  Failed     8m34s (x4 over 10m)  kubelet            Failed to pull image "nginx:alpine": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit

	  Warning  Failed     8m34s (x4 over 10m)  kubelet            Error: ErrImagePull

	  Warning  Failed     8m21s (x6 over 10m)  kubelet            Error: ImagePullBackOff

	  Normal   BackOff    5m2s (x21 over 10m)  kubelet            Back-off pulling image "nginx:alpine"

	Name:         sp-pod

	Namespace:    default

	Priority:     0

	Node:         functional-20210813131926-8053/192.168.49.2

	Start Time:   Fri, 13 Aug 2021 13:29:43 -0700

	Labels:       test=storage-provisioner

	Annotations:  <none>

	Status:       Pending

	IP:           172.17.0.5

	IPs:

	  IP:  172.17.0.5

	Containers:

	  myfrontend:

	    Container ID:   

	    Image:          nginx

	    Image ID:       

	    Port:           <none>

	    Host Port:      <none>

	    State:          Waiting

	      Reason:       ImagePullBackOff

	    Ready:          False

	    Restart Count:  0

	    Environment:    <none>

	    Mounts:

	      /tmp/mount from mypd (rw)

	      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-plv7j (ro)

	Conditions:

	  Type              Status

	  Initialized       True 

	  Ready             False 

	  ContainersReady   False 

	  PodScheduled      True 

	Volumes:

	  mypd:

	    Type:       PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)

	    ClaimName:  myclaim

	    ReadOnly:   false

	  kube-api-access-plv7j:

	    Type:                    Projected (a volume that contains injected data from multiple sources)

	    TokenExpirationSeconds:  3607

	    ConfigMapName:           kube-root-ca.crt

	    ConfigMapOptional:       <nil>

	    DownwardAPI:             true

	QoS Class:                   BestEffort

	Node-Selectors:              <none>

	Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

	                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

	Events:

	  Type     Reason     Age                   From               Message

	  ----     ------     ----                  ----               -------

	  Normal   Scheduled  3m19s                 default-scheduler  Successfully assigned default/sp-pod to functional-20210813131926-8053

	  Normal   Pulling    108s (x4 over 3m19s)  kubelet            Pulling image "nginx"

	  Warning  Failed     107s (x4 over 3m18s)  kubelet            Failed to pull image "nginx": rpc error: code = Unknown desc = Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit

	  Warning  Failed     107s (x4 over 3m18s)  kubelet            Error: ErrImagePull

	  Warning  Failed     93s (x6 over 3m17s)   kubelet            Error: ImagePullBackOff

	  Normal   BackOff    78s (x7 over 3m17s)   kubelet            Back-off pulling image "nginx"

-- /stdout --

helpers_test.go:284: <<< TestFunctional/parallel/MySQL FAILED: end of post-mortem logs <<<

helpers_test.go:285: ---------------------/post-mortem---------------------------------

--- FAIL: TestFunctional/parallel/MySQL (605.84s)